2024-08-17T02:13:23.865 INFO:root:teuthology version: 1.2.0 2024-08-17T02:13:23.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:13:23.987 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858253 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858253' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:02:08 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:13:23.987 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:13:23.988 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:13:23.988 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:13:23.990 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:13:24.012 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:13:24.012 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:13:24.012 INFO:teuthology.packaging:ref: None 2024-08-17T02:13:24.012 INFO:teuthology.packaging:tag: None 2024-08-17T02:13:24.012 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:13:24.012 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:13:24.013 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:13:24.164 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375-g2577e813-1focal 2024-08-17T02:13:24.165 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:13:24.172 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:13:24.172 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:13:24.196 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:13:24.212 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:13:24.219 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:13:24.243 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858253', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:49.049164', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-08-17T02:13:24.267 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858253', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:49.047912', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-08-17T02:13:24.267 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:13:24.273 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:13:24.273 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:13:24.273 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:13:24.337 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc927807ac0>, signals=[15]) 2024-08-17T02:13:24.337 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:13:24.343 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:13:24.343 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-08-17T02:13:24.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:13:24.439 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2024-08-17T02:13:24.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:13:24.529 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:13:24.536 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-08-17T02:13:24.546 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-08-17T02:13:24.546 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-08-17T02:13:24.593 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu" 2024-08-17T02:13:24.593 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-08-17T02:13:24.593 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu 2024-08-17T02:13:24.593 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian 2024-08-17T02:13:24.593 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-08-17T02:13:24.593 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="20.04" 2024-08-17T02:13:24.594 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-17T02:13:24.594 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-17T02:13:24.594 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-17T02:13:24.594 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-17T02:13:24.594 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=focal 2024-08-17T02:13:24.594 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=focal 2024-08-17T02:13:24.595 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-08-17T02:13:24.618 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-08-17T02:13:24.625 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-08-17T02:13:24.625 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-08-17T02:13:24.673 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Ubuntu" 2024-08-17T02:13:24.673 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-08-17T02:13:24.674 INFO:teuthology.orchestra.run.smithi121.stdout:ID=ubuntu 2024-08-17T02:13:24.674 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE=debian 2024-08-17T02:13:24.674 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-08-17T02:13:24.674 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="20.04" 2024-08-17T02:13:24.674 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-17T02:13:24.674 INFO:teuthology.orchestra.run.smithi121.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-17T02:13:24.674 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-17T02:13:24.674 INFO:teuthology.orchestra.run.smithi121.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-17T02:13:24.674 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_CODENAME=focal 2024-08-17T02:13:24.674 INFO:teuthology.orchestra.run.smithi121.stdout:UBUNTU_CODENAME=focal 2024-08-17T02:13:24.675 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-08-17T02:13:24.693 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:13:24.701 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:13:24.705 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:13:24.706 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:13:24.708 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:13:24.713 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:13:24.719 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:13:24.719 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:13:24.721 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:13:24.825 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:13:24.878 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:13:24.893 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:13:24.893 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-17T02:13:24.893 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:13:24.894 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:13:24.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:13:24.899 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-08-17T02:13:24.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:13:24.901 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-08-17T02:13:24.907 INFO:teuthology.orchestra.run.smithi102.stdout:5.4.0-124-generic 2024-08-17T02:13:24.907 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.4.0-124-generic 2024-08-17T02:13:24.907 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get clean 2024-08-17T02:13:24.908 INFO:teuthology.orchestra.run.smithi121.stdout:5.4.0-124-generic 2024-08-17T02:13:24.908 INFO:teuthology.task.kernel:Running kernel on smithi121: 5.4.0-124-generic 2024-08-17T02:13:24.908 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get clean 2024-08-17T02:13:25.019 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2024-08-17T02:13:25.068 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get update 2024-08-17T02:13:25.199 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:13:25.202 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-08-17T02:13:25.244 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:13:25.244 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-08-17T02:13:25.244 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-08-17T02:13:25.264 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-08-17T02:13:25.303 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-08-17T02:13:25.307 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-08-17T02:13:25.572 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,496 kB] 2024-08-17T02:13:25.618 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [797 kB] 2024-08-17T02:13:25.698 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,126 kB] 2024-08-17T02:13:25.724 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,017 kB] 2024-08-17T02:13:25.740 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [543 kB] 2024-08-17T02:13:25.743 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [464 kB] 2024-08-17T02:13:25.745 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-08-17T02:13:25.745 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.4 kB] 2024-08-17T02:13:25.745 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,152 kB] 2024-08-17T02:13:25.747 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.2 kB] 2024-08-17T02:13:25.747 INFO:teuthology.orchestra.run.smithi121.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.1 kB] 2024-08-17T02:13:25.748 INFO:teuthology.orchestra.run.smithi121.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,034 kB] 2024-08-17T02:13:25.759 INFO:teuthology.orchestra.run.smithi121.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,017 kB] 2024-08-17T02:13:25.769 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [442 kB] 2024-08-17T02:13:25.769 INFO:teuthology.orchestra.run.smithi121.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [425 kB] 2024-08-17T02:13:25.772 INFO:teuthology.orchestra.run.smithi121.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [544 B] 2024-08-17T02:13:25.772 INFO:teuthology.orchestra.run.smithi121.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [999 kB] 2024-08-17T02:13:25.774 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [540 B] 2024-08-17T02:13:25.774 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,219 kB] 2024-08-17T02:13:25.779 INFO:teuthology.orchestra.run.smithi121.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [674 kB] 2024-08-17T02:13:25.783 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [801 kB] 2024-08-17T02:13:25.783 INFO:teuthology.orchestra.run.smithi121.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [212 kB] 2024-08-17T02:13:25.785 INFO:teuthology.orchestra.run.smithi121.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.0 kB] 2024-08-17T02:13:25.785 INFO:teuthology.orchestra.run.smithi121.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-08-17T02:13:25.785 INFO:teuthology.orchestra.run.smithi121.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-08-17T02:13:25.786 INFO:teuthology.orchestra.run.smithi121.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-08-17T02:13:25.790 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [294 kB] 2024-08-17T02:13:25.792 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [27.8 kB] 2024-08-17T02:13:25.792 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-08-17T02:13:25.793 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-08-17T02:13:25.793 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-08-17T02:13:25.793 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-08-17T02:13:25.795 INFO:teuthology.orchestra.run.smithi121.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-08-17T02:13:25.808 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-08-17T02:13:25.808 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-08-17T02:13:25.809 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-08-17T02:13:25.809 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-08-17T02:13:25.829 INFO:teuthology.orchestra.run.smithi121.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,496 kB] 2024-08-17T02:13:25.833 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-08-17T02:13:25.833 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-08-17T02:13:25.867 INFO:teuthology.orchestra.run.smithi121.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [543 kB] 2024-08-17T02:13:25.871 INFO:teuthology.orchestra.run.smithi121.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-08-17T02:13:25.871 INFO:teuthology.orchestra.run.smithi121.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,152 kB] 2024-08-17T02:13:25.892 INFO:teuthology.orchestra.run.smithi121.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.4 kB] 2024-08-17T02:13:25.893 INFO:teuthology.orchestra.run.smithi121.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [442 kB] 2024-08-17T02:13:25.896 INFO:teuthology.orchestra.run.smithi121.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [540 B] 2024-08-17T02:13:25.896 INFO:teuthology.orchestra.run.smithi121.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [801 kB] 2024-08-17T02:13:25.901 INFO:teuthology.orchestra.run.smithi121.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,219 kB] 2024-08-17T02:13:25.909 INFO:teuthology.orchestra.run.smithi121.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [294 kB] 2024-08-17T02:13:25.911 INFO:teuthology.orchestra.run.smithi121.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [27.8 kB] 2024-08-17T02:13:25.911 INFO:teuthology.orchestra.run.smithi121.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-08-17T02:13:25.911 INFO:teuthology.orchestra.run.smithi121.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-08-17T02:13:25.915 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [797 kB] 2024-08-17T02:13:25.924 INFO:teuthology.orchestra.run.smithi121.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-08-17T02:13:25.925 INFO:teuthology.orchestra.run.smithi121.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-08-17T02:13:25.925 INFO:teuthology.orchestra.run.smithi121.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-08-17T02:13:25.925 INFO:teuthology.orchestra.run.smithi121.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-08-17T02:13:25.925 INFO:teuthology.orchestra.run.smithi121.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-08-17T02:13:25.941 INFO:teuthology.orchestra.run.smithi121.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-08-17T02:13:25.941 INFO:teuthology.orchestra.run.smithi121.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-08-17T02:13:25.942 INFO:teuthology.orchestra.run.smithi121.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-08-17T02:13:26.249 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,126 kB] 2024-08-17T02:13:26.441 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [464 kB] 2024-08-17T02:13:26.455 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.2 kB] 2024-08-17T02:13:26.455 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,034 kB] 2024-08-17T02:13:26.547 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.1 kB] 2024-08-17T02:13:26.547 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [425 kB] 2024-08-17T02:13:26.560 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [544 B] 2024-08-17T02:13:26.560 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [999 kB] 2024-08-17T02:13:26.587 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [674 kB] 2024-08-17T02:13:26.601 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [212 kB] 2024-08-17T02:13:26.608 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.0 kB] 2024-08-17T02:13:26.608 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-08-17T02:13:26.613 INFO:teuthology.orchestra.run.smithi102.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-08-17T02:13:26.687 INFO:teuthology.orchestra.run.smithi102.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-08-17T02:13:26.687 INFO:teuthology.orchestra.run.smithi102.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-08-17T02:13:29.949 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 21.4 MB in 3s (7,295 kB/s) 2024-08-17T02:13:30.028 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 21.4 MB in 3s (7,122 kB/s) 2024-08-17T02:13:31.505 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-08-17T02:13:31.530 DEBUG:teuthology.orchestra.run.smithi121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:13:31.545 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-08-17T02:13:31.572 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:13:31.604 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-08-17T02:13:31.642 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-08-17T02:13:31.799 INFO:teuthology.orchestra.run.smithi121.stdout:Building dependency tree... 2024-08-17T02:13:31.800 INFO:teuthology.orchestra.run.smithi121.stdout:Reading state information... 2024-08-17T02:13:31.859 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-08-17T02:13:31.859 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-08-17T02:13:31.990 INFO:teuthology.orchestra.run.smithi121.stdout:The following additional packages will be installed: 2024-08-17T02:13:31.990 INFO:teuthology.orchestra.run.smithi121.stdout: linux-generic linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:13:31.990 INFO:teuthology.orchestra.run.smithi121.stdout: linux-headers-generic linux-image-5.4.0-192-generic 2024-08-17T02:13:31.991 INFO:teuthology.orchestra.run.smithi121.stdout: linux-modules-5.4.0-192-generic linux-modules-extra-5.4.0-192-generic 2024-08-17T02:13:31.991 INFO:teuthology.orchestra.run.smithi121.stdout:Suggested packages: 2024-08-17T02:13:31.991 INFO:teuthology.orchestra.run.smithi121.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-08-17T02:13:31.992 INFO:teuthology.orchestra.run.smithi121.stdout:Recommended packages: 2024-08-17T02:13:31.992 INFO:teuthology.orchestra.run.smithi121.stdout: thermald 2024-08-17T02:13:32.052 INFO:teuthology.orchestra.run.smithi121.stdout:The following NEW packages will be installed: 2024-08-17T02:13:32.053 INFO:teuthology.orchestra.run.smithi121.stdout: linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:13:32.053 INFO:teuthology.orchestra.run.smithi121.stdout: linux-image-5.4.0-192-generic linux-modules-5.4.0-192-generic 2024-08-17T02:13:32.053 INFO:teuthology.orchestra.run.smithi121.stdout: linux-modules-extra-5.4.0-192-generic 2024-08-17T02:13:32.054 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages will be upgraded: 2024-08-17T02:13:32.055 INFO:teuthology.orchestra.run.smithi121.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-17T02:13:32.070 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2024-08-17T02:13:32.071 INFO:teuthology.orchestra.run.smithi102.stdout: linux-generic linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:13:32.071 INFO:teuthology.orchestra.run.smithi102.stdout: linux-headers-generic linux-image-5.4.0-192-generic 2024-08-17T02:13:32.071 INFO:teuthology.orchestra.run.smithi102.stdout: linux-modules-5.4.0-192-generic linux-modules-extra-5.4.0-192-generic 2024-08-17T02:13:32.072 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2024-08-17T02:13:32.072 INFO:teuthology.orchestra.run.smithi102.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-08-17T02:13:32.072 INFO:teuthology.orchestra.run.smithi102.stdout:Recommended packages: 2024-08-17T02:13:32.072 INFO:teuthology.orchestra.run.smithi102.stdout: thermald 2024-08-17T02:13:32.115 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2024-08-17T02:13:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:13:32.116 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-192-generic linux-modules-5.4.0-192-generic 2024-08-17T02:13:32.117 INFO:teuthology.orchestra.run.smithi102.stdout: linux-modules-extra-5.4.0-192-generic 2024-08-17T02:13:32.117 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages will be upgraded: 2024-08-17T02:13:32.117 INFO:teuthology.orchestra.run.smithi102.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-17T02:13:32.170 INFO:teuthology.orchestra.run.smithi102.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:13:32.171 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 77.2 MB of archives. 2024-08-17T02:13:32.171 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 381 MB of additional disk space will be used. 2024-08-17T02:13:32.171 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-192-generic amd64 5.4.0-192.212 [15.0 MB] 2024-08-17T02:13:32.238 INFO:teuthology.orchestra.run.smithi121.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:13:32.238 INFO:teuthology.orchestra.run.smithi121.stdout:Need to get 77.2 MB of archives. 2024-08-17T02:13:32.238 INFO:teuthology.orchestra.run.smithi121.stdout:After this operation, 381 MB of additional disk space will be used. 2024-08-17T02:13:32.238 INFO:teuthology.orchestra.run.smithi121.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-192-generic amd64 5.4.0-192.212 [15.0 MB] 2024-08-17T02:13:32.478 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-192-generic amd64 5.4.0-192.212 [10.5 MB] 2024-08-17T02:13:32.571 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-192-generic amd64 5.4.0-192.212 [39.2 MB] 2024-08-17T02:13:33.090 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.192.190 [1,900 B] 2024-08-17T02:13:33.090 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.192.190 [2,588 B] 2024-08-17T02:13:33.091 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192 all 5.4.0-192.212 [11.0 MB] 2024-08-17T02:13:33.184 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192-generic amd64 5.4.0-192.212 [1,398 kB] 2024-08-17T02:13:33.195 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.192.190 [2,456 B] 2024-08-17T02:13:33.400 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-192-generic amd64 5.4.0-192.212 [10.5 MB] 2024-08-17T02:13:33.673 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-192-generic amd64 5.4.0-192.212 [39.2 MB] 2024-08-17T02:13:33.872 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 77.2 MB in 1s (72.1 MB/s) 2024-08-17T02:13:34.039 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-modules-5.4.0-192-generic. 2024-08-17T02:13:35.004 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.192.190 [1,900 B] 2024-08-17T02:13:35.004 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.192.190 [2,588 B] 2024-08-17T02:13:35.004 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192 all 5.4.0-192.212 [11.0 MB] 2024-08-17T02:13:35.286 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192-generic amd64 5.4.0-192.212 [1,398 kB] 2024-08-17T02:13:35.331 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.192.190 [2,456 B] 2024-08-17T02:13:35.743 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-08-17T02:13:35.748 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../0-linux-modules-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:13:35.811 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:36.006 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 77.2 MB in 3s (23.6 MB/s) 2024-08-17T02:13:36.209 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-modules-5.4.0-192-generic. 2024-08-17T02:13:37.728 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-image-5.4.0-192-generic. 2024-08-17T02:13:37.741 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../1-linux-image-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:13:37.837 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:38.084 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-08-17T02:13:38.089 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../0-linux-modules-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:13:38.239 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:38.915 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-192-generic. 2024-08-17T02:13:38.927 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:13:38.964 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:40.222 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-image-5.4.0-192-generic. 2024-08-17T02:13:40.236 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../1-linux-image-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:13:40.340 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:41.442 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-192-generic. 2024-08-17T02:13:41.456 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:13:41.500 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:43.745 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../3-linux-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:13:43.869 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:13:44.212 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:13:44.331 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-image-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:13:44.651 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-headers-5.4.0-192. 2024-08-17T02:13:44.666 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../5-linux-headers-5.4.0-192_5.4.0-192.212_all.deb ... 2024-08-17T02:13:44.709 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:13:46.119 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../3-linux-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:13:46.246 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:13:46.596 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:13:46.724 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-image-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:13:47.052 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-headers-5.4.0-192. 2024-08-17T02:13:47.069 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../5-linux-headers-5.4.0-192_5.4.0-192.212_all.deb ... 2024-08-17T02:13:47.110 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:13:49.913 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-headers-5.4.0-192-generic. 2024-08-17T02:13:49.934 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../6-linux-headers-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:13:49.971 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:52.643 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:13:52.774 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:13:52.875 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-headers-5.4.0-192-generic. 2024-08-17T02:13:52.897 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../6-linux-headers-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:13:52.950 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:53.157 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:13:53.270 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:54.473 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:55.577 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:13:55.604 INFO:teuthology.orchestra.run.smithi102.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:13:55.605 INFO:teuthology.orchestra.run.smithi102.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-192-generic 2024-08-17T02:13:55.696 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-headers-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:13:55.741 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:55.876 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:56.046 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:13:56.168 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:57.077 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-image-generic (5.4.0.192.190) ... 2024-08-17T02:13:57.195 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-generic (5.4.0.192.190) ... 2024-08-17T02:13:57.321 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-generic (5.4.0.192.190) ... 2024-08-17T02:13:57.395 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:57.448 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:57.512 INFO:teuthology.orchestra.run.smithi102.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-17T02:13:57.512 INFO:teuthology.orchestra.run.smithi102.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:13:58.956 INFO:teuthology.orchestra.run.smithi121.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:13:58.956 INFO:teuthology.orchestra.run.smithi121.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-192-generic 2024-08-17T02:13:59.122 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:13:59.248 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:00.432 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-image-generic (5.4.0.192.190) ... 2024-08-17T02:14:00.558 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-headers-generic (5.4.0.192.190) ... 2024-08-17T02:14:00.693 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-generic (5.4.0.192.190) ... 2024-08-17T02:14:00.827 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:00.892 INFO:teuthology.orchestra.run.smithi121.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-17T02:14:00.893 INFO:teuthology.orchestra.run.smithi121.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:14:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-17T02:14:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:Sourcing file `/etc/default/grub' 2024-08-17T02:14:19.154 INFO:teuthology.orchestra.run.smithi102.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:14:19.166 INFO:teuthology.orchestra.run.smithi102.stdout:Generating grub configuration file ... 2024-08-17T02:14:19.470 INFO:teuthology.orchestra.run.smithi102.stdout:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:14:19.500 INFO:teuthology.orchestra.run.smithi102.stdout:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:14:19.870 INFO:teuthology.orchestra.run.smithi102.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:14:19.882 INFO:teuthology.orchestra.run.smithi102.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:14:21.945 INFO:teuthology.orchestra.run.smithi102.stdout:done 2024-08-17T02:14:22.316 DEBUG:teuthology.orchestra.run.smithi102:> dpkg -s linux-image-generic 2024-08-17T02:14:22.363 INFO:teuthology.orchestra.run.smithi102.stdout:Package: linux-image-generic 2024-08-17T02:14:22.363 INFO:teuthology.orchestra.run.smithi102.stdout:Status: install ok installed 2024-08-17T02:14:22.363 INFO:teuthology.orchestra.run.smithi102.stdout:Priority: optional 2024-08-17T02:14:22.363 INFO:teuthology.orchestra.run.smithi102.stdout:Section: kernel 2024-08-17T02:14:22.363 INFO:teuthology.orchestra.run.smithi102.stdout:Installed-Size: 20 2024-08-17T02:14:22.364 INFO:teuthology.orchestra.run.smithi102.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:14:22.364 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: amd64 2024-08-17T02:14:22.364 INFO:teuthology.orchestra.run.smithi102.stdout:Source: linux-meta 2024-08-17T02:14:22.364 INFO:teuthology.orchestra.run.smithi102.stdout:Version: 5.4.0.192.190 2024-08-17T02:14:22.364 INFO:teuthology.orchestra.run.smithi102.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:14:22.364 INFO:teuthology.orchestra.run.smithi102.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:14:22.364 INFO:teuthology.orchestra.run.smithi102.stdout:Recommends: thermald 2024-08-17T02:14:22.364 INFO:teuthology.orchestra.run.smithi102.stdout:Description: Generic Linux kernel image 2024-08-17T02:14:22.364 INFO:teuthology.orchestra.run.smithi102.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:14:22.364 INFO:teuthology.orchestra.run.smithi102.stdout: available. 2024-08-17T02:14:22.364 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-192-generic 2024-08-17T02:14:22.365 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-17T02:14:22.365 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-17T02:14:22.365 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-08-17T02:14:22.365 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2024-08-17T02:14:22.365 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get clean 2024-08-17T02:14:22.447 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2024-08-17T02:14:22.707 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:14:22.707 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:14:22.778 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:14:22.832 INFO:teuthology.orchestra.run.smithi121.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-17T02:14:22.833 INFO:teuthology.orchestra.run.smithi121.stdout:Sourcing file `/etc/default/grub' 2024-08-17T02:14:22.844 INFO:teuthology.orchestra.run.smithi121.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:14:22.855 INFO:teuthology.orchestra.run.smithi121.stdout:Generating grub configuration file ... 2024-08-17T02:14:22.869 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:14:23.162 INFO:teuthology.orchestra.run.smithi121.stdout:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:14:23.191 INFO:teuthology.orchestra.run.smithi121.stdout:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:14:23.586 INFO:teuthology.orchestra.run.smithi121.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:14:23.597 INFO:teuthology.orchestra.run.smithi121.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:14:24.560 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-08-17T02:14:24.587 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:14:24.659 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-08-17T02:14:24.851 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-08-17T02:14:24.851 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-08-17T02:14:25.080 INFO:teuthology.orchestra.run.smithi102.stdout:linux-image-generic is already the newest version (5.4.0.192.190). 2024-08-17T02:14:25.081 INFO:teuthology.orchestra.run.smithi102.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:14:25.082 DEBUG:teuthology.orchestra.run.smithi102:> dpkg -s linux-image-generic 2024-08-17T02:14:25.097 INFO:teuthology.orchestra.run.smithi102.stdout:Package: linux-image-generic 2024-08-17T02:14:25.098 INFO:teuthology.orchestra.run.smithi102.stdout:Status: install ok installed 2024-08-17T02:14:25.098 INFO:teuthology.orchestra.run.smithi102.stdout:Priority: optional 2024-08-17T02:14:25.098 INFO:teuthology.orchestra.run.smithi102.stdout:Section: kernel 2024-08-17T02:14:25.098 INFO:teuthology.orchestra.run.smithi102.stdout:Installed-Size: 20 2024-08-17T02:14:25.098 INFO:teuthology.orchestra.run.smithi102.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:14:25.098 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: amd64 2024-08-17T02:14:25.098 INFO:teuthology.orchestra.run.smithi102.stdout:Source: linux-meta 2024-08-17T02:14:25.098 INFO:teuthology.orchestra.run.smithi102.stdout:Version: 5.4.0.192.190 2024-08-17T02:14:25.098 INFO:teuthology.orchestra.run.smithi102.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:14:25.098 INFO:teuthology.orchestra.run.smithi102.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:14:25.098 INFO:teuthology.orchestra.run.smithi102.stdout:Recommends: thermald 2024-08-17T02:14:25.098 INFO:teuthology.orchestra.run.smithi102.stdout:Description: Generic Linux kernel image 2024-08-17T02:14:25.099 INFO:teuthology.orchestra.run.smithi102.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:14:25.099 INFO:teuthology.orchestra.run.smithi102.stdout: available. 2024-08-17T02:14:25.099 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-08-17T02:14:25.103 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.px6XXKyocx 2024-08-17T02:14:25.104 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub/grub.cfg /tmp/tmp.px6XXKyocx 2024-08-17T02:14:25.161 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.px6XXKyocx 2024-08-17T02:14:25.201 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.px6XXKyocx is 9KB 2024-08-17T02:14:25.214 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.px6XXKyocx 2024-08-17T02:14:25.220 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-17T02:14:25.277 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:14:25.277 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-17T02:14:25.277 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-17T02:14:25.306 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-192-generic 2024-08-17T02:14:25.306 DEBUG:teuthology.orchestra.run.smithi102:> sudo update-grub 2024-08-17T02:14:25.836 INFO:teuthology.orchestra.run.smithi121.stdout:done 2024-08-17T02:14:26.252 DEBUG:teuthology.orchestra.run.smithi121:> dpkg -s linux-image-generic 2024-08-17T02:14:26.303 INFO:teuthology.orchestra.run.smithi121.stdout:Package: linux-image-generic 2024-08-17T02:14:26.303 INFO:teuthology.orchestra.run.smithi121.stdout:Status: install ok installed 2024-08-17T02:14:26.303 INFO:teuthology.orchestra.run.smithi121.stdout:Priority: optional 2024-08-17T02:14:26.303 INFO:teuthology.orchestra.run.smithi121.stdout:Section: kernel 2024-08-17T02:14:26.303 INFO:teuthology.orchestra.run.smithi121.stdout:Installed-Size: 20 2024-08-17T02:14:26.304 INFO:teuthology.orchestra.run.smithi121.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:14:26.304 INFO:teuthology.orchestra.run.smithi121.stdout:Architecture: amd64 2024-08-17T02:14:26.304 INFO:teuthology.orchestra.run.smithi121.stdout:Source: linux-meta 2024-08-17T02:14:26.304 INFO:teuthology.orchestra.run.smithi121.stdout:Version: 5.4.0.192.190 2024-08-17T02:14:26.304 INFO:teuthology.orchestra.run.smithi121.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:14:26.304 INFO:teuthology.orchestra.run.smithi121.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:14:26.304 INFO:teuthology.orchestra.run.smithi121.stdout:Recommends: thermald 2024-08-17T02:14:26.304 INFO:teuthology.orchestra.run.smithi121.stdout:Description: Generic Linux kernel image 2024-08-17T02:14:26.304 INFO:teuthology.orchestra.run.smithi121.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:14:26.304 INFO:teuthology.orchestra.run.smithi121.stdout: available. 2024-08-17T02:14:26.304 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-192-generic 2024-08-17T02:14:26.305 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-17T02:14:26.305 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-17T02:14:26.305 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-08-17T02:14:26.305 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi121.front.sepia.ceph.com, path=None, version=distro) 2024-08-17T02:14:26.305 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get clean 2024-08-17T02:14:26.387 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get update 2024-08-17T02:14:26.581 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub' 2024-08-17T02:14:26.590 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:14:26.613 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-08-17T02:14:26.646 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:14:26.646 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:14:26.716 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:14:26.798 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:14:26.890 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:14:26.902 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:14:27.253 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:14:27.265 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:14:28.236 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-08-17T02:14:28.238 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2024-08-17T02:14:28.480 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-08-17T02:14:28.509 DEBUG:teuthology.orchestra.run.smithi121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:14:28.582 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-08-17T02:14:28.787 INFO:teuthology.orchestra.run.smithi121.stdout:Building dependency tree... 2024-08-17T02:14:28.787 INFO:teuthology.orchestra.run.smithi121.stdout:Reading state information... 2024-08-17T02:14:29.013 INFO:teuthology.orchestra.run.smithi121.stdout:linux-image-generic is already the newest version (5.4.0.192.190). 2024-08-17T02:14:29.013 INFO:teuthology.orchestra.run.smithi121.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:14:29.015 DEBUG:teuthology.orchestra.run.smithi121:> dpkg -s linux-image-generic 2024-08-17T02:14:29.034 INFO:teuthology.orchestra.run.smithi121.stdout:Package: linux-image-generic 2024-08-17T02:14:29.035 INFO:teuthology.orchestra.run.smithi121.stdout:Status: install ok installed 2024-08-17T02:14:29.035 INFO:teuthology.orchestra.run.smithi121.stdout:Priority: optional 2024-08-17T02:14:29.035 INFO:teuthology.orchestra.run.smithi121.stdout:Section: kernel 2024-08-17T02:14:29.035 INFO:teuthology.orchestra.run.smithi121.stdout:Installed-Size: 20 2024-08-17T02:14:29.035 INFO:teuthology.orchestra.run.smithi121.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:14:29.036 INFO:teuthology.orchestra.run.smithi121.stdout:Architecture: amd64 2024-08-17T02:14:29.036 INFO:teuthology.orchestra.run.smithi121.stdout:Source: linux-meta 2024-08-17T02:14:29.036 INFO:teuthology.orchestra.run.smithi121.stdout:Version: 5.4.0.192.190 2024-08-17T02:14:29.036 INFO:teuthology.orchestra.run.smithi121.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:14:29.036 INFO:teuthology.orchestra.run.smithi121.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:14:29.036 INFO:teuthology.orchestra.run.smithi121.stdout:Recommends: thermald 2024-08-17T02:14:29.037 INFO:teuthology.orchestra.run.smithi121.stdout:Description: Generic Linux kernel image 2024-08-17T02:14:29.037 INFO:teuthology.orchestra.run.smithi121.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:14:29.037 INFO:teuthology.orchestra.run.smithi121.stdout: available. 2024-08-17T02:14:29.037 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-08-17T02:14:29.042 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.aIF55pbkZJ 2024-08-17T02:14:29.042 DEBUG:teuthology.orchestra.run.smithi121:> sudo cp /boot/grub/grub.cfg /tmp/tmp.aIF55pbkZJ 2024-08-17T02:14:29.062 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.aIF55pbkZJ 2024-08-17T02:14:29.103 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.aIF55pbkZJ is 9KB 2024-08-17T02:14:29.154 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.aIF55pbkZJ 2024-08-17T02:14:29.161 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-17T02:14:29.173 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:14:29.173 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-17T02:14:29.174 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-17T02:14:29.206 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-192-generic 2024-08-17T02:14:29.206 DEBUG:teuthology.orchestra.run.smithi121:> sudo update-grub 2024-08-17T02:14:30.563 INFO:teuthology.orchestra.run.smithi121.stderr:Sourcing file `/etc/default/grub' 2024-08-17T02:14:30.575 INFO:teuthology.orchestra.run.smithi121.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:14:30.586 INFO:teuthology.orchestra.run.smithi121.stderr:Generating grub configuration file ... 2024-08-17T02:14:30.823 INFO:teuthology.orchestra.run.smithi121.stderr:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:14:30.835 INFO:teuthology.orchestra.run.smithi121.stderr:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:14:31.222 INFO:teuthology.orchestra.run.smithi121.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:14:31.233 INFO:teuthology.orchestra.run.smithi121.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:14:32.287 INFO:teuthology.orchestra.run.smithi121.stderr:done 2024-08-17T02:14:32.289 DEBUG:teuthology.orchestra.run.smithi121:> sudo shutdown -r now 2024-08-17T02:14:58.266 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-08-17T02:14:58.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-08-17T02:14:58.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:02.294 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-08-17T02:15:02.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-08-17T02:15:02.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:16.703 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-08-17T02:15:25.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-08-17T02:15:25.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:28.766 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-08-17T02:15:36.927 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-08-17T02:15:40.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-08-17T02:15:40.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:45.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-08-17T02:15:45.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:59.202 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-08-17T02:16:04.318 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-08-17T02:16:14.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-08-17T02:16:14.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:14.450 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-08-17T02:16:15.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-08-17T02:16:15.073 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-192-generic"... 2024-08-17T02:16:15.073 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-08-17T02:16:15.079 INFO:teuthology.orchestra.run.smithi102.stdout:5.4.0-192-generic 2024-08-17T02:16:15.080 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-192-generic vs 5.4.0-192-generic 2024-08-17T02:16:15.080 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:16:15.080 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-17T02:16:16.081 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-17T02:16:16.081 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-17T02:16:16.167 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2024-08-17T02:16:16.191 DEBUG:teuthology.parallel:result is None 2024-08-17T02:16:16.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-08-17T02:16:16.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:16.756 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-08-17T02:16:17.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-08-17T02:16:17.579 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-192-generic"... 2024-08-17T02:16:17.579 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-08-17T02:16:17.587 INFO:teuthology.orchestra.run.smithi121.stdout:5.4.0-192-generic 2024-08-17T02:16:17.587 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-192-generic vs 5.4.0-192-generic 2024-08-17T02:16:17.587 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:16:17.587 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-17T02:16:18.588 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-08-17T02:16:18.589 DEBUG:teuthology.orchestra.run.smithi121:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-17T02:16:18.689 INFO:teuthology.orchestra.run.smithi121.stdout:ttyS1 2024-08-17T02:16:18.713 DEBUG:teuthology.parallel:result is None 2024-08-17T02:16:18.713 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:16:18.721 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:16:18.721 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:16:18.723 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:16:18.730 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:16:18.736 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:16:18.742 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:16:18.743 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:16:18.745 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:16:18.770 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:16:18.777 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:16:18.777 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:16:18.802 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:16:18.818 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:16:18.828 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:16:18.837 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:16:18.848 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:16:18.849 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:16:18.857 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:16:18.858 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:16:18.861 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:16:18.877 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:16:18.887 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:16:18.887 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:16:18.922 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:16:18.930 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:16:18.936 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:16:18.942 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:16:18.942 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:16:19.009 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:16:19.016 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:16:19.065 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:16:19.065 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:16:19.089 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-08-17T02:16:19.092 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2024-08-17T02:16:19.140 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:16:19.148 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:16:19.148 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:16:19.160 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:16:19.168 DEBUG:teuthology.task.selinux:Excluding smithi102: OS 'ubuntu' does not support SELinux 2024-08-17T02:16:19.168 DEBUG:teuthology.task.selinux:Excluding smithi121: OS 'ubuntu' does not support SELinux 2024-08-17T02:16:19.168 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:16:19.169 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-08-17T02:16:19.169 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:16:19.169 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:16:19.186 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:16:19.199 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:16:19.200 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi102.front.sepia.ceph.com,smithi121.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:21:58.590 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi102.front.sepia.ceph.com'), Remote(name='ubuntu@smithi121.front.sepia.ceph.com')] 2024-08-17T02:21:58.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-08-17T02:21:58.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:21:58.705 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-08-17T02:21:58.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-08-17T02:21:58.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-08-17T02:21:58.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:21:58.934 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-08-17T02:21:59.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-08-17T02:21:59.057 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:21:59.067 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:21:59.067 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:21:59.068 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:21:59.071 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:21:59.071 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:21:59.105 INFO:teuthology.orchestra.run.smithi121.stdout:17 Aug 02:21:59 ntpd[13612]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-08-17T02:21:59.105 INFO:teuthology.orchestra.run.smithi121.stdout:17 Aug 02:21:59 ntpd[13612]: Command line: ntpd -gq 2024-08-17T02:21:59.106 INFO:teuthology.orchestra.run.smithi102.stdout:17 Aug 02:21:59 ntpd[13636]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-08-17T02:21:59.106 INFO:teuthology.orchestra.run.smithi102.stdout:17 Aug 02:21:59 ntpd[13636]: Command line: ntpd -gq 2024-08-17T02:21:59.106 INFO:teuthology.orchestra.run.smithi121.stdout:17 Aug 02:21:59 ntpd[13612]: proto: precision = 0.100 usec (-23) 2024-08-17T02:21:59.106 INFO:teuthology.orchestra.run.smithi121.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:21:59.107 INFO:teuthology.orchestra.run.smithi121.stdout:17 Aug 02:21:59 ntpd[13612]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:21:59.107 INFO:teuthology.orchestra.run.smithi121.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi121.stdout:17 Aug 02:21:59 ntpd[13612]: restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi121.stdout:17 Aug 02:21:59 ntpd[13612]: Listen and drop on 0 v6wildcard [::]:123 2024-08-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi121.stdout:17 Aug 02:21:59 ntpd[13612]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi121.stdout:17 Aug 02:21:59 ntpd[13612]: Listen normally on 2 lo 127.0.0.1:123 2024-08-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi121.stdout:17 Aug 02:21:59 ntpd[13612]: Listen normally on 3 enp3s0f1 172.21.15.121:123 2024-08-17T02:21:59.108 INFO:teuthology.orchestra.run.smithi121.stdout:17 Aug 02:21:59 ntpd[13612]: Listen normally on 4 lo [::1]:123 2024-08-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi121.stdout:17 Aug 02:21:59 ntpd[13612]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cba3%5]:123 2024-08-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi121.stdout:17 Aug 02:21:59 ntpd[13612]: Listening on routing socket on fd #22 for interface updates 2024-08-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi102.stdout:17 Aug 02:21:59 ntpd[13636]: proto: precision = 0.116 usec (-23) 2024-08-17T02:21:59.109 INFO:teuthology.orchestra.run.smithi102.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:21:59.110 INFO:teuthology.orchestra.run.smithi102.stdout:17 Aug 02:21:59 ntpd[13636]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:21:59.111 INFO:teuthology.orchestra.run.smithi102.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:21:59.111 INFO:teuthology.orchestra.run.smithi102.stdout:17 Aug 02:21:59 ntpd[13636]: restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi102.stdout:17 Aug 02:21:59 ntpd[13636]: Listen and drop on 0 v6wildcard [::]:123 2024-08-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi102.stdout:17 Aug 02:21:59 ntpd[13636]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi102.stdout:17 Aug 02:21:59 ntpd[13636]: Listen normally on 2 lo 127.0.0.1:123 2024-08-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi102.stdout:17 Aug 02:21:59 ntpd[13636]: Listen normally on 3 enp3s0f1 172.21.15.102:123 2024-08-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi102.stdout:17 Aug 02:21:59 ntpd[13636]: Listen normally on 4 lo [::1]:123 2024-08-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi102.stdout:17 Aug 02:21:59 ntpd[13636]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d769%5]:123 2024-08-17T02:21:59.112 INFO:teuthology.orchestra.run.smithi102.stdout:17 Aug 02:21:59 ntpd[13636]: Listening on routing socket on fd #22 for interface updates 2024-08-17T02:22:00.107 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:00.107 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:00 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:00.107 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:00.107 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:00 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:00.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:00.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:00 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:00.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:00.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:00 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:00.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:00.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:00 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:00.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:00 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:00.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:00 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:02.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:02 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:02.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:02 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:02.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:02 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:02.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:02 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:02.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:02 ntpd[13612]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:02.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:02 ntpd[13612]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:02 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:02 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:02 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:02 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:02 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:02 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:02 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:02 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:02 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:02 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:02 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:02.109 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:02 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:03.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:03 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:03.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:03 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:03.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:03 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:03.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:03 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:03.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:03 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:03.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:03 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:03.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:03 ntpd[13612]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:03.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:03 ntpd[13612]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:03.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:03 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:03.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:03 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:03.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:03 ntpd[13612]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:03.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:03 ntpd[13612]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:04.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:04 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:04.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:04 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:04.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:04 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:04.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:04 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:04.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:04 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:04.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:04 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:04.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:04 ntpd[13612]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:04.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:04 ntpd[13612]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:04.109 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:04.109 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:04.110 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:04.110 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:04.110 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:04.110 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:04.110 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:04.110 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:04.110 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:04.110 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:04.110 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:04.110 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:04.111 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:04.111 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:04.111 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:04.111 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:04.111 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:04.111 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:04.111 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:04.111 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:04 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:05.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:05 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:05.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:05 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:05.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:05 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:05.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:05 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:05.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:05 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:05.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:05 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:05.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:05 ntpd[13612]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:05.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:05 ntpd[13612]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:05.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:05 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:05.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:05 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:05.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:05 ntpd[13612]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:05.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:05 ntpd[13612]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:06.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:06 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:06.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:06 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:06.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:06 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:06.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:06 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:06.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:06 ntpd[13612]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:06.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:06 ntpd[13612]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:06.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:06 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:06.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:06 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:06.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:06 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:06.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:06 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:06.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:06 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:06.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:06 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:06.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:06 ntpd[13636]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:06.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:06 ntpd[13636]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:06.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:06 ntpd[13636]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:06.108 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:06 ntpd[13636]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:06.109 INFO:teuthology.orchestra.run.smithi102.stdout:17 Aug 02:22:06 ntpd[13636]: ntpd: time slew +0.000004 s 2024-08-17T02:22:06.109 INFO:teuthology.orchestra.run.smithi102.stdout:ntpd: time slew +0.000004s 2024-08-17T02:22:06.109 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:06 ntpd[13636]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-17T02:22:06.109 INFO:teuthology.orchestra.run.smithi102.stderr:17 Aug 02:22:06 ntpd[13636]: can't open /var/log/ntpstats/loopstats.20240817: Permission denied 2024-08-17T02:22:06.178 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:22:06.178 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2024-08-17T02:22:06.178 INFO:teuthology.orchestra.run.smithi102.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:06.179 INFO:teuthology.orchestra.run.smithi102.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:06.179 INFO:teuthology.orchestra.run.smithi102.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:06.179 INFO:teuthology.orchestra.run.smithi102.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:07.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:07 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:07.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:07 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:07.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:07 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:07.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:07 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:07.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:07 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:07.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:07 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:07.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:07 ntpd[13612]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:07.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:07 ntpd[13612]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:07.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:07 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:07.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:07 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:07.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:07 ntpd[13612]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:07.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:07 ntpd[13612]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:08.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:08 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:08.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:08 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:08.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:08 ntpd[13612]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:08.106 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:08 ntpd[13612]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:08.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:08 ntpd[13612]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:08.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:08 ntpd[13612]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:08.107 INFO:teuthology.orchestra.run.smithi121.stdout:17 Aug 02:22:08 ntpd[13612]: ntpd: time slew +0.001538 s 2024-08-17T02:22:08.107 INFO:teuthology.orchestra.run.smithi121.stdout:ntpd: time slew +0.001538s 2024-08-17T02:22:08.107 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:08 ntpd[13612]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-17T02:22:08.108 INFO:teuthology.orchestra.run.smithi121.stderr:17 Aug 02:22:08 ntpd[13612]: can't open /var/log/ntpstats/loopstats.20240817: Permission denied 2024-08-17T02:22:08.178 INFO:teuthology.orchestra.run.smithi121.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:22:08.178 INFO:teuthology.orchestra.run.smithi121.stdout:============================================================================== 2024-08-17T02:22:08.179 INFO:teuthology.orchestra.run.smithi121.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:08.179 INFO:teuthology.orchestra.run.smithi121.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:08.179 INFO:teuthology.orchestra.run.smithi121.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:08.179 INFO:teuthology.orchestra.run.smithi121.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:08.179 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:22:08.188 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:22:08.188 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:22:08.189 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:22:08.189 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:22:08.197 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:22:08.198 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:22:08.198 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-key list | grep Ceph 2024-08-17T02:22:08.199 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-key list | grep Ceph 2024-08-17T02:22:08.305 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-08-17T02:22:08.327 INFO:teuthology.orchestra.run.smithi121.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-08-17T02:22:08.367 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-17T02:22:08.367 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph.com (release key) 2024-08-17T02:22:08.368 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-17T02:22:08.368 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-08-17T02:22:08.368 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:22:08.386 INFO:teuthology.orchestra.run.smithi121.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-17T02:22:08.387 INFO:teuthology.orchestra.run.smithi121.stdout:uid [ unknown] Ceph.com (release key) 2024-08-17T02:22:08.388 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-17T02:22:08.388 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-08-17T02:22:08.388 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:22:08.511 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default/ 2024-08-17T02:22:08.511 INFO:teuthology.task.install.deb:Package version is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:22:08.525 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default/ 2024-08-17T02:22:08.525 INFO:teuthology.task.install.deb:Package version is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:22:08.796 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:22:08.796 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-17T02:22:08.799 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:22:08.799 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-17T02:22:08.812 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2024-08-17T02:22:08.816 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get update 2024-08-17T02:22:08.955 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:22:08.996 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:22:09.002 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:22:09.019 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:22:09.073 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:22:09.115 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:22:09.154 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:22:09.194 INFO:teuthology.orchestra.run.smithi121.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal InRelease 2024-08-17T02:22:09.228 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal InRelease 2024-08-17T02:22:09.238 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:22:09.263 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-08-17T02:22:09.298 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-08-17T02:22:09.336 INFO:teuthology.orchestra.run.smithi121.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release.gpg 2024-08-17T02:22:09.369 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release.gpg 2024-08-17T02:22:09.408 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main i386 Packages [3,382 B] 2024-08-17T02:22:09.440 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main i386 Packages [3,382 B] 2024-08-17T02:22:09.489 INFO:teuthology.orchestra.run.smithi121.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-08-17T02:22:09.523 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-08-17T02:22:09.595 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 28.5 kB in 1s (45.7 kB/s) 2024-08-17T02:22:09.659 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 28.5 kB in 1s (44.9 kB/s) 2024-08-17T02:22:10.742 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-08-17T02:22:10.769 DEBUG:teuthology.orchestra.run.smithi121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1375-g2577e813-1focal cephadm=17.2.7-1375-g2577e813-1focal ceph-mds=17.2.7-1375-g2577e813-1focal ceph-mgr=17.2.7-1375-g2577e813-1focal ceph-common=17.2.7-1375-g2577e813-1focal ceph-fuse=17.2.7-1375-g2577e813-1focal ceph-test=17.2.7-1375-g2577e813-1focal ceph-volume=17.2.7-1375-g2577e813-1focal radosgw=17.2.7-1375-g2577e813-1focal python3-rados=17.2.7-1375-g2577e813-1focal python3-rgw=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal python3-rbd=17.2.7-1375-g2577e813-1focal libcephfs2=17.2.7-1375-g2577e813-1focal libcephfs-dev=17.2.7-1375-g2577e813-1focal librados2=17.2.7-1375-g2577e813-1focal librbd1=17.2.7-1375-g2577e813-1focal rbd-fuse=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal cephfs-shell=17.2.7-1375-g2577e813-1focal cephfs-top=17.2.7-1375-g2577e813-1focal cephfs-mirror=17.2.7-1375-g2577e813-1focal 2024-08-17T02:22:10.802 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-08-17T02:22:10.828 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1375-g2577e813-1focal cephadm=17.2.7-1375-g2577e813-1focal ceph-mds=17.2.7-1375-g2577e813-1focal ceph-mgr=17.2.7-1375-g2577e813-1focal ceph-common=17.2.7-1375-g2577e813-1focal ceph-fuse=17.2.7-1375-g2577e813-1focal ceph-test=17.2.7-1375-g2577e813-1focal ceph-volume=17.2.7-1375-g2577e813-1focal radosgw=17.2.7-1375-g2577e813-1focal python3-rados=17.2.7-1375-g2577e813-1focal python3-rgw=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal python3-rbd=17.2.7-1375-g2577e813-1focal libcephfs2=17.2.7-1375-g2577e813-1focal libcephfs-dev=17.2.7-1375-g2577e813-1focal librados2=17.2.7-1375-g2577e813-1focal librbd1=17.2.7-1375-g2577e813-1focal rbd-fuse=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal cephfs-shell=17.2.7-1375-g2577e813-1focal cephfs-top=17.2.7-1375-g2577e813-1focal cephfs-mirror=17.2.7-1375-g2577e813-1focal 2024-08-17T02:22:10.840 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-08-17T02:22:10.902 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-08-17T02:22:11.055 INFO:teuthology.orchestra.run.smithi121.stdout:Building dependency tree... 2024-08-17T02:22:11.055 INFO:teuthology.orchestra.run.smithi121.stdout:Reading state information... 2024-08-17T02:22:11.094 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-08-17T02:22:11.095 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-08-17T02:22:11.255 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:22:11.257 INFO:teuthology.orchestra.run.smithi121.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:22:11.257 INFO:teuthology.orchestra.run.smithi121.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:22:11.257 INFO:teuthology.orchestra.run.smithi121.stdout:The following additional packages will be installed: 2024-08-17T02:22:11.257 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-17T02:22:11.257 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-08-17T02:22:11.257 INFO:teuthology.orchestra.run.smithi121.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-08-17T02:22:11.257 INFO:teuthology.orchestra.run.smithi121.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-08-17T02:22:11.257 INFO:teuthology.orchestra.run.smithi121.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-08-17T02:22:11.259 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-08-17T02:22:11.259 INFO:teuthology.orchestra.run.smithi121.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-08-17T02:22:11.259 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:22:11.260 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2024-08-17T02:22:11.260 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-08-17T02:22:11.260 INFO:teuthology.orchestra.run.smithi121.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-08-17T02:22:11.260 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:22:11.260 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:22:11.260 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:22:11.260 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:22:11.260 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:22:11.261 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2024-08-17T02:22:11.262 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:22:11.262 INFO:teuthology.orchestra.run.smithi121.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:22:11.262 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:22:11.262 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:22:11.262 INFO:teuthology.orchestra.run.smithi121.stdout: qttranslations5-l10n socat xmlstarlet 2024-08-17T02:22:11.262 INFO:teuthology.orchestra.run.smithi121.stdout:Suggested packages: 2024-08-17T02:22:11.262 INFO:teuthology.orchestra.run.smithi121.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-08-17T02:22:11.262 INFO:teuthology.orchestra.run.smithi121.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-08-17T02:22:11.262 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-08-17T02:22:11.263 INFO:teuthology.orchestra.run.smithi121.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-08-17T02:22:11.263 INFO:teuthology.orchestra.run.smithi121.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-08-17T02:22:11.263 INFO:teuthology.orchestra.run.smithi121.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-08-17T02:22:11.263 INFO:teuthology.orchestra.run.smithi121.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-08-17T02:22:11.263 INFO:teuthology.orchestra.run.smithi121.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-17T02:22:11.263 INFO:teuthology.orchestra.run.smithi121.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-08-17T02:22:11.263 INFO:teuthology.orchestra.run.smithi121.stdout:Recommended packages: 2024-08-17T02:22:11.263 INFO:teuthology.orchestra.run.smithi121.stdout: btrfs-tools 2024-08-17T02:22:11.286 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:22:11.287 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:22:11.287 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:22:11.288 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2024-08-17T02:22:11.288 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-17T02:22:11.288 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-08-17T02:22:11.288 INFO:teuthology.orchestra.run.smithi102.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-08-17T02:22:11.288 INFO:teuthology.orchestra.run.smithi102.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-08-17T02:22:11.288 INFO:teuthology.orchestra.run.smithi102.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-08-17T02:22:11.289 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-08-17T02:22:11.289 INFO:teuthology.orchestra.run.smithi102.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-08-17T02:22:11.289 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:22:11.289 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2024-08-17T02:22:11.289 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-08-17T02:22:11.290 INFO:teuthology.orchestra.run.smithi102.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-08-17T02:22:11.290 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:22:11.290 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:22:11.290 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:22:11.290 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:22:11.290 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:22:11.290 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2024-08-17T02:22:11.290 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:22:11.290 INFO:teuthology.orchestra.run.smithi102.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:22:11.290 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:22:11.290 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:22:11.290 INFO:teuthology.orchestra.run.smithi102.stdout: qttranslations5-l10n socat xmlstarlet 2024-08-17T02:22:11.291 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2024-08-17T02:22:11.291 INFO:teuthology.orchestra.run.smithi102.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-08-17T02:22:11.291 INFO:teuthology.orchestra.run.smithi102.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-08-17T02:22:11.291 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-08-17T02:22:11.291 INFO:teuthology.orchestra.run.smithi102.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-08-17T02:22:11.291 INFO:teuthology.orchestra.run.smithi102.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-08-17T02:22:11.291 INFO:teuthology.orchestra.run.smithi102.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-08-17T02:22:11.291 INFO:teuthology.orchestra.run.smithi102.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-08-17T02:22:11.291 INFO:teuthology.orchestra.run.smithi102.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-17T02:22:11.291 INFO:teuthology.orchestra.run.smithi102.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-08-17T02:22:11.292 INFO:teuthology.orchestra.run.smithi102.stdout:Recommended packages: 2024-08-17T02:22:11.292 INFO:teuthology.orchestra.run.smithi102.stdout: btrfs-tools 2024-08-17T02:22:11.374 INFO:teuthology.orchestra.run.smithi121.stdout:The following NEW packages will be installed: 2024-08-17T02:22:11.374 INFO:teuthology.orchestra.run.smithi121.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-17T02:22:11.375 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-17T02:22:11.375 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-17T02:22:11.375 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-08-17T02:22:11.375 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-08-17T02:22:11.375 INFO:teuthology.orchestra.run.smithi121.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-08-17T02:22:11.375 INFO:teuthology.orchestra.run.smithi121.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-08-17T02:22:11.377 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-08-17T02:22:11.377 INFO:teuthology.orchestra.run.smithi121.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2024-08-17T02:22:11.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:22:11.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2024-08-17T02:22:11.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2024-08-17T02:22:11.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-08-17T02:22:11.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:22:11.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:22:11.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:22:11.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:22:11.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:22:11.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-08-17T02:22:11.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-17T02:22:11.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:22:11.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:22:11.379 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:22:11.379 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:22:11.379 INFO:teuthology.orchestra.run.smithi121.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-08-17T02:22:11.379 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages will be upgraded: 2024-08-17T02:22:11.379 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 librbd1 2024-08-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2024-08-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi102.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-08-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-08-17T02:22:11.417 INFO:teuthology.orchestra.run.smithi102.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-08-17T02:22:11.418 INFO:teuthology.orchestra.run.smithi102.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-08-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-08-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi102.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2024-08-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2024-08-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2024-08-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-08-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:22:11.419 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-08-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi102.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi102.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-08-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages will be upgraded: 2024-08-17T02:22:11.420 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 librbd1 2024-08-17T02:22:11.485 INFO:teuthology.orchestra.run.smithi102.stdout:2 upgraded, 114 newly installed, 0 to remove and 295 not upgraded. 2024-08-17T02:22:11.486 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 201 MB of archives. 2024-08-17T02:22:11.486 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 938 MB of additional disk space will be used. 2024-08-17T02:22:11.486 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-08-17T02:22:11.505 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-08-17T02:22:11.512 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-08-17T02:22:11.539 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-08-17T02:22:11.568 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-08-17T02:22:11.570 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-08-17T02:22:11.570 INFO:teuthology.orchestra.run.smithi121.stdout:2 upgraded, 114 newly installed, 0 to remove and 295 not upgraded. 2024-08-17T02:22:11.570 INFO:teuthology.orchestra.run.smithi121.stdout:Need to get 201 MB of archives. 2024-08-17T02:22:11.570 INFO:teuthology.orchestra.run.smithi121.stdout:After this operation, 938 MB of additional disk space will be used. 2024-08-17T02:22:11.570 INFO:teuthology.orchestra.run.smithi121.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-08-17T02:22:11.580 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-08-17T02:22:11.582 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-08-17T02:22:11.600 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-08-17T02:22:11.601 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-08-17T02:22:11.606 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-08-17T02:22:11.634 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-08-17T02:22:11.635 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-08-17T02:22:11.641 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-08-17T02:22:11.643 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-08-17T02:22:11.643 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-08-17T02:22:11.646 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-08-17T02:22:11.646 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-08-17T02:22:11.646 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-08-17T02:22:11.647 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-08-17T02:22:11.653 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-08-17T02:22:11.656 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-08-17T02:22:11.656 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-08-17T02:22:11.673 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-08-17T02:22:11.674 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-08-17T02:22:11.674 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-08-17T02:22:11.676 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-17T02:22:11.676 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-08-17T02:22:11.676 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-08-17T02:22:11.678 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-08-17T02:22:11.678 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-08-17T02:22:11.688 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-08-17T02:22:11.691 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-08-17T02:22:11.692 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-08-17T02:22:11.708 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-08-17T02:22:11.714 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-08-17T02:22:11.715 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-08-17T02:22:11.715 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-08-17T02:22:11.716 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-08-17T02:22:11.717 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-08-17T02:22:11.719 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-08-17T02:22:11.720 INFO:teuthology.orchestra.run.smithi102.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-17T02:22:11.725 INFO:teuthology.orchestra.run.smithi102.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-08-17T02:22:11.726 INFO:teuthology.orchestra.run.smithi102.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-08-17T02:22:11.742 INFO:teuthology.orchestra.run.smithi102.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-08-17T02:22:11.744 INFO:teuthology.orchestra.run.smithi102.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-08-17T02:22:11.745 INFO:teuthology.orchestra.run.smithi102.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-08-17T02:22:11.745 INFO:teuthology.orchestra.run.smithi102.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-08-17T02:22:11.761 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1375-g2577e813-1focal [3,506 kB] 2024-08-17T02:22:11.803 INFO:teuthology.orchestra.run.smithi102.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1375-g2577e813-1focal [3,506 kB] 2024-08-17T02:22:11.812 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-08-17T02:22:11.831 INFO:teuthology.orchestra.run.smithi102.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-08-17T02:22:11.846 INFO:teuthology.orchestra.run.smithi102.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-08-17T02:22:11.848 INFO:teuthology.orchestra.run.smithi102.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-08-17T02:22:11.859 INFO:teuthology.orchestra.run.smithi102.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-08-17T02:22:11.860 INFO:teuthology.orchestra.run.smithi102.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-08-17T02:22:11.930 INFO:teuthology.orchestra.run.smithi102.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-08-17T02:22:11.931 INFO:teuthology.orchestra.run.smithi102.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-08-17T02:22:11.932 INFO:teuthology.orchestra.run.smithi102.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-08-17T02:22:11.934 INFO:teuthology.orchestra.run.smithi102.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-08-17T02:22:11.934 INFO:teuthology.orchestra.run.smithi102.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-08-17T02:22:11.936 INFO:teuthology.orchestra.run.smithi102.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-08-17T02:22:11.937 INFO:teuthology.orchestra.run.smithi102.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-08-17T02:22:11.938 INFO:teuthology.orchestra.run.smithi102.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-08-17T02:22:11.945 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-08-17T02:22:11.948 INFO:teuthology.orchestra.run.smithi102.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-08-17T02:22:11.954 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-08-17T02:22:11.960 INFO:teuthology.orchestra.run.smithi102.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-08-17T02:22:11.962 INFO:teuthology.orchestra.run.smithi102.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-08-17T02:22:11.963 INFO:teuthology.orchestra.run.smithi102.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-08-17T02:22:11.967 INFO:teuthology.orchestra.run.smithi102.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-08-17T02:22:11.970 INFO:teuthology.orchestra.run.smithi102.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-08-17T02:22:11.971 INFO:teuthology.orchestra.run.smithi102.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-08-17T02:22:11.986 INFO:teuthology.orchestra.run.smithi102.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-08-17T02:22:11.988 INFO:teuthology.orchestra.run.smithi102.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-08-17T02:22:11.997 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-08-17T02:22:12.009 INFO:teuthology.orchestra.run.smithi121.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-08-17T02:22:12.024 INFO:teuthology.orchestra.run.smithi102.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-08-17T02:22:12.025 INFO:teuthology.orchestra.run.smithi102.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-08-17T02:22:12.025 INFO:teuthology.orchestra.run.smithi102.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-08-17T02:22:12.026 INFO:teuthology.orchestra.run.smithi102.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-08-17T02:22:12.026 INFO:teuthology.orchestra.run.smithi102.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-08-17T02:22:12.027 INFO:teuthology.orchestra.run.smithi102.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-08-17T02:22:12.038 INFO:teuthology.orchestra.run.smithi102.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-17T02:22:12.039 INFO:teuthology.orchestra.run.smithi102.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-08-17T02:22:12.039 INFO:teuthology.orchestra.run.smithi102.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-08-17T02:22:12.042 INFO:teuthology.orchestra.run.smithi102.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-08-17T02:22:12.060 INFO:teuthology.orchestra.run.smithi102.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-08-17T02:22:12.060 INFO:teuthology.orchestra.run.smithi102.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-08-17T02:22:12.062 INFO:teuthology.orchestra.run.smithi102.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-08-17T02:22:12.062 INFO:teuthology.orchestra.run.smithi102.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-08-17T02:22:12.089 INFO:teuthology.orchestra.run.smithi121.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-08-17T02:22:12.094 INFO:teuthology.orchestra.run.smithi121.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-08-17T02:22:12.117 INFO:teuthology.orchestra.run.smithi121.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-08-17T02:22:12.242 INFO:teuthology.orchestra.run.smithi121.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-08-17T02:22:12.250 INFO:teuthology.orchestra.run.smithi121.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-08-17T02:22:12.272 INFO:teuthology.orchestra.run.smithi121.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-08-17T02:22:12.279 INFO:teuthology.orchestra.run.smithi121.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-08-17T02:22:12.280 INFO:teuthology.orchestra.run.smithi121.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-08-17T02:22:12.287 INFO:teuthology.orchestra.run.smithi121.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-08-17T02:22:12.287 INFO:teuthology.orchestra.run.smithi121.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-08-17T02:22:12.288 INFO:teuthology.orchestra.run.smithi121.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-08-17T02:22:12.289 INFO:teuthology.orchestra.run.smithi121.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-08-17T02:22:12.334 INFO:teuthology.orchestra.run.smithi121.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1375-g2577e813-1focal [3,560 kB] 2024-08-17T02:22:12.351 INFO:teuthology.orchestra.run.smithi121.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-08-17T02:22:12.351 INFO:teuthology.orchestra.run.smithi121.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-08-17T02:22:12.432 INFO:teuthology.orchestra.run.smithi121.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-08-17T02:22:12.433 INFO:teuthology.orchestra.run.smithi121.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-08-17T02:22:12.433 INFO:teuthology.orchestra.run.smithi121.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-08-17T02:22:12.435 INFO:teuthology.orchestra.run.smithi121.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-17T02:22:12.436 INFO:teuthology.orchestra.run.smithi121.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-08-17T02:22:12.437 INFO:teuthology.orchestra.run.smithi121.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-08-17T02:22:12.439 INFO:teuthology.orchestra.run.smithi121.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-08-17T02:22:12.440 INFO:teuthology.orchestra.run.smithi121.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-08-17T02:22:12.513 INFO:teuthology.orchestra.run.smithi121.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-08-17T02:22:12.515 INFO:teuthology.orchestra.run.smithi121.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-08-17T02:22:12.595 INFO:teuthology.orchestra.run.smithi121.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-08-17T02:22:12.603 INFO:teuthology.orchestra.run.smithi121.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-08-17T02:22:12.604 INFO:teuthology.orchestra.run.smithi121.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-08-17T02:22:12.605 INFO:teuthology.orchestra.run.smithi121.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-08-17T02:22:12.606 INFO:teuthology.orchestra.run.smithi121.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-08-17T02:22:12.608 INFO:teuthology.orchestra.run.smithi121.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-08-17T02:22:12.610 INFO:teuthology.orchestra.run.smithi121.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-08-17T02:22:12.611 INFO:teuthology.orchestra.run.smithi121.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-17T02:22:12.638 INFO:teuthology.orchestra.run.smithi121.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1375-g2577e813-1focal [761 kB] 2024-08-17T02:22:12.676 INFO:teuthology.orchestra.run.smithi121.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-08-17T02:22:12.678 INFO:teuthology.orchestra.run.smithi121.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-08-17T02:22:12.714 INFO:teuthology.orchestra.run.smithi121.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1375-g2577e813-1focal [414 kB] 2024-08-17T02:22:12.721 INFO:teuthology.orchestra.run.smithi121.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1375-g2577e813-1focal [22.6 kB] 2024-08-17T02:22:12.722 INFO:teuthology.orchestra.run.smithi121.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1375-g2577e813-1focal [200 kB] 2024-08-17T02:22:12.757 INFO:teuthology.orchestra.run.smithi121.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-08-17T02:22:12.759 INFO:teuthology.orchestra.run.smithi121.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-08-17T02:22:12.760 INFO:teuthology.orchestra.run.smithi121.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-08-17T02:22:12.761 INFO:teuthology.orchestra.run.smithi121.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-08-17T02:22:12.785 INFO:teuthology.orchestra.run.smithi121.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1375-g2577e813-1focal [49.1 kB] 2024-08-17T02:22:12.787 INFO:teuthology.orchestra.run.smithi121.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1375-g2577e813-1focal [389 kB] 2024-08-17T02:22:12.796 INFO:teuthology.orchestra.run.smithi121.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1375-g2577e813-1focal [5,612 kB] 2024-08-17T02:22:12.817 INFO:teuthology.orchestra.run.smithi102.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1375-g2577e813-1focal [3,560 kB] 2024-08-17T02:22:13.079 INFO:teuthology.orchestra.run.smithi121.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-08-17T02:22:13.113 INFO:teuthology.orchestra.run.smithi121.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-08-17T02:22:13.114 INFO:teuthology.orchestra.run.smithi121.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-08-17T02:22:13.185 INFO:teuthology.orchestra.run.smithi121.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-08-17T02:22:13.185 INFO:teuthology.orchestra.run.smithi121.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-08-17T02:22:13.186 INFO:teuthology.orchestra.run.smithi121.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-08-17T02:22:13.186 INFO:teuthology.orchestra.run.smithi121.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-08-17T02:22:13.186 INFO:teuthology.orchestra.run.smithi121.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-08-17T02:22:13.187 INFO:teuthology.orchestra.run.smithi121.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-08-17T02:22:13.187 INFO:teuthology.orchestra.run.smithi121.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-08-17T02:22:13.247 INFO:teuthology.orchestra.run.smithi121.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-08-17T02:22:13.247 INFO:teuthology.orchestra.run.smithi121.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-08-17T02:22:13.328 INFO:teuthology.orchestra.run.smithi121.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-08-17T02:22:13.334 INFO:teuthology.orchestra.run.smithi121.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-08-17T02:22:13.337 INFO:teuthology.orchestra.run.smithi121.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-08-17T02:22:13.340 INFO:teuthology.orchestra.run.smithi121.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-08-17T02:22:13.341 INFO:teuthology.orchestra.run.smithi121.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-08-17T02:22:13.343 INFO:teuthology.orchestra.run.smithi121.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-08-17T02:22:13.346 INFO:teuthology.orchestra.run.smithi121.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-08-17T02:22:13.346 INFO:teuthology.orchestra.run.smithi121.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-08-17T02:22:13.419 INFO:teuthology.orchestra.run.smithi121.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-08-17T02:22:13.423 INFO:teuthology.orchestra.run.smithi121.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1375-g2577e813-1focal [116 kB] 2024-08-17T02:22:13.425 INFO:teuthology.orchestra.run.smithi121.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-08-17T02:22:13.482 INFO:teuthology.orchestra.run.smithi121.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1375-g2577e813-1focal [478 kB] 2024-08-17T02:22:13.498 INFO:teuthology.orchestra.run.smithi121.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1375-g2577e813-1focal [26.9 MB] 2024-08-17T02:22:13.535 INFO:teuthology.orchestra.run.smithi102.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1375-g2577e813-1focal [761 kB] 2024-08-17T02:22:13.587 INFO:teuthology.orchestra.run.smithi121.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-08-17T02:22:13.589 INFO:teuthology.orchestra.run.smithi121.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-08-17T02:22:13.589 INFO:teuthology.orchestra.run.smithi121.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-08-17T02:22:13.589 INFO:teuthology.orchestra.run.smithi121.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-08-17T02:22:13.589 INFO:teuthology.orchestra.run.smithi121.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-08-17T02:22:13.589 INFO:teuthology.orchestra.run.smithi121.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-08-17T02:22:13.602 INFO:teuthology.orchestra.run.smithi121.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-17T02:22:13.602 INFO:teuthology.orchestra.run.smithi121.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-08-17T02:22:13.603 INFO:teuthology.orchestra.run.smithi121.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-08-17T02:22:13.669 INFO:teuthology.orchestra.run.smithi121.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-08-17T02:22:13.750 INFO:teuthology.orchestra.run.smithi121.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-08-17T02:22:13.751 INFO:teuthology.orchestra.run.smithi121.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-08-17T02:22:13.754 INFO:teuthology.orchestra.run.smithi121.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-08-17T02:22:13.756 INFO:teuthology.orchestra.run.smithi121.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-08-17T02:22:13.884 INFO:teuthology.orchestra.run.smithi102.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1375-g2577e813-1focal [414 kB] 2024-08-17T02:22:13.910 INFO:teuthology.orchestra.run.smithi102.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1375-g2577e813-1focal [22.6 kB] 2024-08-17T02:22:13.910 INFO:teuthology.orchestra.run.smithi102.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1375-g2577e813-1focal [200 kB] 2024-08-17T02:22:13.973 INFO:teuthology.orchestra.run.smithi102.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1375-g2577e813-1focal [49.1 kB] 2024-08-17T02:22:13.974 INFO:teuthology.orchestra.run.smithi102.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1375-g2577e813-1focal [389 kB] 2024-08-17T02:22:14.093 INFO:teuthology.orchestra.run.smithi102.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1375-g2577e813-1focal [5,612 kB] 2024-08-17T02:22:15.678 INFO:teuthology.orchestra.run.smithi102.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1375-g2577e813-1focal [116 kB] 2024-08-17T02:22:15.738 INFO:teuthology.orchestra.run.smithi102.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1375-g2577e813-1focal [478 kB] 2024-08-17T02:22:15.869 INFO:teuthology.orchestra.run.smithi102.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1375-g2577e813-1focal [26.9 MB] 2024-08-17T02:22:16.231 INFO:teuthology.orchestra.run.smithi121.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1375-g2577e813-1focal [5,173 kB] 2024-08-17T02:22:16.628 INFO:teuthology.orchestra.run.smithi121.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1375-g2577e813-1focal [223 kB] 2024-08-17T02:22:16.632 INFO:teuthology.orchestra.run.smithi121.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1375-g2577e813-1focal [157 kB] 2024-08-17T02:22:16.635 INFO:teuthology.orchestra.run.smithi121.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1375-g2577e813-1focal [1,594 kB] 2024-08-17T02:22:16.798 INFO:teuthology.orchestra.run.smithi121.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1375-g2577e813-1focal [4,686 kB] 2024-08-17T02:22:17.228 INFO:teuthology.orchestra.run.smithi121.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1375-g2577e813-1focal [23.1 MB] 2024-08-17T02:22:19.564 INFO:teuthology.orchestra.run.smithi121.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1375-g2577e813-1focal [3,944 B] 2024-08-17T02:22:19.564 INFO:teuthology.orchestra.run.smithi121.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1375-g2577e813-1focal [871 kB] 2024-08-17T02:22:19.580 INFO:teuthology.orchestra.run.smithi121.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1375-g2577e813-1focal [2,415 kB] 2024-08-17T02:22:19.803 INFO:teuthology.orchestra.run.smithi121.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1375-g2577e813-1focal [81.4 kB] 2024-08-17T02:22:19.843 INFO:teuthology.orchestra.run.smithi121.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1375-g2577e813-1focal [120 kB] 2024-08-17T02:22:19.846 INFO:teuthology.orchestra.run.smithi121.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1375-g2577e813-1focal [6,653 kB] 2024-08-17T02:22:20.508 INFO:teuthology.orchestra.run.smithi121.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1375-g2577e813-1focal [7,886 kB] 2024-08-17T02:22:21.287 INFO:teuthology.orchestra.run.smithi121.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1375-g2577e813-1focal [4,060 B] 2024-08-17T02:22:21.288 INFO:teuthology.orchestra.run.smithi121.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1375-g2577e813-1focal [53.3 MB] 2024-08-17T02:22:23.499 INFO:teuthology.orchestra.run.smithi102.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1375-g2577e813-1focal [5,173 kB] 2024-08-17T02:22:24.894 INFO:teuthology.orchestra.run.smithi102.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1375-g2577e813-1focal [223 kB] 2024-08-17T02:22:24.906 INFO:teuthology.orchestra.run.smithi102.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1375-g2577e813-1focal [157 kB] 2024-08-17T02:22:24.966 INFO:teuthology.orchestra.run.smithi102.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1375-g2577e813-1focal [1,594 kB] 2024-08-17T02:22:25.390 INFO:teuthology.orchestra.run.smithi102.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1375-g2577e813-1focal [4,686 kB] 2024-08-17T02:22:26.318 INFO:teuthology.orchestra.run.smithi102.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1375-g2577e813-1focal [23.1 MB] 2024-08-17T02:22:26.424 INFO:teuthology.orchestra.run.smithi121.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1375-g2577e813-1focal [230 kB] 2024-08-17T02:22:26.428 INFO:teuthology.orchestra.run.smithi121.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.7-1375-g2577e813-1focal [241 kB] 2024-08-17T02:22:26.433 INFO:teuthology.orchestra.run.smithi121.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.7-1375-g2577e813-1focal [22.0 kB] 2024-08-17T02:22:26.434 INFO:teuthology.orchestra.run.smithi121.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.7-1375-g2577e813-1focal [13.1 kB] 2024-08-17T02:22:26.434 INFO:teuthology.orchestra.run.smithi121.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1375-g2577e813-1focal [21.9 kB] 2024-08-17T02:22:26.435 INFO:teuthology.orchestra.run.smithi121.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1375-g2577e813-1focal [17.1 MB] 2024-08-17T02:22:27.255 INFO:teuthology.orchestra.run.smithi121.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1375-g2577e813-1focal [80.6 kB] 2024-08-17T02:22:27.892 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 201 MB in 16s (12.7 MB/s) 2024-08-17T02:22:28.040 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-17T02:22:28.096 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141718 files and directories currently installed.) 2024-08-17T02:22:28.100 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-08-17T02:22:28.138 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-08-17T02:22:28.424 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-17T02:22:28.441 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-08-17T02:22:28.507 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:22:28.818 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cmd2. 2024-08-17T02:22:28.835 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-08-17T02:22:28.876 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:22:29.254 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-08-17T02:22:29.271 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-08-17T02:22:29.371 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:22:29.377 INFO:teuthology.orchestra.run.smithi102.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1375-g2577e813-1focal [3,944 B] 2024-08-17T02:22:29.377 INFO:teuthology.orchestra.run.smithi102.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1375-g2577e813-1focal [871 kB] 2024-08-17T02:22:29.432 INFO:teuthology.orchestra.run.smithi102.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1375-g2577e813-1focal [2,415 kB] 2024-08-17T02:22:29.693 INFO:teuthology.orchestra.run.smithi102.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1375-g2577e813-1focal [81.4 kB] 2024-08-17T02:22:29.693 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../004-librbd1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:29.695 INFO:teuthology.orchestra.run.smithi102.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1375-g2577e813-1focal [120 kB] 2024-08-17T02:22:29.717 INFO:teuthology.orchestra.run.smithi102.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1375-g2577e813-1focal [6,653 kB] 2024-08-17T02:22:29.800 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librbd1 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:22:30.398 INFO:teuthology.orchestra.run.smithi102.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1375-g2577e813-1focal [7,886 kB] 2024-08-17T02:22:30.547 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../005-librados2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:30.656 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librados2 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:22:31.009 INFO:teuthology.orchestra.run.smithi102.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1375-g2577e813-1focal [4,060 B] 2024-08-17T02:22:31.009 INFO:teuthology.orchestra.run.smithi102.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1375-g2577e813-1focal [53.3 MB] 2024-08-17T02:22:31.377 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libcephfs2. 2024-08-17T02:22:31.395 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../006-libcephfs2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:31.435 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:31.796 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-rados. 2024-08-17T02:22:31.814 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../007-python3-rados_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:31.854 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:32.157 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-17T02:22:32.175 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:32.240 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:32.518 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cephfs. 2024-08-17T02:22:32.537 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../009-python3-cephfs_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:32.576 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:32.929 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-17T02:22:32.944 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:32.987 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:33.403 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-prettytable. 2024-08-17T02:22:33.422 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2024-08-17T02:22:33.465 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-08-17T02:22:33.743 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-rbd. 2024-08-17T02:22:33.759 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../012-python3-rbd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:33.801 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:34.162 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-08-17T02:22:34.182 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-08-17T02:22:34.220 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:22:34.604 INFO:teuthology.orchestra.run.smithi102.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1375-g2577e813-1focal [230 kB] 2024-08-17T02:22:34.609 INFO:teuthology.orchestra.run.smithi102.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.7-1375-g2577e813-1focal [241 kB] 2024-08-17T02:22:34.614 INFO:teuthology.orchestra.run.smithi102.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.7-1375-g2577e813-1focal [22.0 kB] 2024-08-17T02:22:34.614 INFO:teuthology.orchestra.run.smithi102.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.7-1375-g2577e813-1focal [13.1 kB] 2024-08-17T02:22:34.615 INFO:teuthology.orchestra.run.smithi102.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1375-g2577e813-1focal [21.9 kB] 2024-08-17T02:22:34.616 INFO:teuthology.orchestra.run.smithi102.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1375-g2577e813-1focal [17.1 MB] 2024-08-17T02:22:34.623 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-08-17T02:22:34.640 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2024-08-17T02:22:34.682 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:22:35.035 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-17T02:22:35.051 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-08-17T02:22:35.093 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:22:35.399 INFO:teuthology.orchestra.run.smithi102.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1375-g2577e813-1focal [80.6 kB] 2024-08-17T02:22:35.479 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-17T02:22:35.496 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-08-17T02:22:35.537 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:22:35.907 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-17T02:22:35.924 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-08-17T02:22:35.966 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:22:36.053 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 201 MB in 24s (8,392 kB/s) 2024-08-17T02:22:36.230 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-17T02:22:36.288 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141718 files and directories currently installed.) 2024-08-17T02:22:36.292 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-08-17T02:22:36.337 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-08-17T02:22:36.469 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-17T02:22:36.487 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:22:36.537 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:36.647 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-17T02:22:36.664 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-08-17T02:22:36.697 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:22:37.008 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cmd2. 2024-08-17T02:22:37.027 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-08-17T02:22:37.064 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-17T02:22:37.066 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:22:37.082 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:22:37.122 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:37.436 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-08-17T02:22:37.453 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-08-17T02:22:37.520 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:22:37.534 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-17T02:22:37.549 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:22:37.592 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:37.884 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../004-librbd1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:38.007 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librbd1 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:22:38.012 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-08-17T02:22:38.028 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-08-17T02:22:38.078 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:22:38.440 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package librgw2. 2024-08-17T02:22:38.458 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../022-librgw2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:38.498 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:38.696 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../005-librados2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:38.828 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librados2 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:22:39.292 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-rgw. 2024-08-17T02:22:39.309 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../023-python3-rgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:39.350 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:39.524 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs2. 2024-08-17T02:22:39.540 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../006-libcephfs2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:39.582 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:39.720 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package liboath0. 2024-08-17T02:22:39.738 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-08-17T02:22:39.803 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-08-17T02:22:39.893 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rados. 2024-08-17T02:22:39.911 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../007-python3-rados_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:39.942 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:40.131 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libradosstriper1. 2024-08-17T02:22:40.148 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../025-libradosstriper1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:40.189 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:40.312 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-17T02:22:40.329 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:40.371 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:40.648 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cephfs. 2024-08-17T02:22:40.664 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../009-python3-cephfs_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:40.706 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:40.709 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-common. 2024-08-17T02:22:40.727 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../026-ceph-common_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:40.767 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:41.793 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-17T02:22:41.809 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:41.842 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:42.154 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-prettytable. 2024-08-17T02:22:42.172 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2024-08-17T02:22:42.204 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-08-17T02:22:42.465 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rbd. 2024-08-17T02:22:42.483 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../012-python3-rbd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:42.523 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:42.876 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-08-17T02:22:42.895 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-08-17T02:22:42.934 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:22:43.271 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-08-17T02:22:43.286 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2024-08-17T02:22:43.320 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:22:43.665 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-17T02:22:43.681 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-08-17T02:22:43.723 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:22:43.848 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-base. 2024-08-17T02:22:43.864 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../027-ceph-base_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:43.933 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:44.101 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-17T02:22:44.119 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-08-17T02:22:44.159 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:22:44.490 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-17T02:22:44.505 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-08-17T02:22:44.550 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:22:44.811 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cryptography. 2024-08-17T02:22:44.830 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-08-17T02:22:44.892 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:22:45.043 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-17T02:22:45.060 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:22:45.111 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:45.289 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-openssl. 2024-08-17T02:22:45.307 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2024-08-17T02:22:45.347 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-08-17T02:22:45.646 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-17T02:22:45.664 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:22:45.692 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-packaging. 2024-08-17T02:22:45.704 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:45.708 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../030-python3-packaging_20.3-1_all.deb ... 2024-08-17T02:22:45.775 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-packaging (20.3-1) ... 2024-08-17T02:22:46.053 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-17T02:22:46.071 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../031-ceph-mgr-modules-core_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:46.099 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-17T02:22:46.111 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:46.116 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:22:46.157 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:46.525 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-17T02:22:46.535 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-08-17T02:22:46.540 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../032-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-08-17T02:22:46.555 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-08-17T02:22:46.583 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:22:46.585 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:22:46.927 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-17T02:22:46.946 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../033-python3-cherrypy3_8.9.1-6_all.deb ... 2024-08-17T02:22:46.955 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librgw2. 2024-08-17T02:22:46.972 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../022-librgw2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:46.985 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:22:47.014 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:47.347 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-natsort. 2024-08-17T02:22:47.364 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../034-python3-natsort_7.0.1-1_all.deb ... 2024-08-17T02:22:47.406 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-08-17T02:22:47.742 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jwt. 2024-08-17T02:22:47.762 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../035-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-08-17T02:22:47.824 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rgw. 2024-08-17T02:22:47.833 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:22:47.840 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../023-python3-rgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:47.882 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:48.170 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-logutils. 2024-08-17T02:22:48.187 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-7_all.deb ... 2024-08-17T02:22:48.227 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liboath0. 2024-08-17T02:22:48.228 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-08-17T02:22:48.242 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-08-17T02:22:48.277 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-08-17T02:22:48.556 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-17T02:22:48.573 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../037-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-08-17T02:22:48.579 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libradosstriper1. 2024-08-17T02:22:48.595 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../025-libradosstriper1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:48.614 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:22:48.638 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:48.917 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-mako. 2024-08-17T02:22:48.933 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../038-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-08-17T02:22:48.992 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:22:49.108 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-common. 2024-08-17T02:22:49.127 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../026-ceph-common_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:49.191 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:49.329 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-17T02:22:49.345 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-17T02:22:49.379 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:22:49.707 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-17T02:22:49.723 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-08-17T02:22:49.765 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:22:50.126 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-webob. 2024-08-17T02:22:50.146 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.5-2_all.deb ... 2024-08-17T02:22:50.184 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-08-17T02:22:50.537 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-soupsieve. 2024-08-17T02:22:50.553 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../042-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-08-17T02:22:50.595 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:22:50.865 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-bs4. 2024-08-17T02:22:50.883 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../043-python3-bs4_4.8.2-1_all.deb ... 2024-08-17T02:22:50.915 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-08-17T02:22:51.209 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-waitress. 2024-08-17T02:22:51.227 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../044-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-08-17T02:22:51.287 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:22:51.644 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-tempita. 2024-08-17T02:22:51.663 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../045-python3-tempita_0.5.2-6_all.deb ... 2024-08-17T02:22:51.703 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-08-17T02:22:51.763 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-base. 2024-08-17T02:22:51.782 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../027-ceph-base_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:51.848 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:52.031 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-paste. 2024-08-17T02:22:52.050 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../046-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-08-17T02:22:52.131 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:22:52.467 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-17T02:22:52.487 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../047-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-08-17T02:22:52.525 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:22:52.668 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cryptography. 2024-08-17T02:22:52.685 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-08-17T02:22:52.726 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:22:52.828 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-17T02:22:52.847 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../048-python3-pastedeploy_2.1.0-1_all.deb ... 2024-08-17T02:22:52.878 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:22:53.080 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-openssl. 2024-08-17T02:22:53.095 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2024-08-17T02:22:53.129 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-08-17T02:22:53.198 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-webtest. 2024-08-17T02:22:53.216 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../049-python3-webtest_2.0.32-2_all.deb ... 2024-08-17T02:22:53.282 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-08-17T02:22:53.482 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-packaging. 2024-08-17T02:22:53.498 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../030-python3-packaging_20.3-1_all.deb ... 2024-08-17T02:22:53.540 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-packaging (20.3-1) ... 2024-08-17T02:22:53.626 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pecan. 2024-08-17T02:22:53.645 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../050-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-08-17T02:22:53.684 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:22:53.826 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-17T02:22:53.842 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../031-ceph-mgr-modules-core_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:53.885 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:54.006 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-17T02:22:54.023 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../051-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-08-17T02:22:54.056 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:22:54.282 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-17T02:22:54.297 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../032-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-08-17T02:22:54.339 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:22:54.461 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-17T02:22:54.479 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../052-libsqlite3-mod-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:54.511 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:54.676 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-17T02:22:54.693 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../033-python3-cherrypy3_8.9.1-6_all.deb ... 2024-08-17T02:22:54.734 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:22:54.892 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr. 2024-08-17T02:22:54.908 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../053-ceph-mgr_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:54.949 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:55.096 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-natsort. 2024-08-17T02:22:55.113 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../034-python3-natsort_7.0.1-1_all.deb ... 2024-08-17T02:22:55.154 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-08-17T02:22:55.477 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mon. 2024-08-17T02:22:55.493 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../054-ceph-mon_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:55.507 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jwt. 2024-08-17T02:22:55.525 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../035-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-08-17T02:22:55.535 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:55.565 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:22:55.877 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-logutils. 2024-08-17T02:22:55.893 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-7_all.deb ... 2024-08-17T02:22:55.935 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-08-17T02:22:56.271 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-17T02:22:56.289 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../037-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-08-17T02:22:56.329 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:22:56.363 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-osd. 2024-08-17T02:22:56.380 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../055-ceph-osd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:56.422 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:56.649 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-mako. 2024-08-17T02:22:56.665 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../038-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-08-17T02:22:56.708 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:22:57.377 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-17T02:22:57.396 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-17T02:22:57.435 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:22:57.713 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-17T02:22:57.732 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-08-17T02:22:57.796 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:22:58.100 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webob. 2024-08-17T02:22:58.116 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.5-2_all.deb ... 2024-08-17T02:22:58.191 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-08-17T02:22:58.511 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-soupsieve. 2024-08-17T02:22:58.527 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../042-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-08-17T02:22:58.587 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:22:58.608 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph. 2024-08-17T02:22:58.624 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../056-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:58.767 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:58.905 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-bs4. 2024-08-17T02:22:58.922 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../043-python3-bs4_4.8.2-1_all.deb ... 2024-08-17T02:22:58.963 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-08-17T02:22:59.317 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-waitress. 2024-08-17T02:22:59.336 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../044-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-08-17T02:22:59.391 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-fuse. 2024-08-17T02:22:59.403 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:22:59.410 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../057-ceph-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:59.460 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:59.711 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-tempita. 2024-08-17T02:22:59.727 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../045-python3-tempita_0.5.2-6_all.deb ... 2024-08-17T02:22:59.769 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-08-17T02:22:59.848 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mds. 2024-08-17T02:22:59.864 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../058-ceph-mds_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:59.908 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:00.114 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-paste. 2024-08-17T02:23:00.132 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../046-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-08-17T02:23:00.197 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:23:00.501 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package cephadm. 2024-08-17T02:23:00.515 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-17T02:23:00.519 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../059-cephadm_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:00.531 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../047-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-08-17T02:23:00.584 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:00.607 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:23:00.860 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-17T02:23:00.876 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../048-python3-pastedeploy_2.1.0-1_all.deb ... 2024-08-17T02:23:00.909 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:23:00.912 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jinja2. 2024-08-17T02:23:00.931 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../060-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-08-17T02:23:00.970 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:23:01.238 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webtest. 2024-08-17T02:23:01.256 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../049-python3-webtest_2.0.32-2_all.deb ... 2024-08-17T02:23:01.296 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-08-17T02:23:01.306 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-17T02:23:01.326 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../061-ceph-mgr-cephadm_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:01.364 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:01.615 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pecan. 2024-08-17T02:23:01.635 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../050-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-08-17T02:23:01.673 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:23:01.735 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-17T02:23:01.754 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2024-08-17T02:23:01.792 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-17T02:23:02.029 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libjs-underscore. 2024-08-17T02:23:02.046 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-08-17T02:23:02.078 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:23:02.087 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-17T02:23:02.104 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../051-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-08-17T02:23:02.145 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:23:02.373 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-08-17T02:23:02.389 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-08-17T02:23:02.431 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:23:02.524 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-17T02:23:02.541 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../052-libsqlite3-mod-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:02.615 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:02.767 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-routes. 2024-08-17T02:23:02.786 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2024-08-17T02:23:02.825 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-08-17T02:23:02.952 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr. 2024-08-17T02:23:02.968 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../053-ceph-mgr_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:03.043 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:03.212 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-17T02:23:03.228 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:03.270 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:03.567 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mon. 2024-08-17T02:23:03.583 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../054-ceph-mon_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:03.617 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:04.462 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-osd. 2024-08-17T02:23:04.480 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../055-ceph-osd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:04.520 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:04.667 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-decorator. 2024-08-17T02:23:04.684 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-08-17T02:23:04.725 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:23:05.053 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-08-17T02:23:05.069 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-08-17T02:23:05.111 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:23:05.497 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-scipy. 2024-08-17T02:23:05.513 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-08-17T02:23:05.556 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-08-17T02:23:06.622 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph. 2024-08-17T02:23:06.638 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../056-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:06.680 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:07.008 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-08-17T02:23:07.024 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-08-17T02:23:07.033 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-fuse. 2024-08-17T02:23:07.049 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../057-ceph-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:07.065 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:07.091 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:07.569 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mds. 2024-08-17T02:23:07.588 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../058-ceph-mds_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:07.627 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:07.636 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-joblib. 2024-08-17T02:23:07.655 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2024-08-17T02:23:07.694 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-08-17T02:23:08.081 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-sklearn. 2024-08-17T02:23:08.099 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-08-17T02:23:08.164 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:08.205 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephadm. 2024-08-17T02:23:08.224 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../059-cephadm_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:08.263 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:08.617 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jinja2. 2024-08-17T02:23:08.636 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../060-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-08-17T02:23:08.675 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:23:08.891 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-17T02:23:08.909 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:08.949 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:09.020 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-17T02:23:09.037 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../061-ceph-mgr-cephadm_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:09.078 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:09.456 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-17T02:23:09.473 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2024-08-17T02:23:09.514 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-17T02:23:09.809 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjs-underscore. 2024-08-17T02:23:09.825 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-08-17T02:23:09.867 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:23:10.086 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cachetools. 2024-08-17T02:23:10.106 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2024-08-17T02:23:10.144 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-08-17T02:23:10.161 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-08-17T02:23:10.177 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-08-17T02:23:10.244 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:23:10.471 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-17T02:23:10.488 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-08-17T02:23:10.521 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:23:10.586 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-routes. 2024-08-17T02:23:10.603 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2024-08-17T02:23:10.646 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-08-17T02:23:10.875 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-17T02:23:10.892 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-08-17T02:23:10.933 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:23:11.017 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-17T02:23:11.033 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:11.075 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:11.302 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-rsa. 2024-08-17T02:23:11.322 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2024-08-17T02:23:11.360 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-rsa (4.0-3) ... 2024-08-17T02:23:11.689 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-google-auth. 2024-08-17T02:23:11.705 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2024-08-17T02:23:11.747 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-08-17T02:23:12.100 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-blinker. 2024-08-17T02:23:12.117 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-08-17T02:23:12.192 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:23:12.455 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-decorator. 2024-08-17T02:23:12.473 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-08-17T02:23:12.513 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:23:12.521 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-oauthlib. 2024-08-17T02:23:12.539 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-08-17T02:23:12.570 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:23:12.849 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-08-17T02:23:12.865 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-08-17T02:23:12.899 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:23:13.043 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-17T02:23:13.063 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-08-17T02:23:13.101 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:23:13.252 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-scipy. 2024-08-17T02:23:13.269 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-08-17T02:23:13.310 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-08-17T02:23:13.446 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-websocket. 2024-08-17T02:23:13.462 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-08-17T02:23:13.505 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:23:13.826 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-17T02:23:13.843 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-08-17T02:23:13.908 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:23:14.556 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-17T02:23:14.575 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:14.605 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:14.662 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-08-17T02:23:14.682 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-08-17T02:23:14.720 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:14.954 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-17T02:23:14.974 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2024-08-17T02:23:15.012 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:23:15.282 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-joblib. 2024-08-17T02:23:15.301 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2024-08-17T02:23:15.340 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-08-17T02:23:15.407 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-17T02:23:15.427 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:23:15.465 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:23:15.719 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn. 2024-08-17T02:23:15.735 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-08-17T02:23:15.760 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package jq. 2024-08-17T02:23:15.776 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:23:15.777 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:15.817 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:23:16.104 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package socat. 2024-08-17T02:23:16.121 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2024-08-17T02:23:16.162 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking socat (1.7.3.3-2) ... 2024-08-17T02:23:16.485 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-17T02:23:16.504 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:16.535 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:16.535 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package xmlstarlet. 2024-08-17T02:23:16.555 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-08-17T02:23:16.598 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:23:16.962 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-test. 2024-08-17T02:23:16.981 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../090-ceph-test_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:17.020 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:17.663 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cachetools. 2024-08-17T02:23:17.681 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2024-08-17T02:23:17.721 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-08-17T02:23:18.058 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-17T02:23:18.074 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-08-17T02:23:18.115 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:23:18.477 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-17T02:23:18.494 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-08-17T02:23:18.535 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:23:18.872 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rsa. 2024-08-17T02:23:18.888 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2024-08-17T02:23:18.938 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rsa (4.0-3) ... 2024-08-17T02:23:19.274 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-google-auth. 2024-08-17T02:23:19.295 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2024-08-17T02:23:19.332 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-08-17T02:23:19.636 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-blinker. 2024-08-17T02:23:19.653 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-08-17T02:23:19.694 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:23:20.030 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-oauthlib. 2024-08-17T02:23:20.049 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-08-17T02:23:20.105 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:23:20.537 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-17T02:23:20.554 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-08-17T02:23:20.595 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:23:20.931 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-websocket. 2024-08-17T02:23:20.951 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-08-17T02:23:20.981 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:23:21.329 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-17T02:23:21.346 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-08-17T02:23:21.387 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:23:21.703 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-volume. 2024-08-17T02:23:21.723 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../091-ceph-volume_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:21.761 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:21.976 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-17T02:23:21.994 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:22.034 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:22.219 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-17T02:23:22.236 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../092-cephfs-mirror_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:22.275 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:22.362 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-17T02:23:22.380 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2024-08-17T02:23:22.412 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:23:22.639 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-colorama. 2024-08-17T02:23:22.658 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2024-08-17T02:23:22.722 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-08-17T02:23:22.790 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-17T02:23:22.809 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:23:22.848 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:23:23.000 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package cephfs-shell. 2024-08-17T02:23:23.017 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../094-cephfs-shell_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:23.050 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:23.134 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package jq. 2024-08-17T02:23:23.152 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:23:23.196 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:23:23.319 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package cephfs-top. 2024-08-17T02:23:23.339 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../095-cephfs-top_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:23.377 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:23.449 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package socat. 2024-08-17T02:23:23.468 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2024-08-17T02:23:23.507 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking socat (1.7.3.3-2) ... 2024-08-17T02:23:23.663 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package fonts-mathjax. 2024-08-17T02:23:23.680 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:23:23.721 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:23.844 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package xmlstarlet. 2024-08-17T02:23:23.861 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-08-17T02:23:23.902 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:23:24.256 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-test. 2024-08-17T02:23:24.273 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../090-ceph-test_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:24.283 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-17T02:23:24.301 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../097-libcephfs-dev_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:24.314 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:24.333 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:24.768 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package nvme-cli. 2024-08-17T02:23:24.785 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-08-17T02:23:24.845 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:23:25.199 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libjs-mathjax. 2024-08-17T02:23:25.219 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../099-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:23:25.257 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:26.979 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python-natsort-doc. 2024-08-17T02:23:26.997 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../100-python-natsort-doc_7.0.1-1_all.deb ... 2024-08-17T02:23:27.037 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-08-17T02:23:27.440 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-atomicwrites. 2024-08-17T02:23:27.460 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../101-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-08-17T02:23:27.498 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:23:27.826 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-attr. 2024-08-17T02:23:27.842 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../102-python3-attr_19.3.0-2_all.deb ... 2024-08-17T02:23:27.892 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-08-17T02:23:28.237 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-webencodings. 2024-08-17T02:23:28.254 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../103-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-08-17T02:23:28.320 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:23:28.648 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-html5lib. 2024-08-17T02:23:28.665 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../104-python3-html5lib_1.0.1-2_all.deb ... 2024-08-17T02:23:28.706 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-08-17T02:23:28.878 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-volume. 2024-08-17T02:23:28.896 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../091-ceph-volume_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:28.936 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:29.084 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-08-17T02:23:29.104 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../105-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-08-17T02:23:29.175 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:23:29.353 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-17T02:23:29.370 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../092-cephfs-mirror_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:29.402 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:29.739 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-colorama. 2024-08-17T02:23:29.755 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2024-08-17T02:23:29.817 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-08-17T02:23:29.840 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pastescript. 2024-08-17T02:23:29.860 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-17T02:23:30.084 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephfs-shell. 2024-08-17T02:23:30.104 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../094-cephfs-shell_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:30.142 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:30.230 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-17T02:23:30.428 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephfs-top. 2024-08-17T02:23:30.445 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../095-cephfs-top_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:30.494 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:30.566 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pluggy. 2024-08-17T02:23:30.585 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2024-08-17T02:23:30.624 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-08-17T02:23:30.774 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package fonts-mathjax. 2024-08-17T02:23:30.793 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:23:30.832 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:30.960 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-psutil. 2024-08-17T02:23:30.977 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-08-17T02:23:31.018 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:23:31.388 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-py. 2024-08-17T02:23:31.406 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-08-17T02:23:31.410 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-17T02:23:31.429 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../097-libcephfs-dev_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:31.446 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:23:31.469 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:31.791 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-17T02:23:31.808 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-08-17T02:23:31.849 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:23:31.864 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package nvme-cli. 2024-08-17T02:23:31.884 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-08-17T02:23:31.940 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:23:32.244 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pytest. 2024-08-17T02:23:32.263 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2024-08-17T02:23:32.285 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjs-mathjax. 2024-08-17T02:23:32.302 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-08-17T02:23:32.302 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../099-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:23:32.343 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:32.666 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-simplejson. 2024-08-17T02:23:32.687 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-08-17T02:23:32.724 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:23:33.011 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-17T02:23:33.028 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-08-17T02:23:33.081 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:23:33.823 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package radosgw. 2024-08-17T02:23:33.843 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../114-radosgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:33.881 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:34.172 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-natsort-doc. 2024-08-17T02:23:34.190 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../100-python-natsort-doc_7.0.1-1_all.deb ... 2024-08-17T02:23:34.229 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-08-17T02:23:34.574 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-atomicwrites. 2024-08-17T02:23:34.596 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../101-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-08-17T02:23:34.624 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:23:34.910 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-attr. 2024-08-17T02:23:34.930 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../102-python3-attr_19.3.0-2_all.deb ... 2024-08-17T02:23:34.968 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-08-17T02:23:35.305 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webencodings. 2024-08-17T02:23:35.322 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../103-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-08-17T02:23:35.363 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:23:35.593 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package rbd-fuse. 2024-08-17T02:23:35.609 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../115-rbd-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:35.651 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:35.707 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-html5lib. 2024-08-17T02:23:35.725 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../104-python3-html5lib_1.0.1-2_all.deb ... 2024-08-17T02:23:35.765 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-08-17T02:23:35.988 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-attr (19.3.0-2) ... 2024-08-17T02:23:36.102 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-08-17T02:23:36.119 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../105-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-08-17T02:23:36.152 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:23:36.325 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:23:36.434 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:23:36.594 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:23:36.655 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastescript. 2024-08-17T02:23:36.673 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-17T02:23:36.730 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-17T02:23:36.806 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:37.059 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pluggy. 2024-08-17T02:23:37.075 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2024-08-17T02:23:37.133 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-08-17T02:23:37.414 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-psutil. 2024-08-17T02:23:37.431 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-08-17T02:23:37.469 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:23:37.482 INFO:teuthology.orchestra.run.smithi121.stdout:Adding system user cephadm....done 2024-08-17T02:23:37.610 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:37.771 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:23:37.797 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-py. 2024-08-17T02:23:37.814 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-08-17T02:23:37.855 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:23:38.131 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-17T02:23:38.175 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-17T02:23:38.196 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-08-17T02:23:38.259 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:23:38.423 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:38.549 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-08-17T02:23:38.603 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pytest. 2024-08-17T02:23:38.620 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2024-08-17T02:23:38.661 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-08-17T02:23:38.686 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:23:39.012 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-08-17T02:23:39.032 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplejson. 2024-08-17T02:23:39.052 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-08-17T02:23:39.090 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:23:39.392 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-17T02:23:39.410 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-08-17T02:23:39.450 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:23:39.457 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:23:39.774 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-08-17T02:23:40.083 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-08-17T02:23:40.274 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package radosgw. 2024-08-17T02:23:40.291 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../114-radosgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:40.357 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:40.368 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:23:40.644 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:23:40.945 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:41.246 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:41.372 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-08-17T02:23:41.681 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:23:41.999 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:23:42.136 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package rbd-fuse. 2024-08-17T02:23:42.153 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../115-rbd-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:42.194 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:42.333 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:23:42.459 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:23:42.511 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-attr (19.3.0-2) ... 2024-08-17T02:23:42.782 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:23:42.844 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-08-17T02:23:42.908 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:23:43.034 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:23:43.192 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:23:43.261 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:43.496 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:23:43.856 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:23:43.900 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user cephadm....done 2024-08-17T02:23:44.061 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:44.148 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:23:44.187 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:23:44.491 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-08-17T02:23:44.564 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-17T02:23:44.775 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-packaging (20.3-1) ... 2024-08-17T02:23:44.882 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:45.008 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-08-17T02:23:45.068 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:23:45.167 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:23:45.236 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:23:45.378 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:23:45.520 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-08-17T02:23:45.663 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:23:45.948 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:23:46.098 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:23:46.232 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-08-17T02:23:46.407 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:23:46.550 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-08-17T02:23:46.775 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:23:46.834 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:23:47.102 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:23:47.144 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up socat (1.7.3.3-2) ... 2024-08-17T02:23:47.303 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:47.419 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:47.629 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:23:47.712 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:47.763 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-08-17T02:23:47.838 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-08-17T02:23:48.148 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:23:48.156 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:23:48.266 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:23:48.424 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:23:48.425 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-08-17T02:23:48.717 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:23:48.718 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:23:48.876 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:23:49.044 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:23:49.170 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:23:49.244 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-08-17T02:23:49.321 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:23:49.553 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:23:49.664 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:23:49.854 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:23:49.940 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-08-17T02:23:50.206 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:23:50.233 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:23:50.359 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:23:50.482 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:23:50.702 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-08-17T02:23:50.816 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-08-17T02:23:51.011 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:23:51.109 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-packaging (20.3-1) ... 2024-08-17T02:23:51.320 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:23:51.427 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:23:51.536 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:23:51.669 INFO:teuthology.orchestra.run.smithi121.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-08-17T02:23:51.695 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:23:51.940 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:23:52.013 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:23:52.066 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:23:52.434 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:23:52.434 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:23:52.734 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:23:52.818 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:23:52.944 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:23:53.103 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-08-17T02:23:53.136 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:23:53.438 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:23:53.513 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up socat (1.7.3.3-2) ... 2024-08-17T02:23:53.672 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:53.739 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librados2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:53.881 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-08-17T02:23:54.031 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:23:54.166 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-08-17T02:23:54.517 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:23:54.643 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:23:54.769 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-08-17T02:23:55.079 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:23:55.354 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:55.405 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:23:55.480 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:23:55.531 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:23:55.631 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-08-17T02:23:55.682 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:23:55.992 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:23:55.999 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-08-17T02:23:56.283 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:23:56.301 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-08-17T02:23:56.576 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:23:56.602 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:23:56.702 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-08-17T02:23:56.728 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:23:57.030 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-08-17T02:23:57.095 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:57.221 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:23:57.331 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:23:57.614 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:57.648 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:23:57.742 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:23:57.996 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-08-17T02:23:58.066 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:58.284 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:23:58.427 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:23:59.144 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:23:59.146 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librbd1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:59.247 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:23:59.399 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-08-17T02:23:59.496 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:23:59.525 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:23:59.622 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:23:59.692 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-rsa (4.0-3) ... 2024-08-17T02:23:59.748 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-08-17T02:24:00.002 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:24:00.124 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:24:00.128 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-08-17T02:24:00.417 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librados2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:00.531 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:00.543 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-08-17T02:24:00.657 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:00.903 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:24:00.903 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:24:01.388 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:01.510 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:24:01.795 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-17T02:24:02.050 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:02.104 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:24:02.175 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:24:02.317 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-08-17T02:24:02.449 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:02.608 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:02.678 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-08-17T02:24:02.734 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:02.885 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:03.011 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:03.020 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:24:03.162 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-routes (2.4.1-2) ... 2024-08-17T02:24:03.313 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:24:03.447 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-08-17T02:24:03.464 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-08-17T02:24:03.731 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:03.815 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:03.857 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:03.916 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:24:04.008 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:04.143 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:24:04.227 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:04.353 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:24:04.679 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:24:05.104 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:05.698 INFO:teuthology.orchestra.run.smithi121.stdout:Adding group ceph....done 2024-08-17T02:24:05.751 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librbd1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:05.877 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:24:06.003 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-08-17T02:24:06.108 INFO:teuthology.orchestra.run.smithi121.stdout:Adding system user ceph....done 2024-08-17T02:24:06.154 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:24:06.280 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rsa (4.0-3) ... 2024-08-17T02:24:06.293 INFO:teuthology.orchestra.run.smithi121.stdout:Setting system user ceph properties....done 2024-08-17T02:24:06.314 INFO:teuthology.orchestra.run.smithi121.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-17T02:24:06.464 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-17T02:24:06.606 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:24:06.732 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-08-17T02:24:06.790 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-17T02:24:07.111 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:07.237 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:07.239 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:07.467 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:24:07.468 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:24:07.487 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:24:07.487 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:24:07.931 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:07.946 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:08.056 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:24:08.066 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:08.350 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:24:08.351 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:24:08.399 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-17T02:24:08.717 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:24:08.993 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:09.078 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:09.179 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:09.346 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:09.412 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-17T02:24:09.447 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:09.573 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:09.733 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-routes (2.4.1-2) ... 2024-08-17T02:24:09.853 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:10.051 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-08-17T02:24:10.117 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:24:10.117 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:24:10.377 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:10.528 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:10.596 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:10.629 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:10.730 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:24:10.829 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:24:10.829 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:24:11.431 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:11.626 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:11.906 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:24:11.906 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:24:12.186 INFO:teuthology.orchestra.run.smithi102.stdout:Adding group ceph....done 2024-08-17T02:24:12.349 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:12.475 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:12.597 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user ceph....done 2024-08-17T02:24:12.643 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:12.773 INFO:teuthology.orchestra.run.smithi102.stdout:Setting system user ceph properties....done 2024-08-17T02:24:12.796 INFO:teuthology.orchestra.run.smithi102.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-17T02:24:12.871 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:24:12.871 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:24:12.942 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-17T02:24:13.263 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-17T02:24:13.303 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:13.445 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:13.571 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:13.711 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:13.748 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:13.875 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:24:13.939 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:24:13.940 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:24:14.068 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:24:14.344 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:24:14.545 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:14.671 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:14.943 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:24:14.943 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:24:15.573 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:15.952 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-17T02:24:16.392 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:16.656 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:24:16.656 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:24:17.094 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:17.272 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-08-17T02:24:17.325 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:24:17.326 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:24:17.770 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:17.860 INFO:teuthology.orchestra.run.smithi121.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:24:17.863 DEBUG:teuthology.orchestra.run.smithi121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-08-17T02:24:17.934 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-08-17T02:24:18.151 INFO:teuthology.orchestra.run.smithi121.stdout:Building dependency tree... 2024-08-17T02:24:18.152 INFO:teuthology.orchestra.run.smithi121.stdout:Reading state information... 2024-08-17T02:24:18.265 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:24:18.265 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:24:18.369 INFO:teuthology.orchestra.run.smithi121.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-08-17T02:24:18.369 INFO:teuthology.orchestra.run.smithi121.stdout:flex is already the newest version (2.6.4-6.2). 2024-08-17T02:24:18.369 INFO:teuthology.orchestra.run.smithi121.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-08-17T02:24:18.370 INFO:teuthology.orchestra.run.smithi121.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-08-17T02:24:18.370 INFO:teuthology.orchestra.run.smithi121.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-08-17T02:24:18.370 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:24:18.370 INFO:teuthology.orchestra.run.smithi121.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:24:18.370 INFO:teuthology.orchestra.run.smithi121.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:24:18.371 INFO:teuthology.orchestra.run.smithi121.stdout:The following additional packages will be installed: 2024-08-17T02:24:18.371 INFO:teuthology.orchestra.run.smithi121.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-08-17T02:24:18.371 INFO:teuthology.orchestra.run.smithi121.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2024-08-17T02:24:18.371 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2024-08-17T02:24:18.372 INFO:teuthology.orchestra.run.smithi121.stdout: usb-modeswitch-data wpasupplicant 2024-08-17T02:24:18.373 INFO:teuthology.orchestra.run.smithi121.stdout:Suggested packages: 2024-08-17T02:24:18.373 INFO:teuthology.orchestra.run.smithi121.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2024-08-17T02:24:18.373 INFO:teuthology.orchestra.run.smithi121.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-17T02:24:18.426 INFO:teuthology.orchestra.run.smithi121.stdout:The following NEW packages will be installed: 2024-08-17T02:24:18.426 INFO:teuthology.orchestra.run.smithi121.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-08-17T02:24:18.426 INFO:teuthology.orchestra.run.smithi121.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2024-08-17T02:24:18.427 INFO:teuthology.orchestra.run.smithi121.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-08-17T02:24:18.427 INFO:teuthology.orchestra.run.smithi121.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-17T02:24:18.428 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages will be upgraded: 2024-08-17T02:24:18.429 INFO:teuthology.orchestra.run.smithi121.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-08-17T02:24:18.485 INFO:teuthology.orchestra.run.smithi121.stdout:6 upgraded, 23 newly installed, 0 to remove and 289 not upgraded. 2024-08-17T02:24:18.485 INFO:teuthology.orchestra.run.smithi121.stdout:Need to get 10.4 MB of archives. 2024-08-17T02:24:18.485 INFO:teuthology.orchestra.run.smithi121.stdout:After this operation, 33.5 MB of additional disk space will be used. 2024-08-17T02:24:18.485 INFO:teuthology.orchestra.run.smithi121.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-08-17T02:24:18.617 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-08-17T02:24:18.618 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-08-17T02:24:18.619 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-08-17T02:24:18.623 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-08-17T02:24:18.624 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-08-17T02:24:18.641 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-08-17T02:24:18.642 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-08-17T02:24:18.643 INFO:teuthology.orchestra.run.smithi121.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-08-17T02:24:18.644 INFO:teuthology.orchestra.run.smithi121.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-08-17T02:24:18.645 INFO:teuthology.orchestra.run.smithi121.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-08-17T02:24:18.650 INFO:teuthology.orchestra.run.smithi121.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-08-17T02:24:18.651 INFO:teuthology.orchestra.run.smithi121.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-08-17T02:24:18.653 INFO:teuthology.orchestra.run.smithi121.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-08-17T02:24:18.653 INFO:teuthology.orchestra.run.smithi121.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-08-17T02:24:18.667 INFO:teuthology.orchestra.run.smithi121.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-08-17T02:24:18.668 INFO:teuthology.orchestra.run.smithi121.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-08-17T02:24:18.673 INFO:teuthology.orchestra.run.smithi121.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-08-17T02:24:18.681 INFO:teuthology.orchestra.run.smithi121.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-08-17T02:24:18.681 INFO:teuthology.orchestra.run.smithi121.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-08-17T02:24:18.688 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:18.695 INFO:teuthology.orchestra.run.smithi121.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-08-17T02:24:18.695 INFO:teuthology.orchestra.run.smithi121.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-08-17T02:24:18.703 INFO:teuthology.orchestra.run.smithi121.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-08-17T02:24:18.712 INFO:teuthology.orchestra.run.smithi121.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-08-17T02:24:18.727 INFO:teuthology.orchestra.run.smithi121.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-08-17T02:24:18.730 INFO:teuthology.orchestra.run.smithi121.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-08-17T02:24:18.730 INFO:teuthology.orchestra.run.smithi121.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-08-17T02:24:18.731 INFO:teuthology.orchestra.run.smithi121.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-08-17T02:24:18.731 INFO:teuthology.orchestra.run.smithi121.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-08-17T02:24:18.839 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:18.982 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:19.044 INFO:teuthology.orchestra.run.smithi121.stdout:Preconfiguring packages ... 2024-08-17T02:24:19.183 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 10.4 MB in 0s (35.4 MB/s) 2024-08-17T02:24:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:24:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:24:19.471 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:19.476 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:19.640 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:19.659 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:19.802 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:19.928 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:20.104 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:20.231 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:24:20.382 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:24:20.700 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:24:20.829 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-08-17T02:24:22.332 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:22.337 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:22.487 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:22.905 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:23.102 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:23.464 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:24:23.520 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-08-17T02:24:23.955 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:23.959 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:24:24.126 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:24:24.134 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:24:24.137 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-08-17T02:24:24.209 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-08-17T02:24:24.426 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-08-17T02:24:24.427 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-08-17T02:24:24.582 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:24:24.643 INFO:teuthology.orchestra.run.smithi102.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-08-17T02:24:24.643 INFO:teuthology.orchestra.run.smithi102.stdout:flex is already the newest version (2.6.4-6.2). 2024-08-17T02:24:24.643 INFO:teuthology.orchestra.run.smithi102.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-08-17T02:24:24.643 INFO:teuthology.orchestra.run.smithi102.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-08-17T02:24:24.643 INFO:teuthology.orchestra.run.smithi102.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-08-17T02:24:24.643 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:24:24.644 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:24:24.644 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:24:24.644 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2024-08-17T02:24:24.644 INFO:teuthology.orchestra.run.smithi102.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-08-17T02:24:24.644 INFO:teuthology.orchestra.run.smithi102.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2024-08-17T02:24:24.645 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2024-08-17T02:24:24.645 INFO:teuthology.orchestra.run.smithi102.stdout: usb-modeswitch-data wpasupplicant 2024-08-17T02:24:24.646 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2024-08-17T02:24:24.646 INFO:teuthology.orchestra.run.smithi102.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2024-08-17T02:24:24.646 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-17T02:24:24.697 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2024-08-17T02:24:24.697 INFO:teuthology.orchestra.run.smithi102.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-08-17T02:24:24.697 INFO:teuthology.orchestra.run.smithi102.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2024-08-17T02:24:24.698 INFO:teuthology.orchestra.run.smithi102.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-08-17T02:24:24.698 INFO:teuthology.orchestra.run.smithi102.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-17T02:24:24.699 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages will be upgraded: 2024-08-17T02:24:24.700 INFO:teuthology.orchestra.run.smithi102.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-08-17T02:24:24.748 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:24:24.754 INFO:teuthology.orchestra.run.smithi102.stdout:6 upgraded, 23 newly installed, 0 to remove and 289 not upgraded. 2024-08-17T02:24:24.754 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 10.4 MB of archives. 2024-08-17T02:24:24.754 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 33.5 MB of additional disk space will be used. 2024-08-17T02:24:24.754 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-08-17T02:24:24.884 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-08-17T02:24:24.884 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-08-17T02:24:24.886 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-08-17T02:24:24.891 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-08-17T02:24:24.892 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-08-17T02:24:24.908 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-08-17T02:24:24.908 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-08-17T02:24:24.909 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-08-17T02:24:24.911 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-08-17T02:24:24.911 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-08-17T02:24:24.917 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-08-17T02:24:24.917 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-08-17T02:24:24.919 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-08-17T02:24:24.919 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-08-17T02:24:24.934 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-08-17T02:24:24.934 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-08-17T02:24:24.940 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-08-17T02:24:24.947 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-08-17T02:24:24.948 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-08-17T02:24:24.962 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-08-17T02:24:24.962 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-08-17T02:24:24.970 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-08-17T02:24:24.980 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-08-17T02:24:24.996 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-08-17T02:24:24.998 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-08-17T02:24:24.999 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-08-17T02:24:24.999 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-08-17T02:24:24.999 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-08-17T02:24:25.279 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:24:25.315 INFO:teuthology.orchestra.run.smithi102.stdout:Preconfiguring packages ... 2024-08-17T02:24:25.411 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-08-17T02:24:25.454 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 10.4 MB in 0s (35.7 MB/s) 2024-08-17T02:24:25.721 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:25.725 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:25.880 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:25.923 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-17T02:24:25.941 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-08-17T02:24:25.981 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:24:26.368 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package dump. 2024-08-17T02:24:26.385 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-08-17T02:24:26.443 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking dump (0.4b46-6) ... 2024-08-17T02:24:26.950 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package indent. 2024-08-17T02:24:26.969 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:24:27.094 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-08-17T02:24:27.230 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:24:28.017 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-17T02:24:28.034 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-08-17T02:24:28.075 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:24:28.429 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-17T02:24:28.448 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-08-17T02:24:28.512 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:24:28.581 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:28.586 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:28.719 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:28.823 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-17T02:24:28.841 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:24:28.881 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:24:29.145 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:29.209 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-17T02:24:29.226 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:29.267 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:24:29.342 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:29.578 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-17T02:24:29.597 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:29.661 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:24:29.693 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:24:30.023 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-17T02:24:30.043 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:30.081 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:24:30.409 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-17T02:24:30.426 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-08-17T02:24:30.459 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:24:30.771 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:30.775 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:24:30.837 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-17T02:24:30.854 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:24:30.895 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:24:30.942 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:24:31.289 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-17T02:24:31.309 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:31.372 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:24:31.422 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:24:31.539 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:24:31.709 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-17T02:24:31.728 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:31.758 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:24:31.994 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-17T02:24:32.013 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:24:32.027 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:24:32.052 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:24:32.194 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-08-17T02:24:32.614 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-17T02:24:32.631 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2024-08-17T02:24:32.672 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:24:32.722 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-17T02:24:32.743 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-08-17T02:24:32.780 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:24:33.084 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package dump. 2024-08-17T02:24:33.101 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-08-17T02:24:33.133 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking dump (0.4b46-6) ... 2024-08-17T02:24:33.437 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package indent. 2024-08-17T02:24:33.455 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:24:33.495 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:24:33.696 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package modemmanager. 2024-08-17T02:24:33.713 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:33.781 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:24:33.840 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-17T02:24:33.858 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-08-17T02:24:33.898 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:24:34.210 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-17T02:24:34.229 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-08-17T02:24:34.260 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:24:34.410 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package wpasupplicant. 2024-08-17T02:24:34.430 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-08-17T02:24:34.468 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:24:34.513 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-17T02:24:34.532 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:24:34.596 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:24:34.974 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-17T02:24:34.990 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:35.032 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:24:35.065 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package network-manager. 2024-08-17T02:24:35.082 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:24:35.147 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:24:35.343 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-17T02:24:35.364 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:35.401 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:24:35.897 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ppp. 2024-08-17T02:24:35.915 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-08-17T02:24:36.167 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:24:36.237 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-17T02:24:36.257 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:36.489 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:24:36.536 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package pptp-linux. 2024-08-17T02:24:36.553 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-08-17T02:24:36.619 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-08-17T02:24:37.014 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-17T02:24:37.030 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-08-17T02:24:37.089 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-08-17T02:24:37.442 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-17T02:24:37.458 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2024-08-17T02:24:37.524 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-08-17T02:24:37.561 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-17T02:24:37.580 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-08-17T02:24:37.610 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:24:37.945 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-17T02:24:37.955 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-17T02:24:37.962 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-08-17T02:24:37.972 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:24:38.013 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:24:38.014 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:24:38.322 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:24:38.416 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-17T02:24:38.434 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:38.474 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:24:38.684 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:24:38.861 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-17T02:24:38.878 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:38.919 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:24:39.062 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:24:39.179 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-17T02:24:39.200 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:24:39.229 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:24:39.429 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:24:39.741 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-17T02:24:39.758 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2024-08-17T02:24:39.799 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:24:39.851 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:24:39.852 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:24:40.153 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package modemmanager. 2024-08-17T02:24:40.170 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:24:40.213 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:24:40.323 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:24:40.457 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:24:40.592 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:24:40.743 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-08-17T02:24:40.842 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package wpasupplicant. 2024-08-17T02:24:40.861 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-08-17T02:24:40.869 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:24:40.900 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:24:41.020 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:24:41.472 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package network-manager. 2024-08-17T02:24:41.490 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:24:41.571 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:24:42.007 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-08-17T02:24:42.251 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up dump (0.4b46-6) ... 2024-08-17T02:24:42.329 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ppp. 2024-08-17T02:24:42.346 INFO:teuthology.orchestra.run.smithi121.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-17T02:24:42.347 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-08-17T02:24:42.444 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:24:42.570 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:24:42.603 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:24:42.718 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:24:42.847 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:24:43.049 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:24:43.175 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:24:43.312 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package pptp-linux. 2024-08-17T02:24:43.326 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:24:43.328 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-08-17T02:24:43.361 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-08-17T02:24:43.452 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-08-17T02:24:43.662 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:24:43.773 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-17T02:24:43.788 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:24:43.790 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-08-17T02:24:43.849 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-08-17T02:24:44.112 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-17T02:24:44.132 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2024-08-17T02:24:44.170 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-08-17T02:24:44.548 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:24:44.548 INFO:teuthology.orchestra.run.smithi121.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-17T02:24:44.548 INFO:teuthology.orchestra.run.smithi121.stdout:which means they are currently configured by ifupdown: 2024-08-17T02:24:44.548 INFO:teuthology.orchestra.run.smithi121.stdout:- enp3s0f1 2024-08-17T02:24:44.548 INFO:teuthology.orchestra.run.smithi121.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-17T02:24:44.548 INFO:teuthology.orchestra.run.smithi121.stdout:remove their configuration from /etc/network/interfaces. 2024-08-17T02:24:44.548 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:24:44.573 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-17T02:24:44.590 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-08-17T02:24:44.642 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:24:44.714 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-17T02:24:44.961 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:24:45.042 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-17T02:24:45.270 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:24:45.397 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:24:45.547 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:24:45.562 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-17T02:24:45.896 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:24:45.896 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:24:46.091 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:24:46.259 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-08-17T02:24:46.334 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:24:46.402 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:24:46.476 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:24:46.553 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:24:46.602 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:24:46.679 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:24:46.729 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-08-17T02:24:46.821 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:24:46.888 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:24:47.014 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:24:47.087 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:24:47.087 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:24:47.591 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-08-17T02:24:47.733 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-17T02:24:47.859 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:24:47.952 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-08-17T02:24:48.027 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:24:48.170 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up dump (0.4b46-6) ... 2024-08-17T02:24:48.265 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-17T02:24:48.312 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:24:48.322 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:24:48.481 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:24:48.590 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:24:48.691 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:24:48.884 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:24:49.010 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:24:49.136 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:24:49.287 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-08-17T02:24:49.430 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:24:49.556 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:24:50.306 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:24:50.307 INFO:teuthology.orchestra.run.smithi102.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-17T02:24:50.307 INFO:teuthology.orchestra.run.smithi102.stdout:which means they are currently configured by ifupdown: 2024-08-17T02:24:50.307 INFO:teuthology.orchestra.run.smithi102.stdout:- enp3s0f1 2024-08-17T02:24:50.307 INFO:teuthology.orchestra.run.smithi102.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-17T02:24:50.307 INFO:teuthology.orchestra.run.smithi102.stdout:remove their configuration from /etc/network/interfaces. 2024-08-17T02:24:50.307 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:24:50.465 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-17T02:24:50.794 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-17T02:24:51.308 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-17T02:24:51.834 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:24:51.978 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-08-17T02:24:52.137 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:24:52.239 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-08-17T02:24:52.255 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:24:52.364 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-08-17T02:24:52.381 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:24:52.532 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:24:52.807 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:24:52.807 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:24:53.239 INFO:teuthology.orchestra.run.smithi121.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:24:53.245 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:53.352 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-08-17T02:24:53.461 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-17T02:24:53.587 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:24:53.764 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:24:57.909 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-08-17T02:24:58.018 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-08-17T02:24:59.274 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:24:59.278 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:59.279 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:24:59.424 DEBUG:teuthology.orchestra.run.smithi102:> dpkg-query -W -f '${Version}' ceph 2024-08-17T02:24:59.448 INFO:teuthology.orchestra.run.smithi102.stdout:17.2.7-1375-g2577e813-1focal 2024-08-17T02:24:59.448 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:24:59.449 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375-g2577e813-1focal is installed. 2024-08-17T02:24:59.451 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:24:59.595 DEBUG:teuthology.orchestra.run.smithi121:> dpkg-query -W -f '${Version}' ceph 2024-08-17T02:24:59.619 INFO:teuthology.orchestra.run.smithi121.stdout:17.2.7-1375-g2577e813-1focal 2024-08-17T02:24:59.619 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:24:59.619 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375-g2577e813-1focal is installed. 2024-08-17T02:24:59.621 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:24:59.621 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:24:59.622 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:24:59.638 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:24:59.638 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:24:59.655 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:24:59.655 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:24:59.655 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:24:59.696 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:24:59.707 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:24:59.707 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:24:59.723 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:24:59.737 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:24:59.738 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:24:59.739 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:24:59.755 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:24:59.811 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:24:59.811 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:24:59.827 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:24:59.842 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:24:59.843 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:24:59.843 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:24:59.858 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:24:59.917 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:24:59.917 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:24:59.933 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:24:59.942 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:25:00.019 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:25:00.019 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2024-08-17T02:25:00.022 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /var/log/ceph 2024-08-17T02:25:00.036 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:25:00.037 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:25:00.038 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:25:00.090 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:25:00.090 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:25:00.092 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:25:00.112 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:25:00.112 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:25:00.112 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:25:00.112 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:00.112 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:25:00.117 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:00.196 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:00.196 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:25:00.203 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:00.287 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:25:00.287 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:25:00.287 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858253', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858253', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi121.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:02:08', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:25:00.288 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:25:00.290 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:25:00.296 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:25:00.298 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:25:00.312 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:00.312 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:25:00.319 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:25:00.319 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-08-17T02:25:00.368 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:25:00.368 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:00.368 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 6h/6d Inode: 371 Links: 1 2024-08-17T02:25:00.368 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:00.369 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-08-17 02:20:29.532915499 +0000 2024-08-17T02:25:00.369 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-08-17 02:20:29.316920481 +0000 2024-08-17T02:25:00.369 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-08-17 02:20:29.316920481 +0000 2024-08-17T02:25:00.369 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-08-17T02:25:00.369 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:25:00.379 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-08-17T02:25:00.380 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-08-17T02:25:00.380 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000431311 s, 1.2 MB/s 2024-08-17T02:25:00.380 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:25:00.387 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-08-17T02:25:00.436 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:25:00.436 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:00.436 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 6h/6d Inode: 377 Links: 1 2024-08-17T02:25:00.437 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:00.437 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-08-17 02:20:29.976905261 +0000 2024-08-17T02:25:00.437 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-08-17 02:20:29.772909965 +0000 2024-08-17T02:25:00.437 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-08-17 02:20:29.772909965 +0000 2024-08-17T02:25:00.437 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-08-17T02:25:00.437 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:25:00.449 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-08-17T02:25:00.449 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-08-17T02:25:00.450 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000422051 s, 1.2 MB/s 2024-08-17T02:25:00.450 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:25:00.459 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-08-17T02:25:00.466 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:25:00.466 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:00.467 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 6h/6d Inode: 385 Links: 1 2024-08-17T02:25:00.467 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:00.467 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-08-17 02:20:30.424894929 +0000 2024-08-17T02:25:00.467 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-08-17 02:20:30.224899542 +0000 2024-08-17T02:25:00.467 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-08-17 02:20:30.224899542 +0000 2024-08-17T02:25:00.467 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-08-17T02:25:00.467 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:25:00.522 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-08-17T02:25:00.522 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-08-17T02:25:00.522 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000390628 s, 1.3 MB/s 2024-08-17T02:25:00.523 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:25:00.532 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-08-17T02:25:00.538 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:25:00.538 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:00.538 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 6h/6d Inode: 391 Links: 1 2024-08-17T02:25:00.538 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:00.538 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-08-17 02:20:30.852885059 +0000 2024-08-17T02:25:00.539 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-08-17 02:20:30.648889763 +0000 2024-08-17T02:25:00.539 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-08-17 02:20:30.648889763 +0000 2024-08-17T02:25:00.539 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-08-17T02:25:00.539 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:25:00.596 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-08-17T02:25:00.596 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-08-17T02:25:00.596 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000372839 s, 1.4 MB/s 2024-08-17T02:25:00.598 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:25:00.606 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:00.606 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:00.606 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:25:00.613 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:25:00.613 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2024-08-17T02:25:00.621 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:25:00.621 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:00.621 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 6h/6d Inode: 361 Links: 1 2024-08-17T02:25:00.621 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:00.622 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-08-17 02:20:31.069824911 +0000 2024-08-17T02:25:00.622 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-17 02:20:30.841830160 +0000 2024-08-17T02:25:00.622 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-17 02:20:30.841830160 +0000 2024-08-17T02:25:00.622 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2024-08-17T02:25:00.622 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:25:00.635 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-08-17T02:25:00.635 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-08-17T02:25:00.635 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000355277 s, 1.4 MB/s 2024-08-17T02:25:00.636 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:25:00.686 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2024-08-17T02:25:00.692 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:25:00.692 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:00.692 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-08-17T02:25:00.692 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:00.692 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-08-17 02:20:31.521814508 +0000 2024-08-17T02:25:00.692 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-17 02:20:31.301819572 +0000 2024-08-17T02:25:00.692 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-17 02:20:31.301819572 +0000 2024-08-17T02:25:00.693 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2024-08-17T02:25:00.693 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:25:00.704 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-08-17T02:25:00.704 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-08-17T02:25:00.704 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000419915 s, 1.2 MB/s 2024-08-17T02:25:00.705 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:25:00.758 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2024-08-17T02:25:00.764 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:25:00.764 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:00.764 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 6h/6d Inode: 374 Links: 1 2024-08-17T02:25:00.764 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:00.764 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-08-17 02:20:31.945804747 +0000 2024-08-17T02:25:00.764 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-17 02:20:31.745809351 +0000 2024-08-17T02:25:00.765 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-17 02:20:31.745809351 +0000 2024-08-17T02:25:00.765 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2024-08-17T02:25:00.765 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:25:00.776 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-08-17T02:25:00.776 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-08-17T02:25:00.776 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000394762 s, 1.3 MB/s 2024-08-17T02:25:00.777 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:25:00.829 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2024-08-17T02:25:00.836 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:25:00.836 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:00.836 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 6h/6d Inode: 379 Links: 1 2024-08-17T02:25:00.836 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:00.836 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-08-17 02:20:32.405794160 +0000 2024-08-17T02:25:00.836 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-17 02:20:32.169799592 +0000 2024-08-17T02:25:00.836 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-17 02:20:32.169799592 +0000 2024-08-17T02:25:00.836 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2024-08-17T02:25:00.836 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:25:00.849 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-08-17T02:25:00.849 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-08-17T02:25:00.849 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000367739 s, 1.4 MB/s 2024-08-17T02:25:00.850 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:25:00.902 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:00.902 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:25:00.902 INFO:tasks.ceph:Generating config... 2024-08-17T02:25:00.903 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:25:00.903 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:25:00.903 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:25:00.904 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:25:00.904 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:25:00.904 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:25:00.904 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:25:00.904 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:25:00.904 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:25:00.904 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:25:00.904 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:25:00.904 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:25:00.904 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:25:00.904 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:25:00.904 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:25:00.904 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:25:00.904 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:25:00.904 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:25:00.905 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:25:00.905 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:25:00.905 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:25:00.905 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:25:00.905 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:25:00.905 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:25:00.905 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:25:00.905 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:25:00.905 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:25:00.905 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:25:00.905 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:25:00.905 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:25:00.905 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:25:00.905 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:25:00.905 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:25:00.905 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:25:00.905 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:25:00.906 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:25:00.906 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:25:00.906 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:25:00.906 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:25:00.906 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:25:00.906 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:25:00.906 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:25:00.942 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:25:00.944 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:25:01.021 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:25:01.036 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.102'), ('mon.b', '172.21.15.121'), ('mon.c', '[v2:172.21.15.121:3301,v1:172.21.15.121:6790]')] 2024-08-17T02:25:01.037 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.102,172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:25:01.037 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:01.038 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:25:01.043 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.102 --add b 172.21.15.121 --addv c '[v2:172.21.15.121:3301,v1:172.21.15.121:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:01.125 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:01.125 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: generated fsid 0c0c2578-b641-472b-9b35-bef011c543fd 2024-08-17T02:25:01.125 INFO:teuthology.orchestra.run.smithi102.stdout:setting min_mon_release = octopus 2024-08-17T02:25:01.125 INFO:teuthology.orchestra.run.smithi102.stdout:epoch 0 2024-08-17T02:25:01.125 INFO:teuthology.orchestra.run.smithi102.stdout:fsid 0c0c2578-b641-472b-9b35-bef011c543fd 2024-08-17T02:25:01.125 INFO:teuthology.orchestra.run.smithi102.stdout:last_changed 2024-08-17T02:25:01.124827+0000 2024-08-17T02:25:01.125 INFO:teuthology.orchestra.run.smithi102.stdout:created 2024-08-17T02:25:01.124827+0000 2024-08-17T02:25:01.125 INFO:teuthology.orchestra.run.smithi102.stdout:min_mon_release 15 (octopus) 2024-08-17T02:25:01.125 INFO:teuthology.orchestra.run.smithi102.stdout:election_strategy: 1 2024-08-17T02:25:01.125 INFO:teuthology.orchestra.run.smithi102.stdout:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-08-17T02:25:01.125 INFO:teuthology.orchestra.run.smithi102.stdout:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-08-17T02:25:01.125 INFO:teuthology.orchestra.run.smithi102.stdout:2: [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] mon.c 2024-08-17T02:25:01.126 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:25:01.127 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:25:01.133 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0c0c2578-b641-472b-9b35-bef011c543fd... 2024-08-17T02:25:01.134 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:25:01.136 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:25:01.164 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-08-17T02:25:01.164 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.102,172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790]" 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = 0c0c2578-b641-472b-9b35-bef011c543fd 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2024-08-17T02:25:01.169 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2024-08-17T02:25:01.169 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.169 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2024-08-17T02:25:01.169 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2024-08-17T02:25:01.169 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2024-08-17T02:25:01.169 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.169 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2024-08-17T02:25:01.169 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2024-08-17T02:25:01.169 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.169 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:25:01.169 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.169 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2024-08-17T02:25:01.169 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.169 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2024-08-17T02:25:01.170 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.170 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:25:01.170 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2024-08-17T02:25:01.170 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.170 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2024-08-17T02:25:01.170 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2024-08-17T02:25:01.170 INFO:teuthology.orchestra.run.smithi102.stdout: bdev async discard = True 2024-08-17T02:25:01.170 INFO:teuthology.orchestra.run.smithi102.stdout: bdev enable discard = True 2024-08-17T02:25:01.170 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore allocator = bitmap 2024-08-17T02:25:01.170 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2024-08-17T02:25:01.170 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2024-08-17T02:25:01.170 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 1/20 2024-08-17T02:25:01.170 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 1/20 2024-08-17T02:25:01.171 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-08-17T02:25:01.171 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2024-08-17T02:25:01.171 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 4/10 2024-08-17T02:25:01.171 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:25:01.171 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2024-08-17T02:25:01.171 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:25:01.171 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:25:01.171 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2024-08-17T02:25:01.171 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-08-17T02:25:01.171 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.171 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2024-08-17T02:25:01.171 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-08-17T02:25:01.171 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2024-08-17T02:25:01.171 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi102.stdout: debug finisher = 20 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = "" 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds balancer = 20 2024-08-17T02:25:01.176 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-08-17T02:25:01.176 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2024-08-17T02:25:01.176 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2024-08-17T02:25:01.176 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2024-08-17T02:25:01.176 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2024-08-17T02:25:01.176 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-08-17T02:25:01.176 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-08-17T02:25:01.176 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-08-17T02:25:01.177 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2024-08-17T02:25:01.177 INFO:teuthology.orchestra.run.smithi121.stdout: chdir = "" 2024-08-17T02:25:01.177 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:25:01.177 INFO:teuthology.orchestra.run.smithi121.stdout: auth supported = cephx 2024-08-17T02:25:01.177 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.177 INFO:teuthology.orchestra.run.smithi121.stdout: filestore xattr use omap = true 2024-08-17T02:25:01.177 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.177 INFO:teuthology.orchestra.run.smithi121.stdout: mon clock drift allowed = 1.000 2024-08-17T02:25:01.177 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.177 INFO:teuthology.orchestra.run.smithi121.stdout: osd crush chooseleaf type = 0 2024-08-17T02:25:01.177 INFO:teuthology.orchestra.run.smithi121.stdout: auth debug = true 2024-08-17T02:25:01.177 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.178 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on old message = true 2024-08-17T02:25:01.178 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on bug = true 2024-08-17T02:25:01.178 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.178 INFO:teuthology.orchestra.run.smithi121.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:25:01.178 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn max object skew = 0 2024-08-17T02:25:01.178 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.178 INFO:teuthology.orchestra.run.smithi121.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:25:01.178 INFO:teuthology.orchestra.run.smithi121.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:25:01.178 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.178 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default size = 2 2024-08-17T02:25:01.178 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.178 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow primary affinity = true 2024-08-17T02:25:01.178 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow pg remap = true 2024-08-17T02:25:01.178 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:25:01.179 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:25:01.179 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on no sortbitwise = false 2024-08-17T02:25:01.179 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:25:01.179 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on too few osds = false 2024-08-17T02:25:01.179 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:25:01.179 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:25:01.179 INFO:teuthology.orchestra.run.smithi121.stdout: mon_allow_pool_size_one = true 2024-08-17T02:25:01.179 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.179 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:25:01.179 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.179 INFO:teuthology.orchestra.run.smithi121.stdout: osd default data pool replay window = 5 2024-08-17T02:25:01.179 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.179 INFO:teuthology.orchestra.run.smithi121.stdout: mon allow pool delete = true 2024-08-17T02:25:01.179 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.179 INFO:teuthology.orchestra.run.smithi121.stdout: mon cluster log file level = debug 2024-08-17T02:25:01.180 INFO:teuthology.orchestra.run.smithi121.stdout: debug asserts on shutdown = true 2024-08-17T02:25:01.180 INFO:teuthology.orchestra.run.smithi121.stdout: mon health detail to clog = false 2024-08-17T02:25:01.180 INFO:teuthology.orchestra.run.smithi121.stdout: mon host = "172.21.15.102,172.21.15.121,[v2:172.21.15.121:3301,v1:172.21.15.121:6790]" 2024-08-17T02:25:01.180 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = 0c0c2578-b641-472b-9b35-bef011c543fd 2024-08-17T02:25:01.180 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.180 INFO:teuthology.orchestra.run.smithi121.stdout:[osd] 2024-08-17T02:25:01.180 INFO:teuthology.orchestra.run.smithi121.stdout: osd journal size = 100 2024-08-17T02:25:01.180 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.180 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub load threshold = 5.0 2024-08-17T02:25:01.180 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub max interval = 600 2024-08-17T02:25:01.180 INFO:teuthology.orchestra.run.smithi121.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:25:01.180 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.180 INFO:teuthology.orchestra.run.smithi121.stdout: osd recover clone overlap = true 2024-08-17T02:25:01.180 INFO:teuthology.orchestra.run.smithi121.stdout: osd recovery max chunk = 1048576 2024-08-17T02:25:01.181 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.181 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug shutdown = true 2024-08-17T02:25:01.181 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug op order = true 2024-08-17T02:25:01.181 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug verify stray on activate = true 2024-08-17T02:25:01.181 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.181 INFO:teuthology.orchestra.run.smithi121.stdout: osd open classes on start = true 2024-08-17T02:25:01.181 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug pg log writeout = true 2024-08-17T02:25:01.181 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.181 INFO:teuthology.orchestra.run.smithi121.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:25:01.181 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.181 INFO:teuthology.orchestra.run.smithi121.stdout: osd map max advance = 10 2024-08-17T02:25:01.181 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.181 INFO:teuthology.orchestra.run.smithi121.stdout: journal zero on create = true 2024-08-17T02:25:01.181 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.181 INFO:teuthology.orchestra.run.smithi121.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:25:01.182 INFO:teuthology.orchestra.run.smithi121.stdout: filestore apply finisher threads = 3 2024-08-17T02:25:01.182 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.182 INFO:teuthology.orchestra.run.smithi121.stdout: bdev debug aio = true 2024-08-17T02:25:01.182 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug misdirected ops = true 2024-08-17T02:25:01.182 INFO:teuthology.orchestra.run.smithi121.stdout: bdev async discard = True 2024-08-17T02:25:01.182 INFO:teuthology.orchestra.run.smithi121.stdout: bdev enable discard = True 2024-08-17T02:25:01.182 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore allocator = bitmap 2024-08-17T02:25:01.182 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore block size = 96636764160 2024-08-17T02:25:01.182 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore fsck on mount = True 2024-08-17T02:25:01.182 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluefs = 1/20 2024-08-17T02:25:01.182 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluestore = 1/20 2024-08-17T02:25:01.182 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-08-17T02:25:01.183 INFO:teuthology.orchestra.run.smithi121.stdout: debug osd = 20 2024-08-17T02:25:01.183 INFO:teuthology.orchestra.run.smithi121.stdout: debug rocksdb = 4/10 2024-08-17T02:25:01.183 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:25:01.183 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd full ratio = 0.9 2024-08-17T02:25:01.183 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:25:01.183 INFO:teuthology.orchestra.run.smithi121.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:25:01.183 INFO:teuthology.orchestra.run.smithi121.stdout: osd objectstore = bluestore 2024-08-17T02:25:01.183 INFO:teuthology.orchestra.run.smithi121.stdout: osd op complaint time = 180 2024-08-17T02:25:01.183 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.183 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr] 2024-08-17T02:25:01.183 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-08-17T02:25:01.183 INFO:teuthology.orchestra.run.smithi121.stdout: debug mgr = 20 2024-08-17T02:25:01.183 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-08-17T02:25:01.183 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-08-17T02:25:01.184 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:01.184 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:01.184 INFO:teuthology.orchestra.run.smithi121.stdout: mgr/telemetry/nag = false 2024-08-17T02:25:01.184 INFO:teuthology.orchestra.run.smithi121.stdout: debug client = 20 2024-08-17T02:25:01.184 INFO:teuthology.orchestra.run.smithi121.stdout: debug finisher = 20 2024-08-17T02:25:01.184 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.184 INFO:teuthology.orchestra.run.smithi121.stdout:[mon] 2024-08-17T02:25:01.184 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-08-17T02:25:01.184 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-08-17T02:25:01.184 INFO:teuthology.orchestra.run.smithi121.stdout: debug paxos = 20 2024-08-17T02:25:01.184 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-08-17T02:25:01.184 INFO:teuthology.orchestra.run.smithi121.stdout: mon data avail warn = 5 2024-08-17T02:25:01.184 INFO:teuthology.orchestra.run.smithi121.stdout: mon mgr mkfs grace = 240 2024-08-17T02:25:01.185 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:01.185 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd reporter subtree level = osd 2024-08-17T02:25:01.185 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd prime pg temp = true 2024-08-17T02:25:01.185 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:01.185 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.185 INFO:teuthology.orchestra.run.smithi121.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:25:01.185 INFO:teuthology.orchestra.run.smithi121.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:25:01.185 INFO:teuthology.orchestra.run.smithi121.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:25:01.185 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.185 INFO:teuthology.orchestra.run.smithi121.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:25:01.185 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:25:01.185 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:25:01.185 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.185 INFO:teuthology.orchestra.run.smithi121.stdout: # 1m isn't quite enough 2024-08-17T02:25:01.185 INFO:teuthology.orchestra.run.smithi121.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:25:01.186 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.186 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:25:01.186 INFO:teuthology.orchestra.run.smithi121.stdout: mon op complaint time = 120 2024-08-17T02:25:01.186 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-17T02:25:01.186 INFO:teuthology.orchestra.run.smithi121.stdout:[client] 2024-08-17T02:25:01.186 INFO:teuthology.orchestra.run.smithi121.stdout: rgw cache enabled = true 2024-08-17T02:25:01.186 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable ops log = true 2024-08-17T02:25:01.186 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable usage log = true 2024-08-17T02:25:01.186 INFO:teuthology.orchestra.run.smithi121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:25:01.186 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:25:01.186 INFO:teuthology.orchestra.run.smithi121.stdout: client mount timeout = 600 2024-08-17T02:25:01.186 INFO:teuthology.orchestra.run.smithi121.stdout: debug client = 20 2024-08-17T02:25:01.186 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-08-17T02:25:01.186 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = "" 2024-08-17T02:25:01.187 INFO:teuthology.orchestra.run.smithi121.stdout: rados mon op timeout = 900 2024-08-17T02:25:01.187 INFO:teuthology.orchestra.run.smithi121.stdout: rados osd op timeout = 900 2024-08-17T02:25:01.187 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.a] 2024-08-17T02:25:01.187 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.b] 2024-08-17T02:25:01.187 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.c] 2024-08-17T02:25:01.187 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2024-08-17T02:25:01.187 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.c] 2024-08-17T02:25:01.187 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2024-08-17T02:25:01.187 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.d] 2024-08-17T02:25:01.187 INFO:teuthology.orchestra.run.smithi121.stdout:[mds] 2024-08-17T02:25:01.187 INFO:teuthology.orchestra.run.smithi121.stdout: debug mds = 20 2024-08-17T02:25:01.187 INFO:teuthology.orchestra.run.smithi121.stdout: debug mds balancer = 20 2024-08-17T02:25:01.187 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-08-17T02:25:01.187 INFO:teuthology.orchestra.run.smithi121.stdout: mds debug frag = True 2024-08-17T02:25:01.188 INFO:teuthology.orchestra.run.smithi121.stdout: mds debug scatterstat = True 2024-08-17T02:25:01.188 INFO:teuthology.orchestra.run.smithi121.stdout: mds op complaint time = 180 2024-08-17T02:25:01.188 INFO:teuthology.orchestra.run.smithi121.stdout: mds verify scatter = True 2024-08-17T02:25:01.188 INFO:teuthology.orchestra.run.smithi121.stdout: osd op complaint time = 180 2024-08-17T02:25:01.188 INFO:teuthology.orchestra.run.smithi121.stdout: rados mon op timeout = 900 2024-08-17T02:25:01.188 INFO:teuthology.orchestra.run.smithi121.stdout: rados osd op timeout = 900 2024-08-17T02:25:01.189 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:25:01.189 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:25:01.280 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:25:01.280 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:01.280 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:25:01.287 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:01.287 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:25:01.294 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2024-08-17T02:25:01.294 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:01.294 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:25:01.295 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:25:01.316 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:01.316 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:01.322 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi121.front.sepia.ceph.com 2024-08-17T02:25:01.323 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:01.323 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:25:01.323 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:25:01.349 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:01.350 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:01.354 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:25:01.354 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:25:01.354 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:25:01.409 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:25:01.412 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:25:01.458 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:25:01.460 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:25:01.461 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:25:01.504 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:25:01.506 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:25:01.516 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:25:01.557 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:25:01.560 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:25:01.615 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:25:01.663 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:25:01.665 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:25:01.675 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:25:01.766 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:25:01.768 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:25:01.782 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:25:01.782 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:25:01.819 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:25:01.832 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:25:01.866 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:25:01.879 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:25:01.916 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:25:01.929 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:25:02.004 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:25:02.017 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:25:02.017 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:25:02.018 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:02.035 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:02.035 INFO:tasks.ceph:role: osd.0 2024-08-17T02:25:02.035 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com 2024-08-17T02:25:02.035 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:25:02.562 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:02.562 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:02.562 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:02.562 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 2024-08-17T02:25:02.562 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:02.563 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:02.563 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:02.563 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:02.563 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:02.563 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:02.564 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-08-17T02:25:02.564 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:02.651 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:02.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:02.663 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:02.720 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:02.720 INFO:tasks.ceph:role: osd.1 2024-08-17T02:25:02.720 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com 2024-08-17T02:25:02.721 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:25:03.251 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:03.251 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:03.251 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:03.251 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 2024-08-17T02:25:03.251 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:03.252 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:03.252 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:03.252 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:03.252 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:03.252 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:03.253 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-08-17T02:25:03.253 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:03.288 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:03.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:03.340 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:03.341 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:03.355 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:03.355 INFO:tasks.ceph:role: osd.2 2024-08-17T02:25:03.355 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com 2024-08-17T02:25:03.355 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:25:03.827 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:03.827 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:03.827 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:03.827 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 2024-08-17T02:25:03.827 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:03.827 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:03.827 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:03.827 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:03.827 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:03.828 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:03.829 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-08-17T02:25:03.829 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:03.879 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:03.891 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:03.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:03.892 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:03.903 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:03.903 INFO:tasks.ceph:role: osd.3 2024-08-17T02:25:03.904 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com 2024-08-17T02:25:03.904 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:25:04.404 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:04.404 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:04.404 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:04.404 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 2024-08-17T02:25:04.404 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:04.404 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:04.404 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:04.404 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:04.405 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:04.405 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:04.406 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-08-17T02:25:04.407 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:04.461 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:04.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:04.472 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:04.473 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:04.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:04.538+0000 7fe22344f3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:25:04.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:04.542+0000 7fe22344f3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:25:04.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:04.542+0000 7fe22344f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:25:04.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:04.542+0000 7fe22344f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:25:04.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:04.542+0000 7fe22344f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:25:04.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:04.546+0000 7fe22344f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:25:05.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:05.110+0000 7fe22344f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:05.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:05.886+0000 7fe22344f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:06.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:06.666+0000 7fe22344f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:07.514 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:07.530 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:07.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:07.558+0000 7f2a573d23c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:25:07.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:07.562+0000 7f2a573d23c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:25:07.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:07.562+0000 7f2a573d23c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:25:07.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:07.562+0000 7f2a573d23c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:25:07.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:07.562+0000 7f2a573d23c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:25:07.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:07.562+0000 7f2a573d23c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:25:08.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:08.122+0000 7f2a573d23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:08.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:08.902+0000 7f2a573d23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:09.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:09.694+0000 7f2a573d23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:10.562 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:10.579 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:10.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:10.658+0000 7f36a221b3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:25:10.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:10.658+0000 7f36a221b3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:25:10.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:10.658+0000 7f36a221b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:25:10.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:10.658+0000 7f36a221b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:25:10.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:10.658+0000 7f36a221b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:25:10.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:10.662+0000 7f36a221b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:25:11.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:11.222+0000 7f36a221b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:12.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:12.002+0000 7f36a221b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:12.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:12.790+0000 7f36a221b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:13.649 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:13.666 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:13.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:13.702+0000 7f4b35d5a3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:25:13.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:13.702+0000 7f4b35d5a3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:25:13.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:13.702+0000 7f4b35d5a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:25:13.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:13.702+0000 7f4b35d5a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:25:13.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:13.702+0000 7f4b35d5a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:25:13.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:13.702+0000 7f4b35d5a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:25:14.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:14.258+0000 7f4b35d5a3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:15.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:15.038+0000 7f4b35d5a3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:15.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:15.826+0000 7f4b35d5a3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:16.677 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:16.694 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:16.711 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:16.711 INFO:tasks.ceph:role: osd.4 2024-08-17T02:25:16.711 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com 2024-08-17T02:25:16.711 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:25:17.230 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:17.231 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:17.231 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:17.231 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 2024-08-17T02:25:17.231 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:17.231 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:17.231 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:17.231 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:17.231 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:17.231 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:17.233 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-08-17T02:25:17.233 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:17.308 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:17.320 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:17.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:17.321 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:17.332 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:17.332 INFO:tasks.ceph:role: osd.5 2024-08-17T02:25:17.332 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com 2024-08-17T02:25:17.332 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:25:17.865 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 2024-08-17T02:25:17.865 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:17.865 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:17.865 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:17.865 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:17.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-08-17T02:25:17.867 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:17.920 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:17.931 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:17.932 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:17.932 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:17.943 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:17.943 INFO:tasks.ceph:role: osd.6 2024-08-17T02:25:17.943 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com 2024-08-17T02:25:17.943 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:25:18.402 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:18.404 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-08-17T02:25:18.404 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:18.452 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:18.464 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:18.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:18.465 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:18.476 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:18.476 INFO:tasks.ceph:role: osd.7 2024-08-17T02:25:18.476 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi121.front.sepia.ceph.com 2024-08-17T02:25:18.476 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:25:18.971 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:18.971 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:18.971 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:18.971 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 2024-08-17T02:25:18.971 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:18.971 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:18.971 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:18.971 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:18.972 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:18.972 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:18.973 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-08-17T02:25:18.973 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:19.038 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:19.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:19.049 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:19.049 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:19.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:19.156+0000 7faef3b953c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:25:19.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:19.156+0000 7faef3b953c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:25:19.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:19.156+0000 7faef3b953c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:25:19.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:19.156+0000 7faef3b953c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:25:19.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:19.156+0000 7faef3b953c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:25:19.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:19.164+0000 7faef3b953c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:25:19.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:19.740+0000 7faef3b953c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:20.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:20.516+0000 7faef3b953c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:21.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:21.304+0000 7faef3b953c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:22.166 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:22.180 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:22.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:22.212+0000 7fbf9b39c3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:25:22.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:22.216+0000 7fbf9b39c3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:25:22.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:22.216+0000 7fbf9b39c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:25:22.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:22.216+0000 7fbf9b39c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:25:22.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:22.216+0000 7fbf9b39c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:25:22.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:22.216+0000 7fbf9b39c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:25:22.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:22.776+0000 7fbf9b39c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:23.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:23.564+0000 7fbf9b39c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:24.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:24.344+0000 7fbf9b39c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:25.198 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:25.258 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:25.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:25.292+0000 7f451a3993c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:25:25.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:25.292+0000 7f451a3993c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:25:25.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:25.292+0000 7f451a3993c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:25:25.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:25.292+0000 7f451a3993c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:25:25.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:25.292+0000 7f451a3993c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:25:25.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:25.292+0000 7f451a3993c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:25:25.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:25.848+0000 7f451a3993c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:26.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:26.632+0000 7f451a3993c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:27.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:27.420+0000 7f451a3993c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:28.281 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:28.298 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:28.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:28.380+0000 7f19d622d3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:25:28.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:28.380+0000 7f19d622d3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:25:28.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:28.380+0000 7f19d622d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:25:28.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:28.380+0000 7f19d622d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:25:28.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:28.380+0000 7f19d622d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:25:28.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:28.384+0000 7f19d622d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:25:28.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:28.952+0000 7f19d622d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:29.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:29.740+0000 7f19d622d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:30.289 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:30.292 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:30.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:30.528+0000 7f19d622d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:31.393 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:31.409 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:25:31.410 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:31.410 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:25:31.426 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:31.426 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:25:31.435 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:31.436 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:25:31.493 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:31.493 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:25:31.509 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:31.509 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:25:31.519 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:31.519 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:25:31.576 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:31.576 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:25:31.596 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:31.596 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:25:31.612 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:31.612 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:25:31.624 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:31.624 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:25:31.681 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:31.681 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:25:31.693 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:31.693 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:25:31.704 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:31.704 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:25:31.761 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:31.761 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:25:31.772 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:31.772 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:25:31.779 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:31.779 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:25:31.829 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:31.830 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:25:31.837 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:31.837 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:25:31.884 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:25:31.884 DEBUG:teuthology.orchestra.run.smithi102:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:25:31.886 DEBUG:teuthology.orchestra.run.smithi121:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:25:31.898 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.y] 2024-08-17T02:25:31.898 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQD9CcBmGuNoGBAA4A8/06fGZH2ePaLLCVR27Q== 2024-08-17T02:25:31.898 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2024-08-17T02:25:31.898 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQD9CcBmNcIIHhAADPhHoaez14XKXphkNY2sfw== 2024-08-17T02:25:31.898 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.c] 2024-08-17T02:25:31.898 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQD9CcBmHFY5IRAAUeW5dVn2ce6u3LAJrQ4eHg== 2024-08-17T02:25:31.898 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.0] 2024-08-17T02:25:31.898 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAACsBmIFl+IBAAkGaOEDibN0aW5ihngWiCIQ== 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.1] 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQADCsBma1S7IRAAd0sfUVkbF6HNSfAbabWr8Q== 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.2] 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAGCsBmk4+iJxAAobLfanO2dDh2qfeLfedPig== 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.3] 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAJCsBmYhwmKhAAtd8Z2UwH19a7oEhSvP50wg== 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.x] 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQD9CcBm0A1FGxAAP/gtKgo0amWr/y8m2U8rsQ== 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQD9CcBmUrl5JxAAPEo2eEKc1Me8sZTbGmQrhA== 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.d] 2024-08-17T02:25:31.900 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQD9CcBmccyeLRAAc2o9yMJaCO8ueNCFsi9RuA== 2024-08-17T02:25:31.900 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.4] 2024-08-17T02:25:31.900 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAPCsBm2HCOCRAAb/b0YsNZDQGW3ams4o5OjQ== 2024-08-17T02:25:31.900 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.5] 2024-08-17T02:25:31.900 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQASCsBmqYvvDBAAjd21KwVBVNdmf61bB1kD1w== 2024-08-17T02:25:31.900 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.6] 2024-08-17T02:25:31.900 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAVCsBmsN2dERAARy8qXUd1PYCrOCaDxX41Ew== 2024-08-17T02:25:31.900 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.7] 2024-08-17T02:25:31.900 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAYCsBmV5LjFhAAHW2H7qHbd4sf0J/x50o7aA== 2024-08-17T02:25:31.900 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-08-17T02:25:31.900 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQD9CcBmO9XVMBAAIaDYcGwkyxygfAvY+VkwVA== 2024-08-17T02:25:31.901 INFO:teuthology.orchestra.run.smithi121.stdout:[client.2] 2024-08-17T02:25:31.901 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQD9CcBm7HelMxAABEkjlhK3Stjj/JIt848sxg== 2024-08-17T02:25:31.901 INFO:teuthology.orchestra.run.smithi121.stdout:[client.1] 2024-08-17T02:25:31.901 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQD9CcBmCn+NNhAA5UjRBu/QUG9eKJgoc1m3rQ== 2024-08-17T02:25:31.901 INFO:teuthology.orchestra.run.smithi121.stdout:[client.3] 2024-08-17T02:25:31.901 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQD+CcBmbIkxABAAzi8G0Z2RP5SNPyID2CwRYQ== 2024-08-17T02:25:31.903 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.y] 2024-08-17T02:25:31.903 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQD9CcBmGuNoGBAA4A8/06fGZH2ePaLLCVR27Q== 2024-08-17T02:25:31.903 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2024-08-17T02:25:31.903 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQD9CcBmNcIIHhAADPhHoaez14XKXphkNY2sfw== 2024-08-17T02:25:31.903 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2024-08-17T02:25:31.903 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQD9CcBmHFY5IRAAUeW5dVn2ce6u3LAJrQ4eHg== 2024-08-17T02:25:31.903 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.0] 2024-08-17T02:25:31.903 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAACsBmIFl+IBAAkGaOEDibN0aW5ihngWiCIQ== 2024-08-17T02:25:31.903 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.1] 2024-08-17T02:25:31.903 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQADCsBma1S7IRAAd0sfUVkbF6HNSfAbabWr8Q== 2024-08-17T02:25:31.903 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.2] 2024-08-17T02:25:31.904 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAGCsBmk4+iJxAAobLfanO2dDh2qfeLfedPig== 2024-08-17T02:25:31.904 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.3] 2024-08-17T02:25:31.904 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAJCsBmYhwmKhAAtd8Z2UwH19a7oEhSvP50wg== 2024-08-17T02:25:31.904 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.x] 2024-08-17T02:25:31.904 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQD9CcBm0A1FGxAAP/gtKgo0amWr/y8m2U8rsQ== 2024-08-17T02:25:31.904 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2024-08-17T02:25:31.904 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQD9CcBmUrl5JxAAPEo2eEKc1Me8sZTbGmQrhA== 2024-08-17T02:25:31.904 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2024-08-17T02:25:31.904 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQD9CcBmccyeLRAAc2o9yMJaCO8ueNCFsi9RuA== 2024-08-17T02:25:31.904 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.4] 2024-08-17T02:25:31.904 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAPCsBm2HCOCRAAb/b0YsNZDQGW3ams4o5OjQ== 2024-08-17T02:25:31.904 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.5] 2024-08-17T02:25:31.905 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQASCsBmqYvvDBAAjd21KwVBVNdmf61bB1kD1w== 2024-08-17T02:25:31.905 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.6] 2024-08-17T02:25:31.905 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAVCsBmsN2dERAARy8qXUd1PYCrOCaDxX41Ew== 2024-08-17T02:25:31.905 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.7] 2024-08-17T02:25:31.905 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAYCsBmV5LjFhAAHW2H7qHbd4sf0J/x50o7aA== 2024-08-17T02:25:31.905 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2024-08-17T02:25:31.905 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQD9CcBmO9XVMBAAIaDYcGwkyxygfAvY+VkwVA== 2024-08-17T02:25:31.905 INFO:teuthology.orchestra.run.smithi102.stdout:[client.2] 2024-08-17T02:25:31.905 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQD9CcBm7HelMxAABEkjlhK3Stjj/JIt848sxg== 2024-08-17T02:25:31.905 INFO:teuthology.orchestra.run.smithi102.stdout:[client.1] 2024-08-17T02:25:31.905 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQD9CcBmCn+NNhAA5UjRBu/QUG9eKJgoc1m3rQ== 2024-08-17T02:25:31.906 INFO:teuthology.orchestra.run.smithi102.stdout:[client.3] 2024-08-17T02:25:31.906 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQD+CcBmbIkxABAAzi8G0Z2RP5SNPyID2CwRYQ== 2024-08-17T02:25:31.906 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:25:31.909 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:25:31.953 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:31.991 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:32.041 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:32.044 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:32.091 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:32.093 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:32.139 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:32.175 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:32.220 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:32.223 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:32.265 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:32.267 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:32.355 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:25:32.357 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:25:32.400 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:32.403 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:32.445 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:32.448 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:32.538 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:32.540 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:32.585 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:32.587 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:32.630 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:32.632 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:32.718 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:32.720 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:32.763 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:32.766 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:32.852 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:32.855 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:32.900 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:32.903 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:32.947 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:32.950 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:33.040 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:25:33.040 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:25:33.057 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:25:33.152 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:25:33.164 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:25:33.180 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:25:33.279 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:25:33.292 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:25:33.308 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:25:33.405 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:25:33.418 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:33.420 DEBUG:teuthology.orchestra.run.smithi121:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:33.425 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:25:33.425 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:25:33.426 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:25:33.428 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:25:33.429 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:25:33.429 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:25:33.467 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:25:33.467 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:25:33.467 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:25:33.469 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:25:33.469 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:25:33.470 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:25:33.470 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:25:33.472 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:25:33.472 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:25:33.472 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:25:33.474 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:25:33.474 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:25:33.474 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:25:33.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03e5197700 1 Processor -- start 2024-08-17T02:25:33.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03e5197700 1 -- start start 2024-08-17T02:25:33.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03e5197700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 0x7f03e00c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03e5197700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 0x7f03e00cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03e5197700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e00cc450 con 0x7f03e00c2c80 2024-08-17T02:25:33.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03e5197700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e00c3e30 con 0x7f03e0140910 2024-08-17T02:25:33.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03e5197700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e00c4110 con 0x7f03e00cbab0 2024-08-17T02:25:33.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03dffff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 0x7f03e00c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03dffff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 0x7f03e00c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37088/0 (socket says 172.21.15.102:37088) 2024-08-17T02:25:33.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03dffff700 1 -- 172.21.15.102:0/2184392030 learned_addr learned my addr 172.21.15.102:0/2184392030 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:33.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 0x7f03e00cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03dffff700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 msgr2=0x7f03e00c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:25:33.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03dffff700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 msgr2=0x7f03e00c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:33.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03dffff700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 0x7f03e00c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:33.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03dffff700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 0x7f03e00c8520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:25:33.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03d77fe700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 msgr2=0x7f03e00cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:33.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03d77fe700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 msgr2=0x7f03e00cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:33.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 0x7f03e00cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:33.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.574+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 0x7f03e00cbf10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:25:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.778+0000 7f03dffff700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 0x7f03e00c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.778+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 0x7f03e00cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.778+0000 7f03dffff700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 msgr2=0x7f03e00c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:25:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.778+0000 7f03dffff700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 msgr2=0x7f03e00c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.778+0000 7f03dffff700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 0x7f03e00c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.778+0000 7f03d77fe700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 msgr2=0x7f03e00cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.778+0000 7f03d77fe700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 msgr2=0x7f03e00cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.778+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 0x7f03e00cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.778+0000 7f03dffff700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 0x7f03e00c8520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:25:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:33.778+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 0x7f03e00cbf10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.182+0000 7f03dffff700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 0x7f03e00c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.182+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 0x7f03e00cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.182+0000 7f03dffff700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 msgr2=0x7f03e00c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.182+0000 7f03dffff700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 msgr2=0x7f03e00c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.182+0000 7f03dffff700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 0x7f03e00c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.182+0000 7f03d77fe700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 msgr2=0x7f03e00cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:34.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.182+0000 7f03dffff700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 0x7f03e00c8520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:25:34.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.182+0000 7f03d77fe700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 msgr2=0x7f03e00cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:34.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.182+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 0x7f03e00cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:34.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.182+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 0x7f03e00cbf10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:25:34.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.986+0000 7f03dffff700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 0x7f03e00c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.986+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 0x7f03e00cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.986+0000 7f03dffff700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 msgr2=0x7f03e00c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:25:34.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.986+0000 7f03dffff700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 msgr2=0x7f03e00c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:34.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.986+0000 7f03dffff700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 0x7f03e00c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:34.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.986+0000 7f03d77fe700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 msgr2=0x7f03e00cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:34.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.986+0000 7f03dffff700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 0x7f03e00c8520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:25:34.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.986+0000 7f03d77fe700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 msgr2=0x7f03e00cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:34.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.986+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 0x7f03e00cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:34.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:34.986+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 0x7f03e00cbf10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:25:36.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.578+0000 7f03de7fc700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 msgr2=0x7f03e00cbf10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:25:36.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.578+0000 7f03de7fc700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.121:3300/0 conn(0x7f03e00cbab0 0x7f03e00cbf10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.578+0000 7f03de7fc700 1 -- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 msgr2=0x7f03e00c8520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:25:36.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.578+0000 7f03de7fc700 1 --2- 172.21.15.102:0/2184392030 >> v2:172.21.15.102:3300/0 conn(0x7f03e0140910 0x7f03e00c8520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.578+0000 7f03de7fc700 1 -- 172.21.15.102:0/2184392030 >> v1:172.21.15.121:6789/0 conn(0x7f03e00c2c80 legacy=0x7f03e00c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.578+0000 7f03de7fc700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03c0009790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.578+0000 7f03de7fc700 1 -- 172.21.15.102:0/2184392030 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e00c43f0 con 0x7f03c00036c0 2024-08-17T02:25:36.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.578+0000 7f03de7fc700 1 -- 172.21.15.102:0/2184392030 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e00c3e30 con 0x7f03c0007300 2024-08-17T02:25:36.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.578+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03c0009790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.578+0000 7f03d77fe700 1 -- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 msgr2=0x7f03c0009790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:36.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.578+0000 7f03d77fe700 1 -- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 msgr2=0x7f03c0009790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:36.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.578+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03c0009790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:36.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.578+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03c0009790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:25:36.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.782+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03c0009790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.782+0000 7f03d77fe700 1 -- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 msgr2=0x7f03c0009790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:36.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.782+0000 7f03d77fe700 1 -- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 msgr2=0x7f03c0009790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:36.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.782+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03c0009790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:36.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:36.782+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03c0009790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:25:37.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:37.186+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03c0009790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:37.186+0000 7f03d77fe700 1 -- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 msgr2=0x7f03c0009790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:37.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:37.186+0000 7f03d77fe700 1 -- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 msgr2=0x7f03c0009790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:37.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:37.186+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03c0009790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:37.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:37.186+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03c0009790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:25:37.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:37.990+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03c0009790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:37.990+0000 7f03d77fe700 1 -- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 msgr2=0x7f03c0009790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:37.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:37.990+0000 7f03d77fe700 1 -- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 msgr2=0x7f03c0009790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:37.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:37.990+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03c0009790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:37.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:37.990+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03c0009790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:25:38.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03df7fe700 1 -- 172.21.15.102:0/2184392030 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335344750 0 0) 0x7f03e00c43f0 con 0x7f03c00036c0 2024-08-17T02:25:38.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03df7fe700 1 -- 172.21.15.102:0/2184392030 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03cc003570 con 0x7f03c00036c0 2024-08-17T02:25:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03df7fe700 1 -- 172.21.15.102:0/2184392030 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4223944859 0 0) 0x7f03cc003570 con 0x7f03c00036c0 2024-08-17T02:25:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03df7fe700 1 -- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 msgr2=0x7f03c0009790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:25:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03df7fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03c0009790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03df7fe700 1 -- 172.21.15.102:0/2184392030 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c000af60 con 0x7f03c00036c0 2024-08-17T02:25:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03df7fe700 1 -- 172.21.15.102:0/2184392030 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7f03d000c2f0 con 0x7f03c00036c0 2024-08-17T02:25:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03df7fe700 1 -- 172.21.15.102:0/2184392030 >> v1:172.21.15.102:6789/0 conn(0x7f03c00036c0 legacy=0x7f03c0005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03df7fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03cc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03df7fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03cc004070 0x7f03cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03df7fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03cc004d50 0x7f03cc0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03df7fe700 1 -- 172.21.15.102:0/2184392030 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e00c3e30 con 0x7f03cc004d50 2024-08-17T02:25:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03df7fe700 1 -- 172.21.15.102:0/2184392030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc00bcc0 con 0x7f03cc004070 2024-08-17T02:25:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03df7fe700 1 -- 172.21.15.102:0/2184392030 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc00be80 con 0x7f03c0007300 2024-08-17T02:25:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03e4996700 1 -- 172.21.15.102:0/2184392030 reap_dead start 2024-08-17T02:25:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03dffff700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03cc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03cc004070 0x7f03cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.817+0000 7f03e4996700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03cc004d50 0x7f03cc0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03dffff700 1 -- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03cc004070 msgr2=0x7f03cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03dffff700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03cc004070 0x7f03cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03dffff700 1 -- 172.21.15.102:0/2184392030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03cc004d50 msgr2=0x7f03cc0051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03dffff700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03cc004d50 0x7f03cc0051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03dffff700 1 -- 172.21.15.102:0/2184392030 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc003570 con 0x7f03c0007300 2024-08-17T02:25:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03e4996700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03cc004d50 0x7f03cc0051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03d77fe700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03cc004070 0x7f03cc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03dffff700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03cc003a60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009060 tx=0x7f03d0008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0c5fa22883d4bb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03df7fe700 1 -- 172.21.15.102:0/2184392030 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0017470 con 0x7f03c0007300 2024-08-17T02:25:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03df7fe700 1 -- 172.21.15.102:0/2184392030 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d000c040 con 0x7f03c0007300 2024-08-17T02:25:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03df7fe700 1 -- 172.21.15.102:0/2184392030 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0017610 con 0x7f03c0007300 2024-08-17T02:25:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03e5197700 1 -- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 msgr2=0x7f03cc003a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03e5197700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03cc003a60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009060 tx=0x7f03d0008040 comp rx=0 tx=0).stop 2024-08-17T02:25:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03e5197700 1 -- 172.21.15.102:0/2184392030 shutdown_connections 2024-08-17T02:25:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03e5197700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03cc004d50 0x7f03cc0051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03e5197700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03cc004070 0x7f03cc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03e5197700 1 --2- 172.21.15.102:0/2184392030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03c0007300 0x7f03cc003a60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03e5197700 1 -- 172.21.15.102:0/2184392030 >> 172.21.15.102:0/2184392030 conn(0x7f03e00cdee0 msgr2=0x7f03e00ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03e5197700 1 -- 172.21.15.102:0/2184392030 shutdown_connections 2024-08-17T02:25:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.821+0000 7f03e5197700 1 -- 172.21.15.102:0/2184392030 wait complete. 2024-08-17T02:25:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.825+0000 7f03e5197700 1 Processor -- start 2024-08-17T02:25:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.825+0000 7f03e5197700 1 -- start start 2024-08-17T02:25:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.825+0000 7f03e5197700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c0007300 0x7f03e0156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.825+0000 7f03e5197700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03cc004070 0x7f03e0159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.825+0000 7f03e5197700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03cc004d50 0x7f03e015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.825+0000 7f03e5197700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e01584a0 con 0x7f03c0007300 2024-08-17T02:25:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.825+0000 7f03e5197700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e01578d0 con 0x7f03cc004070 2024-08-17T02:25:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.825+0000 7f03e5197700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e0157b70 con 0x7f03cc004d50 2024-08-17T02:25:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.825+0000 7f03dffff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c0007300 0x7f03e0156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03dffff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c0007300 0x7f03e0156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37184/0 (socket says 172.21.15.102:37184) 2024-08-17T02:25:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03e4996700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03cc004d50 0x7f03e015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03dffff700 1 -- 172.21.15.102:0/2827708005 learned_addr learned my addr 172.21.15.102:0/2827708005 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03d77fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03cc004070 0x7f03e0159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03dffff700 1 -- 172.21.15.102:0/2827708005 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03cc004d50 msgr2=0x7f03e015a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03dffff700 1 --2- 172.21.15.102:0/2827708005 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03cc004d50 0x7f03e015a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03dffff700 1 -- 172.21.15.102:0/2827708005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03cc004070 msgr2=0x7f03e0159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03dffff700 1 --2- 172.21.15.102:0/2827708005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03cc004070 0x7f03e0159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03dffff700 1 -- 172.21.15.102:0/2827708005 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e0157e50 con 0x7f03c0007300 2024-08-17T02:25:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03dffff700 1 --2- 172.21.15.102:0/2827708005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c0007300 0x7f03e0156060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f03cc010420 tx=0x7f03d0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03dcff9700 1 -- 172.21.15.102:0/2827708005 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0017570 con 0x7f03c0007300 2024-08-17T02:25:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03e5197700 1 -- 172.21.15.102:0/2827708005 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e0158130 con 0x7f03c0007300 2024-08-17T02:25:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03dcff9700 1 -- 172.21.15.102:0/2827708005 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d0017b90 con 0x7f03c0007300 2024-08-17T02:25:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03dcff9700 1 -- 172.21.15.102:0/2827708005 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d002b460 con 0x7f03c0007300 2024-08-17T02:25:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03e5197700 1 -- 172.21.15.102:0/2827708005 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e0156740 con 0x7f03c0007300 2024-08-17T02:25:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03dcff9700 1 -- 172.21.15.102:0/2827708005 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f03d0029070 con 0x7f03c0007300 2024-08-17T02:25:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03dcff9700 1 -- 172.21.15.102:0/2827708005 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f03d002bcf0 con 0x7f03c0007300 2024-08-17T02:25:38.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.829+0000 7f03e5197700 1 -- 172.21.15.102:0/2827708005 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e00638f0 con 0x7f03c0007300 2024-08-17T02:25:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.833+0000 7f03dcff9700 1 -- 172.21.15.102:0/2827708005 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f03d0030020 con 0x7f03c0007300 2024-08-17T02:25:38.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.901+0000 7f03e5197700 1 -- 172.21.15.102:0/2827708005 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f03e00638f0 con 0x7f03c0007300 2024-08-17T02:25:38.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.909+0000 7f03dcff9700 1 -- 172.21.15.102:0/2827708005 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f03d001b030 con 0x7f03c0007300 2024-08-17T02:25:38.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.909+0000 7f03e5197700 1 -- 172.21.15.102:0/2827708005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c0007300 msgr2=0x7f03e0156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.909+0000 7f03e5197700 1 --2- 172.21.15.102:0/2827708005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c0007300 0x7f03e0156060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f03cc010420 tx=0x7f03d0021000 comp rx=0 tx=0).stop 2024-08-17T02:25:38.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.909+0000 7f03e5197700 1 -- 172.21.15.102:0/2827708005 shutdown_connections 2024-08-17T02:25:38.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.909+0000 7f03e5197700 1 --2- 172.21.15.102:0/2827708005 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03cc004d50 0x7f03e015a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.909+0000 7f03e5197700 1 --2- 172.21.15.102:0/2827708005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03cc004070 0x7f03e0159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.909+0000 7f03e5197700 1 --2- 172.21.15.102:0/2827708005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c0007300 0x7f03e0156060 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.909+0000 7f03e5197700 1 -- 172.21.15.102:0/2827708005 >> 172.21.15.102:0/2827708005 conn(0x7f03e00cdee0 msgr2=0x7f03e00cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:38.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.909+0000 7f03e5197700 1 -- 172.21.15.102:0/2827708005 shutdown_connections 2024-08-17T02:25:38.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:38.913+0000 7f03e5197700 1 -- 172.21.15.102:0/2827708005 wait complete. 2024-08-17T02:25:38.919 INFO:teuthology.orchestra.run.smithi102.stderr:adjusted tunables profile to default 2024-08-17T02:25:38.929 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:25:38.930 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:38.930 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:25:38.944 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:38.944 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:25:38.952 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:38.952 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:25:38.961 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-08-17T02:25:38.961 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:25:38.970 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:38.970 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:25:38.987 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:38.987 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:25:39.008 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:39.001+0000 7f85fa208000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:25:39.045 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:39.045 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:25:39.055 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-17T02:25:39.055 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:25:39.070 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new bed1e6fe-ed38-4057-97f1-799671550db1 0 2024-08-17T02:25:39.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.228+0000 7f386756e700 1 Processor -- start 2024-08-17T02:25:39.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.228+0000 7f386756e700 1 -- start start 2024-08-17T02:25:39.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.228+0000 7f386756e700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f38601574f0 0x7f3860157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.228+0000 7f386756e700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386006e010 con 0x7f38600b0d90 2024-08-17T02:25:39.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.228+0000 7f386756e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3860157fb0 con 0x7f38601514d0 2024-08-17T02:25:39.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.228+0000 7f386756e700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3860158290 con 0x7f38601574f0 2024-08-17T02:25:39.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.228+0000 7f386656c700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f38601514d0 0x7f386006ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46860/0 (socket says 172.21.15.121:46860) 2024-08-17T02:25:39.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.228+0000 7f386656c700 1 -- 172.21.15.121:0/2616549681 learned_addr learned my addr 172.21.15.121:0/2616549681 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-08-17T02:25:39.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.228+0000 7f3865d6b700 1 --2- 172.21.15.121:0/2616549681 >> v2:172.21.15.102:3300/0 conn(0x7f38601574f0 0x7f3860157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.228+0000 7f386556a700 1 -- 172.21.15.121:0/2616549681 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158469530 0 0) 0x7f3860157fb0 con 0x7f38601514d0 2024-08-17T02:25:39.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f386556a700 1 -- 172.21.15.121:0/2616549681 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f384c003570 con 0x7f38601514d0 2024-08-17T02:25:39.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f386556a700 1 -- 172.21.15.121:0/2616549681 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205366889 0 0) 0x7f386006e010 con 0x7f38600b0d90 2024-08-17T02:25:39.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f386556a700 1 -- 172.21.15.121:0/2616549681 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3860157fb0 con 0x7f38600b0d90 2024-08-17T02:25:39.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f3865d6b700 1 -- 172.21.15.121:0/2616549681 >> v1:172.21.15.121:6789/0 conn(0x7f38601514d0 legacy=0x7f386006ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f3865d6b700 1 -- 172.21.15.121:0/2616549681 >> v1:172.21.15.102:6789/0 conn(0x7f38600b0d90 legacy=0x7f38600c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f3865d6b700 1 -- 172.21.15.121:0/2616549681 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386006e260 con 0x7f38601574f0 2024-08-17T02:25:39.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f3865d6b700 1 --2- 172.21.15.121:0/2616549681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38601574f0 0x7f3860157970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f38540098e0 tx=0x7f38540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65169ad7c9da37 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f386556a700 1 -- 172.21.15.121:0/2616549681 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854011630 con 0x7f38601574f0 2024-08-17T02:25:39.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f386556a700 1 -- 172.21.15.121:0/2616549681 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3854011790 con 0x7f38601574f0 2024-08-17T02:25:39.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f386556a700 1 -- 172.21.15.121:0/2616549681 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854011b30 con 0x7f38601574f0 2024-08-17T02:25:39.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f386756e700 1 -- 172.21.15.121:0/2616549681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38601574f0 msgr2=0x7f3860157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f386756e700 1 --2- 172.21.15.121:0/2616549681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38601574f0 0x7f3860157970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f38540098e0 tx=0x7f38540091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f386756e700 1 -- 172.21.15.121:0/2616549681 shutdown_connections 2024-08-17T02:25:39.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f386756e700 1 --2- 172.21.15.121:0/2616549681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38601574f0 0x7f3860157970 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f386756e700 1 -- 172.21.15.121:0/2616549681 >> 172.21.15.121:0/2616549681 conn(0x7f38600678a0 msgr2=0x7f3860067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f386756e700 1 -- 172.21.15.121:0/2616549681 shutdown_connections 2024-08-17T02:25:39.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f386756e700 1 -- 172.21.15.121:0/2616549681 wait complete. 2024-08-17T02:25:39.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f386756e700 1 Processor -- start 2024-08-17T02:25:39.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.232+0000 7f386756e700 1 -- start start 2024-08-17T02:25:39.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386756e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38600b0d90 0x7f38600aace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386756e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38601514d0 0x7f38600a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386756e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f38601574f0 0x7f38600a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386756e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38600a7060 con 0x7f38601514d0 2024-08-17T02:25:39.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386756e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38600a5fc0 con 0x7f38600b0d90 2024-08-17T02:25:39.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386756e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38600a62a0 con 0x7f38601574f0 2024-08-17T02:25:39.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386656c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38600b0d90 0x7f38600aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f3866d6d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f38601574f0 0x7f38600a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f3865d6b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38601514d0 0x7f38600a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386656c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38600b0d90 0x7f38600aace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42882/0 (socket says 172.21.15.121:42882) 2024-08-17T02:25:39.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f3866d6d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f38601574f0 0x7f38600a5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:36318/0 (socket says 172.21.15.121:36318) 2024-08-17T02:25:39.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386656c700 1 -- 172.21.15.121:0/2518658814 learned_addr learned my addr 172.21.15.121:0/2518658814 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-17T02:25:39.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386656c700 1 -- 172.21.15.121:0/2518658814 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f38601574f0 msgr2=0x7f38600a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386656c700 1 --2- 172.21.15.121:0/2518658814 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f38601574f0 0x7f38600a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386656c700 1 -- 172.21.15.121:0/2518658814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38601514d0 msgr2=0x7f38600a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386656c700 1 --2- 172.21.15.121:0/2518658814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38601514d0 0x7f38600a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386656c700 1 -- 172.21.15.121:0/2518658814 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3854009420 con 0x7f38600b0d90 2024-08-17T02:25:39.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f3866d6d700 1 --2- 172.21.15.121:0/2518658814 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f38601574f0 0x7f38600a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:39.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386656c700 1 --2- 172.21.15.121:0/2518658814 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38600b0d90 0x7f38600aace0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f385c00c790 tx=0x7f385c007e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f38527fc700 1 -- 172.21.15.121:0/2518658814 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c005b30 con 0x7f38600b0d90 2024-08-17T02:25:39.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f38527fc700 1 -- 172.21.15.121:0/2518658814 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c005cd0 con 0x7f38600b0d90 2024-08-17T02:25:39.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386756e700 1 -- 172.21.15.121:0/2518658814 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38600a6580 con 0x7f38600b0d90 2024-08-17T02:25:39.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f38527fc700 1 -- 172.21.15.121:0/2518658814 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c007320 con 0x7f38600b0d90 2024-08-17T02:25:39.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386756e700 1 -- 172.21.15.121:0/2518658814 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38600a6b40 con 0x7f38600b0d90 2024-08-17T02:25:39.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f38527fc700 1 -- 172.21.15.121:0/2518658814 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f385c01c440 con 0x7f38600b0d90 2024-08-17T02:25:39.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f38527fc700 1 -- 172.21.15.121:0/2518658814 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f385c005e40 con 0x7f38600b0d90 2024-08-17T02:25:39.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.236+0000 7f386756e700 1 -- 172.21.15.121:0/2518658814 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38600c88c0 con 0x7f38600b0d90 2024-08-17T02:25:39.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.244+0000 7f38527fc700 1 -- 172.21.15.121:0/2518658814 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f38600c88c0 con 0x7f38600b0d90 2024-08-17T02:25:39.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.320+0000 7f386756e700 1 -- 172.21.15.121:0/2518658814 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bed1e6fe-ed38-4057-97f1-799671550db1", "id": 0} v 0) v1 -- 0x7f3860064330 con 0x7f38600b0d90 2024-08-17T02:25:39.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.332+0000 7f38527fc700 1 -- 172.21.15.121:0/2518658814 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bed1e6fe-ed38-4057-97f1-799671550db1", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f385c021060 con 0x7f38600b0d90 2024-08-17T02:25:39.334 INFO:teuthology.orchestra.run.smithi121.stdout:0 2024-08-17T02:25:39.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.332+0000 7f386756e700 1 -- 172.21.15.121:0/2518658814 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38600b0d90 msgr2=0x7f38600aace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.332+0000 7f386756e700 1 --2- 172.21.15.121:0/2518658814 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38600b0d90 0x7f38600aace0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f385c00c790 tx=0x7f385c007e80 comp rx=0 tx=0).stop 2024-08-17T02:25:39.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.332+0000 7f386756e700 1 -- 172.21.15.121:0/2518658814 shutdown_connections 2024-08-17T02:25:39.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.332+0000 7f386756e700 1 --2- 172.21.15.121:0/2518658814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38601514d0 0x7f38600a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.332+0000 7f386756e700 1 --2- 172.21.15.121:0/2518658814 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f38601574f0 0x7f38600a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.332+0000 7f386756e700 1 --2- 172.21.15.121:0/2518658814 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38600b0d90 0x7f38600aace0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.332+0000 7f386756e700 1 -- 172.21.15.121:0/2518658814 >> 172.21.15.121:0/2518658814 conn(0x7f38600678a0 msgr2=0x7f386006e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.332+0000 7f386756e700 1 -- 172.21.15.121:0/2518658814 shutdown_connections 2024-08-17T02:25:39.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.332+0000 7f386756e700 1 -- 172.21.15.121:0/2518658814 wait complete. 2024-08-17T02:25:39.348 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 5b60245e-40dc-4087-a008-f34e239e965a 1 2024-08-17T02:25:39.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.448+0000 7fe479d9f700 1 Processor -- start 2024-08-17T02:25:39.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.448+0000 7fe479d9f700 1 -- start start 2024-08-17T02:25:39.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.448+0000 7fe479d9f700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe4741590b0 0x7fe474066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.448+0000 7fe479d9f700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe4740cd2b0 0x7fe474067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.448+0000 7fe479d9f700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4740ce210 con 0x7fe474159480 2024-08-17T02:25:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.448+0000 7fe479d9f700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4740cba00 con 0x7fe4740cd2b0 2024-08-17T02:25:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.448+0000 7fe479d9f700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4740cdc90 con 0x7fe4741590b0 2024-08-17T02:25:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.448+0000 7fe478d9d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe4741590b0 0x7fe474066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe478d9d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe4741590b0 0x7fe474066e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42884/0 (socket says 172.21.15.121:42884) 2024-08-17T02:25:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe473fff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe474159480 0x7fe47415ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46866/0 (socket says 172.21.15.121:46866) 2024-08-17T02:25:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe478d9d700 1 -- 172.21.15.121:0/670894134 learned_addr learned my addr 172.21.15.121:0/670894134 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-17T02:25:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe47959e700 1 --2- 172.21.15.121:0/670894134 >> v2:172.21.15.102:3300/0 conn(0x7fe4740cd2b0 0x7fe474067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe478d9d700 1 -- 172.21.15.121:0/670894134 >> v2:172.21.15.102:3300/0 conn(0x7fe4740cd2b0 msgr2=0x7fe474067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe478d9d700 1 --2- 172.21.15.121:0/670894134 >> v2:172.21.15.102:3300/0 conn(0x7fe4740cd2b0 0x7fe474067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe478d9d700 1 -- 172.21.15.121:0/670894134 >> v1:172.21.15.121:6789/0 conn(0x7fe474159480 legacy=0x7fe47415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe478d9d700 1 -- 172.21.15.121:0/670894134 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4740cb440 con 0x7fe4741590b0 2024-08-17T02:25:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe478d9d700 1 --2- 172.21.15.121:0/670894134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4741590b0 0x7fe474066e00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe474071780 tx=0x7fe464009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9f863a35ccc43b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe4737fe700 1 -- 172.21.15.121:0/670894134 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46400b860 con 0x7fe4741590b0 2024-08-17T02:25:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe4737fe700 1 -- 172.21.15.121:0/670894134 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46400b9c0 con 0x7fe4741590b0 2024-08-17T02:25:39.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe4737fe700 1 -- 172.21.15.121:0/670894134 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46400bd60 con 0x7fe4741590b0 2024-08-17T02:25:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe479d9f700 1 -- 172.21.15.121:0/670894134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4741590b0 msgr2=0x7fe474066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe479d9f700 1 --2- 172.21.15.121:0/670894134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4741590b0 0x7fe474066e00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe474071780 tx=0x7fe464009250 comp rx=0 tx=0).stop 2024-08-17T02:25:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe479d9f700 1 -- 172.21.15.121:0/670894134 shutdown_connections 2024-08-17T02:25:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe479d9f700 1 --2- 172.21.15.121:0/670894134 >> v2:172.21.15.102:3300/0 conn(0x7fe4740cd2b0 0x7fe474067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe479d9f700 1 --2- 172.21.15.121:0/670894134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4741590b0 0x7fe474066e00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe479d9f700 1 -- 172.21.15.121:0/670894134 >> 172.21.15.121:0/670894134 conn(0x7fe4740d0b90 msgr2=0x7fe4740ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe479d9f700 1 -- 172.21.15.121:0/670894134 shutdown_connections 2024-08-17T02:25:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe479d9f700 1 -- 172.21.15.121:0/670894134 wait complete. 2024-08-17T02:25:39.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe479d9f700 1 Processor -- start 2024-08-17T02:25:39.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.452+0000 7fe479d9f700 1 -- start start 2024-08-17T02:25:39.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe479d9f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4740cd2b0 0x7fe474150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe479d9f700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe4741590b0 0x7fe47415c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe479d9f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe474159480 0x7fe4740c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe479d9f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4740c7ca0 con 0x7fe4740cd2b0 2024-08-17T02:25:39.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe479d9f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe474150fe0 con 0x7fe474159480 2024-08-17T02:25:39.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe479d9f700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4740ca120 con 0x7fe4741590b0 2024-08-17T02:25:39.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe473fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe4741590b0 0x7fe47415c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe473fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe4741590b0 0x7fe47415c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:36322/0 (socket says 172.21.15.121:36322) 2024-08-17T02:25:39.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe473fff700 1 -- 172.21.15.121:0/1229014638 learned_addr learned my addr 172.21.15.121:0/1229014638 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-17T02:25:39.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe47959e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe474159480 0x7fe4740c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe478d9d700 1 --2- 172.21.15.121:0/1229014638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4740cd2b0 0x7fe474150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe473fff700 1 -- 172.21.15.121:0/1229014638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe474159480 msgr2=0x7fe4740c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe473fff700 1 --2- 172.21.15.121:0/1229014638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe474159480 0x7fe4740c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe473fff700 1 -- 172.21.15.121:0/1229014638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4740cd2b0 msgr2=0x7fe474150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe473fff700 1 --2- 172.21.15.121:0/1229014638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4740cd2b0 0x7fe474150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe473fff700 1 -- 172.21.15.121:0/1229014638 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4640094f0 con 0x7fe4741590b0 2024-08-17T02:25:39.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe473fff700 1 --2- 172.21.15.121:0/1229014638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe4741590b0 0x7fe47415c550 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00cd30 tx=0x7fe45c001af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe470ff9700 1 -- 172.21.15.121:0/1229014638 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c00ce90 con 0x7fe4741590b0 2024-08-17T02:25:39.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe470ff9700 1 -- 172.21.15.121:0/1229014638 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45c005df0 con 0x7fe4741590b0 2024-08-17T02:25:39.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe479d9f700 1 -- 172.21.15.121:0/1229014638 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4740ca400 con 0x7fe4741590b0 2024-08-17T02:25:39.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe470ff9700 1 -- 172.21.15.121:0/1229014638 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c00aae0 con 0x7fe4741590b0 2024-08-17T02:25:39.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe479d9f700 1 -- 172.21.15.121:0/1229014638 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4740c7930 con 0x7fe4741590b0 2024-08-17T02:25:39.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe470ff9700 1 -- 172.21.15.121:0/1229014638 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fe45c0070f0 con 0x7fe4741590b0 2024-08-17T02:25:39.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe470ff9700 1 -- 172.21.15.121:0/1229014638 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fe45c01b7c0 con 0x7fe4741590b0 2024-08-17T02:25:39.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.456+0000 7fe479d9f700 1 -- 172.21.15.121:0/1229014638 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4740c7e10 con 0x7fe4741590b0 2024-08-17T02:25:39.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.460+0000 7fe470ff9700 1 -- 172.21.15.121:0/1229014638 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fe45c007530 con 0x7fe4741590b0 2024-08-17T02:25:39.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.540+0000 7fe479d9f700 1 -- 172.21.15.121:0/1229014638 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5b60245e-40dc-4087-a008-f34e239e965a", "id": 1} v 0) v1 -- 0x7fe474064330 con 0x7fe4741590b0 2024-08-17T02:25:39.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.544+0000 7fe470ff9700 1 -- 172.21.15.121:0/1229014638 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5b60245e-40dc-4087-a008-f34e239e965a", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe45c0076d0 con 0x7fe4741590b0 2024-08-17T02:25:39.548 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-08-17T02:25:39.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.544+0000 7fe479d9f700 1 -- 172.21.15.121:0/1229014638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe4741590b0 msgr2=0x7fe47415c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.544+0000 7fe479d9f700 1 --2- 172.21.15.121:0/1229014638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe4741590b0 0x7fe47415c550 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00cd30 tx=0x7fe45c001af0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.544+0000 7fe479d9f700 1 -- 172.21.15.121:0/1229014638 shutdown_connections 2024-08-17T02:25:39.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.544+0000 7fe479d9f700 1 --2- 172.21.15.121:0/1229014638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe474159480 0x7fe4740c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.544+0000 7fe479d9f700 1 --2- 172.21.15.121:0/1229014638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe4741590b0 0x7fe47415c550 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.544+0000 7fe479d9f700 1 --2- 172.21.15.121:0/1229014638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4740cd2b0 0x7fe474150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.544+0000 7fe479d9f700 1 -- 172.21.15.121:0/1229014638 >> 172.21.15.121:0/1229014638 conn(0x7fe4740d0b90 msgr2=0x7fe4740ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.548+0000 7fe479d9f700 1 -- 172.21.15.121:0/1229014638 shutdown_connections 2024-08-17T02:25:39.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.548+0000 7fe479d9f700 1 -- 172.21.15.121:0/1229014638 wait complete. 2024-08-17T02:25:39.561 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new f0966f43-b54a-4b11-b537-f7e93820381f 2 2024-08-17T02:25:39.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.664+0000 7f5aecb01700 1 Processor -- start 2024-08-17T02:25:39.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.664+0000 7f5aecb01700 1 -- start start 2024-08-17T02:25:39.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.664+0000 7f5aecb01700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5ae806e470 0x7f5ae80aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.664+0000 7f5aecb01700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ae80b1600 0x7f5ae80aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.664+0000 7f5aecb01700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae8140f70 con 0x7f5ae806e840 2024-08-17T02:25:39.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.664+0000 7f5aecb01700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae80b1a80 con 0x7f5ae806e470 2024-08-17T02:25:39.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.664+0000 7f5aecb01700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae8141250 con 0x7f5ae80b1600 2024-08-17T02:25:39.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.664+0000 7f5ae77fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5ae806e470 0x7f5ae80aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.664+0000 7f5ae7fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ae80b1600 0x7f5ae80aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.664+0000 7f5ae6ffd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f5ae806e840 0x7f5ae80b0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46884/0 (socket says 172.21.15.121:46884) 2024-08-17T02:25:39.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.664+0000 7f5ae6ffd700 1 -- 172.21.15.121:0/554867582 learned_addr learned my addr 172.21.15.121:0/554867582 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-08-17T02:25:39.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.664+0000 7f5ae7fff700 1 -- 172.21.15.121:0/554867582 >> v2:172.21.15.121:3300/0 conn(0x7f5ae806e470 msgr2=0x7f5ae80aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:39.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.664+0000 7f5ae7fff700 1 --2- 172.21.15.121:0/554867582 >> v2:172.21.15.121:3300/0 conn(0x7f5ae806e470 0x7f5ae80aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.664+0000 7f5ae7fff700 1 -- 172.21.15.121:0/554867582 >> v1:172.21.15.121:6789/0 conn(0x7f5ae806e840 legacy=0x7f5ae80b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.664+0000 7f5ae7fff700 1 -- 172.21.15.121:0/554867582 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae8141530 con 0x7f5ae80b1600 2024-08-17T02:25:39.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.664+0000 7f5ae77fe700 1 --2- 172.21.15.121:0/554867582 >> v2:172.21.15.121:3300/0 conn(0x7f5ae806e470 0x7f5ae80aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:39.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.668+0000 7f5ae7fff700 1 --2- 172.21.15.121:0/554867582 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ae80b1600 0x7f5ae80aefc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009910 tx=0x7f5ad80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f6e74479b70e3e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.668+0000 7f5ae67fc700 1 -- 172.21.15.121:0/554867582 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad800b640 con 0x7f5ae80b1600 2024-08-17T02:25:39.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.668+0000 7f5ae67fc700 1 -- 172.21.15.121:0/554867582 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad800b7a0 con 0x7f5ae80b1600 2024-08-17T02:25:39.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.668+0000 7f5ae67fc700 1 -- 172.21.15.121:0/554867582 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad800bb60 con 0x7f5ae80b1600 2024-08-17T02:25:39.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.668+0000 7f5aecb01700 1 -- 172.21.15.121:0/554867582 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ae80b1600 msgr2=0x7f5ae80aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.668+0000 7f5aecb01700 1 --2- 172.21.15.121:0/554867582 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ae80b1600 0x7f5ae80aefc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009910 tx=0x7f5ad80091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.668+0000 7f5aecb01700 1 -- 172.21.15.121:0/554867582 shutdown_connections 2024-08-17T02:25:39.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.668+0000 7f5aecb01700 1 --2- 172.21.15.121:0/554867582 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ae80b1600 0x7f5ae80aefc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.668+0000 7f5aecb01700 1 --2- 172.21.15.121:0/554867582 >> v2:172.21.15.121:3300/0 conn(0x7f5ae806e470 0x7f5ae80aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.668+0000 7f5aecb01700 1 -- 172.21.15.121:0/554867582 >> 172.21.15.121:0/554867582 conn(0x7f5ae80678a0 msgr2=0x7f5ae8067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.668+0000 7f5aecb01700 1 -- 172.21.15.121:0/554867582 shutdown_connections 2024-08-17T02:25:39.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.668+0000 7f5aecb01700 1 -- 172.21.15.121:0/554867582 wait complete. 2024-08-17T02:25:39.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.668+0000 7f5aecb01700 1 Processor -- start 2024-08-17T02:25:39.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.668+0000 7f5aecb01700 1 -- start start 2024-08-17T02:25:39.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5aecb01700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae806e470 0x7f5ae815d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5aecb01700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ae806e840 0x7f5ae80c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5aecb01700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ae80b1600 0x7f5ae80c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5aecb01700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80c0fe0 con 0x7f5ae806e470 2024-08-17T02:25:39.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5aecb01700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae815d650 con 0x7f5ae806e840 2024-08-17T02:25:39.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5aecb01700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80c3a00 con 0x7f5ae80b1600 2024-08-17T02:25:39.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5ae7fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ae80b1600 0x7f5ae80c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5ae7fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ae80b1600 0x7f5ae80c2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:36338/0 (socket says 172.21.15.121:36338) 2024-08-17T02:25:39.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5ae7fff700 1 -- 172.21.15.121:0/1205765630 learned_addr learned my addr 172.21.15.121:0/1205765630 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-17T02:25:39.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5ae6ffd700 1 --2- 172.21.15.121:0/1205765630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ae806e840 0x7f5ae80c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5ae77fe700 1 --2- 172.21.15.121:0/1205765630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae806e470 0x7f5ae815d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5ae7fff700 1 -- 172.21.15.121:0/1205765630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ae806e840 msgr2=0x7f5ae80c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5ae7fff700 1 --2- 172.21.15.121:0/1205765630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ae806e840 0x7f5ae80c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5ae7fff700 1 -- 172.21.15.121:0/1205765630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae806e470 msgr2=0x7f5ae815d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5ae7fff700 1 --2- 172.21.15.121:0/1205765630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae806e470 0x7f5ae815d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5ae7fff700 1 -- 172.21.15.121:0/1205765630 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae0009a20 con 0x7f5ae80b1600 2024-08-17T02:25:39.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5ae6ffd700 1 --2- 172.21.15.121:0/1205765630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ae806e840 0x7f5ae80c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:39.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5ae77fe700 1 --2- 172.21.15.121:0/1205765630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae806e470 0x7f5ae815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:39.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5ae7fff700 1 --2- 172.21.15.121:0/1205765630 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ae80b1600 0x7f5ae80c2b30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009fb0 tx=0x7f5ad8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5acf7fe700 1 -- 172.21.15.121:0/1205765630 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad801f070 con 0x7f5ae80b1600 2024-08-17T02:25:39.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5acf7fe700 1 -- 172.21.15.121:0/1205765630 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad800b910 con 0x7f5ae80b1600 2024-08-17T02:25:39.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5aecb01700 1 -- 172.21.15.121:0/1205765630 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad8009420 con 0x7f5ae80b1600 2024-08-17T02:25:39.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5acf7fe700 1 -- 172.21.15.121:0/1205765630 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8025670 con 0x7f5ae80b1600 2024-08-17T02:25:39.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5aecb01700 1 -- 172.21.15.121:0/1205765630 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae80c3440 con 0x7f5ae80b1600 2024-08-17T02:25:39.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5acf7fe700 1 -- 172.21.15.121:0/1205765630 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f5ad8023070 con 0x7f5ae80b1600 2024-08-17T02:25:39.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5acf7fe700 1 -- 172.21.15.121:0/1205765630 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f5ad8025d70 con 0x7f5ae80b1600 2024-08-17T02:25:39.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.672+0000 7f5aecb01700 1 -- 172.21.15.121:0/1205765630 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae8064330 con 0x7f5ae80b1600 2024-08-17T02:25:39.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.676+0000 7f5acf7fe700 1 -- 172.21.15.121:0/1205765630 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f5ad802a070 con 0x7f5ae80b1600 2024-08-17T02:25:39.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.752+0000 7f5aecb01700 1 -- 172.21.15.121:0/1205765630 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f0966f43-b54a-4b11-b537-f7e93820381f", "id": 2} v 0) v1 -- 0x7f5ae806ed70 con 0x7f5ae80b1600 2024-08-17T02:25:39.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.760+0000 7f5acf7fe700 1 -- 172.21.15.121:0/1205765630 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0966f43-b54a-4b11-b537-f7e93820381f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5ad8015020 con 0x7f5ae80b1600 2024-08-17T02:25:39.763 INFO:teuthology.orchestra.run.smithi121.stdout:2 2024-08-17T02:25:39.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.760+0000 7f5aecb01700 1 -- 172.21.15.121:0/1205765630 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ae80b1600 msgr2=0x7f5ae80c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.760+0000 7f5aecb01700 1 --2- 172.21.15.121:0/1205765630 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ae80b1600 0x7f5ae80c2b30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009fb0 tx=0x7f5ad8017000 comp rx=0 tx=0).stop 2024-08-17T02:25:39.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.760+0000 7f5aecb01700 1 -- 172.21.15.121:0/1205765630 shutdown_connections 2024-08-17T02:25:39.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.760+0000 7f5aecb01700 1 --2- 172.21.15.121:0/1205765630 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5ae80b1600 0x7f5ae80c2b30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.760+0000 7f5aecb01700 1 --2- 172.21.15.121:0/1205765630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ae806e840 0x7f5ae80c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.760+0000 7f5aecb01700 1 --2- 172.21.15.121:0/1205765630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae806e470 0x7f5ae815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.760+0000 7f5aecb01700 1 -- 172.21.15.121:0/1205765630 >> 172.21.15.121:0/1205765630 conn(0x7f5ae80678a0 msgr2=0x7f5ae8068f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.760+0000 7f5aecb01700 1 -- 172.21.15.121:0/1205765630 shutdown_connections 2024-08-17T02:25:39.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.760+0000 7f5aecb01700 1 -- 172.21.15.121:0/1205765630 wait complete. 2024-08-17T02:25:39.772 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:39.765+0000 7f85fa208000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:25:39.777 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 9ad2af3c-bdff-438b-8d29-1cdd17af3599 3 2024-08-17T02:25:39.783 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:39.780+0000 7f679f7ae000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:25:39.829 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:39.821+0000 7f85fa208000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:25:39.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.884+0000 7fbe80be4700 1 Processor -- start 2024-08-17T02:25:39.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.884+0000 7fbe80be4700 1 -- start start 2024-08-17T02:25:39.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.884+0000 7fbe80be4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe7c155e70 0x7fbe7c0ada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.884+0000 7fbe80be4700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbe7c0b1910 0x7fbe7c0ca600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.884+0000 7fbe80be4700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7c0c9b90 con 0x7fbe7c0adf50 2024-08-17T02:25:39.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.884+0000 7fbe80be4700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7c0ae3d0 con 0x7fbe7c0b1910 2024-08-17T02:25:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.884+0000 7fbe80be4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0c9e00 con 0x7fbe7c155e70 2024-08-17T02:25:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe7a59c700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe7c155e70 0x7fbe7c0ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe79d9b700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbe7c0adf50 0x7fbe7c0b1200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46894/0 (socket says 172.21.15.121:46894) 2024-08-17T02:25:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe79d9b700 1 -- 172.21.15.121:0/3909628843 learned_addr learned my addr 172.21.15.121:0/3909628843 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-08-17T02:25:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe7ad9d700 1 --2- 172.21.15.121:0/3909628843 >> v2:172.21.15.102:3300/0 conn(0x7fbe7c0b1910 0x7fbe7c0ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe7a59c700 1 -- 172.21.15.121:0/3909628843 >> v2:172.21.15.102:3300/0 conn(0x7fbe7c0b1910 msgr2=0x7fbe7c0ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe7a59c700 1 --2- 172.21.15.121:0/3909628843 >> v2:172.21.15.102:3300/0 conn(0x7fbe7c0b1910 0x7fbe7c0ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe7a59c700 1 -- 172.21.15.121:0/3909628843 >> v1:172.21.15.121:6789/0 conn(0x7fbe7c0adf50 legacy=0x7fbe7c0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe7a59c700 1 -- 172.21.15.121:0/3909628843 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c0ca0e0 con 0x7fbe7c155e70 2024-08-17T02:25:39.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe7a59c700 1 --2- 172.21.15.121:0/3909628843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe7c155e70 0x7fbe7c0ada10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0098e0 tx=0x7fbe6c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a78cfc2f93cfed49 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe7959a700 1 -- 172.21.15.121:0/3909628843 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c00b640 con 0x7fbe7c155e70 2024-08-17T02:25:39.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe7959a700 1 -- 172.21.15.121:0/3909628843 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c00b7a0 con 0x7fbe7c155e70 2024-08-17T02:25:39.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe7959a700 1 -- 172.21.15.121:0/3909628843 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c00bb40 con 0x7fbe7c155e70 2024-08-17T02:25:39.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe80be4700 1 -- 172.21.15.121:0/3909628843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe7c155e70 msgr2=0x7fbe7c0ada10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe80be4700 1 --2- 172.21.15.121:0/3909628843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe7c155e70 0x7fbe7c0ada10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0098e0 tx=0x7fbe6c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe80be4700 1 -- 172.21.15.121:0/3909628843 shutdown_connections 2024-08-17T02:25:39.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe80be4700 1 --2- 172.21.15.121:0/3909628843 >> v2:172.21.15.102:3300/0 conn(0x7fbe7c0b1910 0x7fbe7c0ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe80be4700 1 --2- 172.21.15.121:0/3909628843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe7c155e70 0x7fbe7c0ada10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe80be4700 1 -- 172.21.15.121:0/3909628843 >> 172.21.15.121:0/3909628843 conn(0x7fbe7c0687a0 msgr2=0x7fbe7c06c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe80be4700 1 -- 172.21.15.121:0/3909628843 shutdown_connections 2024-08-17T02:25:39.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe80be4700 1 -- 172.21.15.121:0/3909628843 wait complete. 2024-08-17T02:25:39.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe80be4700 1 Processor -- start 2024-08-17T02:25:39.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.888+0000 7fbe80be4700 1 -- start start 2024-08-17T02:25:39.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe80be4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe7c0b1910 0x7fbe7c158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe80be4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe7c155e70 0x7fbe7c151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe80be4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe7c156710 0x7fbe7c1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe80be4700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c167730 con 0x7fbe7c155e70 2024-08-17T02:25:39.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe80be4700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c156bf0 con 0x7fbe7c0b1910 2024-08-17T02:25:39.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe80be4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c156ed0 con 0x7fbe7c156710 2024-08-17T02:25:39.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe7a59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe7c0b1910 0x7fbe7c158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe7ad9d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe7c156710 0x7fbe7c1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe7a59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe7c0b1910 0x7fbe7c158a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42940/0 (socket says 172.21.15.121:42940) 2024-08-17T02:25:39.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe7a59c700 1 -- 172.21.15.121:0/3244302578 learned_addr learned my addr 172.21.15.121:0/3244302578 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-17T02:25:39.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe79d9b700 1 --2- 172.21.15.121:0/3244302578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe7c155e70 0x7fbe7c151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe7a59c700 1 -- 172.21.15.121:0/3244302578 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe7c156710 msgr2=0x7fbe7c1524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe7a59c700 1 --2- 172.21.15.121:0/3244302578 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe7c156710 0x7fbe7c1524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe7a59c700 1 -- 172.21.15.121:0/3244302578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe7c155e70 msgr2=0x7fbe7c151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe7a59c700 1 --2- 172.21.15.121:0/3244302578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe7c155e70 0x7fbe7c151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe7a59c700 1 -- 172.21.15.121:0/3244302578 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c009420 con 0x7fbe7c0b1910 2024-08-17T02:25:39.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe7a59c700 1 --2- 172.21.15.121:0/3244302578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe7c0b1910 0x7fbe7c158a50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0c9f40 tx=0x7fbe6c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe6a7fc700 1 -- 172.21.15.121:0/3244302578 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c00b910 con 0x7fbe7c0b1910 2024-08-17T02:25:39.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe6a7fc700 1 -- 172.21.15.121:0/3244302578 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c00ba70 con 0x7fbe7c0b1910 2024-08-17T02:25:39.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe80be4700 1 -- 172.21.15.121:0/3244302578 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7c1571b0 con 0x7fbe7c0b1910 2024-08-17T02:25:39.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe6a7fc700 1 -- 172.21.15.121:0/3244302578 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c011670 con 0x7fbe7c0b1910 2024-08-17T02:25:39.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe80be4700 1 -- 172.21.15.121:0/3244302578 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c0cc7e0 con 0x7fbe7c0b1910 2024-08-17T02:25:39.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe6a7fc700 1 -- 172.21.15.121:0/3244302578 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fbe6c011aa0 con 0x7fbe7c0b1910 2024-08-17T02:25:39.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe6a7fc700 1 -- 172.21.15.121:0/3244302578 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fbe6c02eab0 con 0x7fbe7c0b1910 2024-08-17T02:25:39.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.892+0000 7fbe80be4700 1 -- 172.21.15.121:0/3244302578 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7c0645c0 con 0x7fbe7c0b1910 2024-08-17T02:25:39.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.896+0000 7fbe6a7fc700 1 -- 172.21.15.121:0/3244302578 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fbe6c0447a0 con 0x7fbe7c0b1910 2024-08-17T02:25:39.943 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:39.937+0000 7f85fa208000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:25:39.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.972+0000 7fbe80be4700 1 -- 172.21.15.121:0/3244302578 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9ad2af3c-bdff-438b-8d29-1cdd17af3599", "id": 3} v 0) v1 -- 0x7fbe7c06b870 con 0x7fbe7c0b1910 2024-08-17T02:25:39.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.984+0000 7fbe6a7fc700 1 -- 172.21.15.121:0/3244302578 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9ad2af3c-bdff-438b-8d29-1cdd17af3599", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbe6c033070 con 0x7fbe7c0b1910 2024-08-17T02:25:39.986 INFO:teuthology.orchestra.run.smithi121.stdout:3 2024-08-17T02:25:39.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.984+0000 7fbe80be4700 1 -- 172.21.15.121:0/3244302578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe7c0b1910 msgr2=0x7fbe7c158a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.984+0000 7fbe80be4700 1 --2- 172.21.15.121:0/3244302578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe7c0b1910 0x7fbe7c158a50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0c9f40 tx=0x7fbe6c017000 comp rx=0 tx=0).stop 2024-08-17T02:25:39.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.984+0000 7fbe80be4700 1 -- 172.21.15.121:0/3244302578 shutdown_connections 2024-08-17T02:25:39.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.984+0000 7fbe80be4700 1 --2- 172.21.15.121:0/3244302578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe7c155e70 0x7fbe7c151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.984+0000 7fbe80be4700 1 --2- 172.21.15.121:0/3244302578 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe7c156710 0x7fbe7c1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.984+0000 7fbe80be4700 1 --2- 172.21.15.121:0/3244302578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe7c0b1910 0x7fbe7c158a50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.984+0000 7fbe80be4700 1 -- 172.21.15.121:0/3244302578 >> 172.21.15.121:0/3244302578 conn(0x7fbe7c0687a0 msgr2=0x7fbe7c1532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.984+0000 7fbe80be4700 1 -- 172.21.15.121:0/3244302578 shutdown_connections 2024-08-17T02:25:39.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:39.984+0000 7fbe80be4700 1 -- 172.21.15.121:0/3244302578 wait complete. 2024-08-17T02:25:40.002 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 2c1f8841-af06-4ba3-94c9-128a175af9ff 4 2024-08-17T02:25:40.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.104+0000 7f191ffff700 1 Processor -- start 2024-08-17T02:25:40.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.104+0000 7f191ffff700 1 -- start start 2024-08-17T02:25:40.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191ffff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1920068db0 0x7f19200ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191ffff700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19200ac8b0 con 0x7f1920155c60 2024-08-17T02:25:40.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191ffff700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1920156740 con 0x7f192006a8e0 2024-08-17T02:25:40.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191ffff700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1920159830 con 0x7f1920068db0 2024-08-17T02:25:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191e7fc700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f192006a8e0 0x7f19200686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46904/0 (socket says 172.21.15.121:46904) 2024-08-17T02:25:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191e7fc700 1 -- 172.21.15.121:0/3637937956 learned_addr learned my addr 172.21.15.121:0/3637937956 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-08-17T02:25:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191f7fe700 1 --2- 172.21.15.121:0/3637937956 >> v2:172.21.15.121:3300/0 conn(0x7f1920068db0 0x7f19200ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191dffb700 1 -- 172.21.15.121:0/3637937956 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990025454 0 0) 0x7f1920156740 con 0x7f192006a8e0 2024-08-17T02:25:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191dffb700 1 -- 172.21.15.121:0/3637937956 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f190c003570 con 0x7f192006a8e0 2024-08-17T02:25:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191dffb700 1 -- 172.21.15.121:0/3637937956 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998808285 0 0) 0x7f19200ac8b0 con 0x7f1920155c60 2024-08-17T02:25:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191dffb700 1 -- 172.21.15.121:0/3637937956 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1920156740 con 0x7f1920155c60 2024-08-17T02:25:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191f7fe700 1 -- 172.21.15.121:0/3637937956 >> v1:172.21.15.121:6789/0 conn(0x7f192006a8e0 legacy=0x7f19200686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191f7fe700 1 -- 172.21.15.121:0/3637937956 >> v1:172.21.15.102:6789/0 conn(0x7f1920155c60 legacy=0x7f1920156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191f7fe700 1 -- 172.21.15.121:0/3637937956 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19200abca0 con 0x7f1920068db0 2024-08-17T02:25:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191f7fe700 1 --2- 172.21.15.121:0/3637937956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1920068db0 0x7f19200ab6c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1918009e60 tx=0x7f1918009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4048a48841326fd9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191dffb700 1 -- 172.21.15.121:0/3637937956 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191800e070 con 0x7f1920068db0 2024-08-17T02:25:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191dffb700 1 -- 172.21.15.121:0/3637937956 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191800bab0 con 0x7f1920068db0 2024-08-17T02:25:40.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191dffb700 1 -- 172.21.15.121:0/3637937956 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191800be70 con 0x7f1920068db0 2024-08-17T02:25:40.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191ffff700 1 -- 172.21.15.121:0/3637937956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1920068db0 msgr2=0x7f19200ab6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191ffff700 1 --2- 172.21.15.121:0/3637937956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1920068db0 0x7f19200ab6c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1918009e60 tx=0x7f1918009780 comp rx=0 tx=0).stop 2024-08-17T02:25:40.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191ffff700 1 -- 172.21.15.121:0/3637937956 shutdown_connections 2024-08-17T02:25:40.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191ffff700 1 --2- 172.21.15.121:0/3637937956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1920068db0 0x7f19200ab6c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191ffff700 1 -- 172.21.15.121:0/3637937956 >> 172.21.15.121:0/3637937956 conn(0x7f192006d820 msgr2=0x7f192006dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191ffff700 1 -- 172.21.15.121:0/3637937956 shutdown_connections 2024-08-17T02:25:40.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.108+0000 7f191ffff700 1 -- 172.21.15.121:0/3637937956 wait complete. 2024-08-17T02:25:40.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191ffff700 1 Processor -- start 2024-08-17T02:25:40.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191ffff700 1 -- start start 2024-08-17T02:25:40.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191ffff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1920068db0 0x7f19200aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191ffff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f192006a8e0 0x7f1920150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1920155c60 0x7f19201589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191ffff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192014bb30 con 0x7f192006a8e0 2024-08-17T02:25:40.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191ffff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192015a970 con 0x7f1920155c60 2024-08-17T02:25:40.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191ffff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1920159d60 con 0x7f1920068db0 2024-08-17T02:25:40.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191effd700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1920068db0 0x7f19200aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191effd700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1920068db0 0x7f19200aae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:36374/0 (socket says 172.21.15.121:36374) 2024-08-17T02:25:40.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191effd700 1 -- 172.21.15.121:0/3989401791 learned_addr learned my addr 172.21.15.121:0/3989401791 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-17T02:25:40.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191f7fe700 1 --2- 172.21.15.121:0/3989401791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1920155c60 0x7f19201589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191e7fc700 1 --2- 172.21.15.121:0/3989401791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f192006a8e0 0x7f1920150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191effd700 1 -- 172.21.15.121:0/3989401791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1920155c60 msgr2=0x7f19201589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191effd700 1 --2- 172.21.15.121:0/3989401791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1920155c60 0x7f19201589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191effd700 1 -- 172.21.15.121:0/3989401791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f192006a8e0 msgr2=0x7f1920150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191effd700 1 --2- 172.21.15.121:0/3989401791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f192006a8e0 0x7f1920150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191effd700 1 -- 172.21.15.121:0/3989401791 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1918009a20 con 0x7f1920068db0 2024-08-17T02:25:40.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.112+0000 7f191effd700 1 --2- 172.21.15.121:0/3989401791 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1920068db0 0x7f19200aae80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f191000c5b0 tx=0x7f1910007e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.116+0000 7f1916ffd700 1 -- 172.21.15.121:0/3989401791 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1910010510 con 0x7f1920068db0 2024-08-17T02:25:40.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.116+0000 7f1916ffd700 1 -- 172.21.15.121:0/3989401791 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1910010670 con 0x7f1920068db0 2024-08-17T02:25:40.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.116+0000 7f191ffff700 1 -- 172.21.15.121:0/3989401791 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192015a040 con 0x7f1920068db0 2024-08-17T02:25:40.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.116+0000 7f1916ffd700 1 -- 172.21.15.121:0/3989401791 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1910010a30 con 0x7f1920068db0 2024-08-17T02:25:40.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.116+0000 7f191ffff700 1 -- 172.21.15.121:0/3989401791 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192015a600 con 0x7f1920068db0 2024-08-17T02:25:40.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.116+0000 7f1916ffd700 1 -- 172.21.15.121:0/3989401791 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f191001b400 con 0x7f1920068db0 2024-08-17T02:25:40.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.116+0000 7f1916ffd700 1 -- 172.21.15.121:0/3989401791 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f1910010e20 con 0x7f1920068db0 2024-08-17T02:25:40.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.116+0000 7f191ffff700 1 -- 172.21.15.121:0/3989401791 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19200638f0 con 0x7f1920068db0 2024-08-17T02:25:40.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.120+0000 7f1916ffd700 1 -- 172.21.15.121:0/3989401791 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f191001b6b0 con 0x7f1920068db0 2024-08-17T02:25:40.182 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:40.177+0000 7f85fa208000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:25:40.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.224+0000 7f191ffff700 1 -- 172.21.15.121:0/3989401791 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2c1f8841-af06-4ba3-94c9-128a175af9ff", "id": 4} v 0) v1 -- 0x7f1920067360 con 0x7f1920068db0 2024-08-17T02:25:40.234 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:40.229+0000 7f85fa208000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:25:40.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.232+0000 7f1916ffd700 1 -- 172.21.15.121:0/3989401791 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c1f8841-af06-4ba3-94c9-128a175af9ff", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f191002a0b0 con 0x7f1920068db0 2024-08-17T02:25:40.237 INFO:teuthology.orchestra.run.smithi121.stdout:4 2024-08-17T02:25:40.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.236+0000 7f191ffff700 1 -- 172.21.15.121:0/3989401791 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1920068db0 msgr2=0x7f19200aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.236+0000 7f191ffff700 1 --2- 172.21.15.121:0/3989401791 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1920068db0 0x7f19200aae80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f191000c5b0 tx=0x7f1910007e10 comp rx=0 tx=0).stop 2024-08-17T02:25:40.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.236+0000 7f191ffff700 1 -- 172.21.15.121:0/3989401791 shutdown_connections 2024-08-17T02:25:40.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.236+0000 7f191ffff700 1 --2- 172.21.15.121:0/3989401791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f192006a8e0 0x7f1920150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.236+0000 7f191ffff700 1 --2- 172.21.15.121:0/3989401791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1920155c60 0x7f19201589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.236+0000 7f191ffff700 1 --2- 172.21.15.121:0/3989401791 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1920068db0 0x7f19200aae80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.236+0000 7f191ffff700 1 -- 172.21.15.121:0/3989401791 >> 172.21.15.121:0/3989401791 conn(0x7f192006d820 msgr2=0x7f1920156030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.236+0000 7f191ffff700 1 -- 172.21.15.121:0/3989401791 shutdown_connections 2024-08-17T02:25:40.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.236+0000 7f191ffff700 1 -- 172.21.15.121:0/3989401791 wait complete. 2024-08-17T02:25:40.255 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new a2428838-ec97-4b61-8f22-ad9fc1ce9771 5 2024-08-17T02:25:40.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.356+0000 7fe135599700 1 Processor -- start 2024-08-17T02:25:40.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.356+0000 7fe135599700 1 -- start start 2024-08-17T02:25:40.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe135599700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe130155e70 0x7fe1300ada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe135599700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1300c9b90 con 0x7fe1300adf50 2024-08-17T02:25:40.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe135599700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1300ae3d0 con 0x7fe1300b1910 2024-08-17T02:25:40.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe135599700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1300c9e00 con 0x7fe130155e70 2024-08-17T02:25:40.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe12f7fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe1300b1910 0x7fe1300ca600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46916/0 (socket says 172.21.15.121:46916) 2024-08-17T02:25:40.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe12f7fe700 1 -- 172.21.15.121:0/1040768136 learned_addr learned my addr 172.21.15.121:0/1040768136 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-08-17T02:25:40.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe12effd700 1 --2- 172.21.15.121:0/1040768136 >> v2:172.21.15.102:3300/0 conn(0x7fe130155e70 0x7fe1300ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe12dffb700 1 -- 172.21.15.121:0/1040768136 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504875270 0 0) 0x7fe1300ae3d0 con 0x7fe1300b1910 2024-08-17T02:25:40.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe12dffb700 1 -- 172.21.15.121:0/1040768136 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe118003570 con 0x7fe1300b1910 2024-08-17T02:25:40.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe12dffb700 1 -- 172.21.15.121:0/1040768136 <== mon.1 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4133853785 0 0) 0x7fe118003570 con 0x7fe1300b1910 2024-08-17T02:25:40.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe12effd700 1 -- 172.21.15.121:0/1040768136 >> v1:172.21.15.121:6789/0 conn(0x7fe1300b1910 legacy=0x7fe1300ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe12effd700 1 -- 172.21.15.121:0/1040768136 >> v1:172.21.15.102:6789/0 conn(0x7fe1300adf50 legacy=0x7fe1300b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe12effd700 1 -- 172.21.15.121:0/1040768136 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1300ca0e0 con 0x7fe130155e70 2024-08-17T02:25:40.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe12effd700 1 --2- 172.21.15.121:0/1040768136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe130155e70 0x7fe1300ada10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe1200098e0 tx=0x7fe1200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5271f3102452cdca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe12dffb700 1 -- 172.21.15.121:0/1040768136 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1280017f0 con 0x7fe130155e70 2024-08-17T02:25:40.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe12dffb700 1 -- 172.21.15.121:0/1040768136 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe120011420 con 0x7fe130155e70 2024-08-17T02:25:40.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe12dffb700 1 -- 172.21.15.121:0/1040768136 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1200117c0 con 0x7fe130155e70 2024-08-17T02:25:40.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe135599700 1 -- 172.21.15.121:0/1040768136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe130155e70 msgr2=0x7fe1300ada10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe135599700 1 --2- 172.21.15.121:0/1040768136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe130155e70 0x7fe1300ada10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe1200098e0 tx=0x7fe1200091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe135599700 1 -- 172.21.15.121:0/1040768136 shutdown_connections 2024-08-17T02:25:40.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe135599700 1 --2- 172.21.15.121:0/1040768136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe130155e70 0x7fe1300ada10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe135599700 1 -- 172.21.15.121:0/1040768136 >> 172.21.15.121:0/1040768136 conn(0x7fe1300687a0 msgr2=0x7fe13006c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe135599700 1 -- 172.21.15.121:0/1040768136 shutdown_connections 2024-08-17T02:25:40.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.360+0000 7fe135599700 1 -- 172.21.15.121:0/1040768136 wait complete. 2024-08-17T02:25:40.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe135599700 1 Processor -- start 2024-08-17T02:25:40.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe135599700 1 -- start start 2024-08-17T02:25:40.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe135599700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1300b1910 0x7fe13016a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe135599700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe130155e70 0x7fe130067690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe135599700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1300c6320 0x7fe130067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe135599700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13016a950 con 0x7fe130155e70 2024-08-17T02:25:40.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe135599700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300c7d80 con 0x7fe1300c6320 2024-08-17T02:25:40.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe135599700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300c67b0 con 0x7fe1300b1910 2024-08-17T02:25:40.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe12effd700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1300b1910 0x7fe13016a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe12effd700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1300b1910 0x7fe13016a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:36390/0 (socket says 172.21.15.121:36390) 2024-08-17T02:25:40.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe12f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1300c6320 0x7fe130067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe12effd700 1 -- 172.21.15.121:0/475438964 learned_addr learned my addr 172.21.15.121:0/475438964 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-17T02:25:40.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe12e7fc700 1 --2- 172.21.15.121:0/475438964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe130155e70 0x7fe130067690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe12effd700 1 -- 172.21.15.121:0/475438964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1300c6320 msgr2=0x7fe130067bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe12effd700 1 --2- 172.21.15.121:0/475438964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1300c6320 0x7fe130067bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe12effd700 1 -- 172.21.15.121:0/475438964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe130155e70 msgr2=0x7fe130067690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe12effd700 1 --2- 172.21.15.121:0/475438964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe130155e70 0x7fe130067690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe12effd700 1 -- 172.21.15.121:0/475438964 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe120009420 con 0x7fe1300b1910 2024-08-17T02:25:40.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe12e7fc700 1 --2- 172.21.15.121:0/475438964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe130155e70 0x7fe130067690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:40.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe12effd700 1 --2- 172.21.15.121:0/475438964 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1300b1910 0x7fe13016a410 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe1200030c0 tx=0x7fe120017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe116ffd700 1 -- 172.21.15.121:0/475438964 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe120010b70 con 0x7fe1300b1910 2024-08-17T02:25:40.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe116ffd700 1 -- 172.21.15.121:0/475438964 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe120010cf0 con 0x7fe1300b1910 2024-08-17T02:25:40.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe135599700 1 -- 172.21.15.121:0/475438964 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1300c6a90 con 0x7fe1300b1910 2024-08-17T02:25:40.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe116ffd700 1 -- 172.21.15.121:0/475438964 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12001d680 con 0x7fe1300b1910 2024-08-17T02:25:40.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe135599700 1 -- 172.21.15.121:0/475438964 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1300c7050 con 0x7fe1300b1910 2024-08-17T02:25:40.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe116ffd700 1 -- 172.21.15.121:0/475438964 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fe12001d9f0 con 0x7fe1300b1910 2024-08-17T02:25:40.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.364+0000 7fe116ffd700 1 -- 172.21.15.121:0/475438964 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fe120025980 con 0x7fe1300b1910 2024-08-17T02:25:40.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.368+0000 7fe135599700 1 -- 172.21.15.121:0/475438964 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1300645c0 con 0x7fe1300b1910 2024-08-17T02:25:40.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.368+0000 7fe116ffd700 1 -- 172.21.15.121:0/475438964 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fe120025b90 con 0x7fe1300b1910 2024-08-17T02:25:40.431 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:40.425+0000 7f85fa208000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:25:40.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.440+0000 7fe135599700 1 -- 172.21.15.121:0/475438964 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a2428838-ec97-4b61-8f22-ad9fc1ce9771", "id": 5} v 0) v1 -- 0x7fe1300b1000 con 0x7fe1300b1910 2024-08-17T02:25:40.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.452+0000 7fe116ffd700 1 -- 172.21.15.121:0/475438964 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a2428838-ec97-4b61-8f22-ad9fc1ce9771", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe120025d30 con 0x7fe1300b1910 2024-08-17T02:25:40.455 INFO:teuthology.orchestra.run.smithi121.stdout:5 2024-08-17T02:25:40.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.452+0000 7fe135599700 1 -- 172.21.15.121:0/475438964 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1300b1910 msgr2=0x7fe13016a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.452+0000 7fe135599700 1 --2- 172.21.15.121:0/475438964 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1300b1910 0x7fe13016a410 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe1200030c0 tx=0x7fe120017000 comp rx=0 tx=0).stop 2024-08-17T02:25:40.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.452+0000 7fe135599700 1 -- 172.21.15.121:0/475438964 shutdown_connections 2024-08-17T02:25:40.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.452+0000 7fe135599700 1 --2- 172.21.15.121:0/475438964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe130155e70 0x7fe130067690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.452+0000 7fe135599700 1 --2- 172.21.15.121:0/475438964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1300c6320 0x7fe130067bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.452+0000 7fe135599700 1 --2- 172.21.15.121:0/475438964 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe1300b1910 0x7fe13016a410 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.452+0000 7fe135599700 1 -- 172.21.15.121:0/475438964 >> 172.21.15.121:0/475438964 conn(0x7fe1300687a0 msgr2=0x7fe1300cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.452+0000 7fe135599700 1 -- 172.21.15.121:0/475438964 shutdown_connections 2024-08-17T02:25:40.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.452+0000 7fe135599700 1 -- 172.21.15.121:0/475438964 wait complete. 2024-08-17T02:25:40.469 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new b8c70c26-5b75-4054-aca3-628720883022 6 2024-08-17T02:25:40.496 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:40.489+0000 7f85fa208000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:25:40.517 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:40.512+0000 7f679f7ae000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:25:40.562 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:40.557+0000 7f85fa208000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:25:40.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.568+0000 7fa3bb59e700 1 Processor -- start 2024-08-17T02:25:40.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.568+0000 7fa3bb59e700 1 -- start start 2024-08-17T02:25:40.574 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:40.572+0000 7f679f7ae000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:25:40.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3bb59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3bc156060 0x7fa3bc0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3bb59e700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc06c020 con 0x7fa3bc155c90 2024-08-17T02:25:40.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3bb59e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc06b410 con 0x7fa3bc068be0 2024-08-17T02:25:40.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3bb59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc069080 con 0x7fa3bc156060 2024-08-17T02:25:40.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3b9d9b700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3bc156060 0x7fa3bc0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3bad9d700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa3bc068be0 0x7fa3bc0c6dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46928/0 (socket says 172.21.15.121:46928) 2024-08-17T02:25:40.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3b9d9b700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3bc156060 0x7fa3bc0686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:36394/0 (socket says 172.21.15.121:36394) 2024-08-17T02:25:40.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3bad9d700 1 -- 172.21.15.121:0/3794874641 learned_addr learned my addr 172.21.15.121:0/3794874641 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-08-17T02:25:40.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3b9d9b700 1 -- 172.21.15.121:0/3794874641 >> v1:172.21.15.121:6789/0 conn(0x7fa3bc068be0 legacy=0x7fa3bc0c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3b9d9b700 1 -- 172.21.15.121:0/3794874641 >> v1:172.21.15.102:6789/0 conn(0x7fa3bc155c90 legacy=0x7fa3bc06a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3b959a700 1 -- 172.21.15.121:0/3794874641 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775659141 0 0) 0x7fa3bc06b410 con 0x7fa3bc068be0 2024-08-17T02:25:40.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3b9d9b700 1 -- 172.21.15.121:0/3794874641 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc06b6f0 con 0x7fa3bc156060 2024-08-17T02:25:40.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3b9d9b700 1 --2- 172.21.15.121:0/3794874641 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3bc156060 0x7fa3bc0686a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009910 tx=0x7fa3b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae27be8a2e0071b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3b959a700 1 -- 172.21.15.121:0/3794874641 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b000b760 con 0x7fa3bc156060 2024-08-17T02:25:40.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3b959a700 1 -- 172.21.15.121:0/3794874641 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b000b8c0 con 0x7fa3bc156060 2024-08-17T02:25:40.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3b959a700 1 -- 172.21.15.121:0/3794874641 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b000bc60 con 0x7fa3bc156060 2024-08-17T02:25:40.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3bb59e700 1 -- 172.21.15.121:0/3794874641 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3bc156060 msgr2=0x7fa3bc0686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3bb59e700 1 --2- 172.21.15.121:0/3794874641 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3bc156060 0x7fa3bc0686a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009910 tx=0x7fa3b00091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3bb59e700 1 -- 172.21.15.121:0/3794874641 shutdown_connections 2024-08-17T02:25:40.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3bb59e700 1 --2- 172.21.15.121:0/3794874641 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3bc156060 0x7fa3bc0686a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3bb59e700 1 -- 172.21.15.121:0/3794874641 >> 172.21.15.121:0/3794874641 conn(0x7fa3bc0c9a80 msgr2=0x7fa3bc06d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3bb59e700 1 -- 172.21.15.121:0/3794874641 shutdown_connections 2024-08-17T02:25:40.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.572+0000 7fa3bb59e700 1 -- 172.21.15.121:0/3794874641 wait complete. 2024-08-17T02:25:40.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.576+0000 7fa3bb59e700 1 Processor -- start 2024-08-17T02:25:40.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.576+0000 7fa3bb59e700 1 -- start start 2024-08-17T02:25:40.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.576+0000 7fa3bb59e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3bc068be0 0x7fa3bc0af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.576+0000 7fa3bb59e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3bc155c90 0x7fa3bc14e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.576+0000 7fa3bb59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3bc156060 0x7fa3bc0c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.576+0000 7fa3bb59e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc156450 con 0x7fa3bc155c90 2024-08-17T02:25:40.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.576+0000 7fa3bb59e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0afbd0 con 0x7fa3bc068be0 2024-08-17T02:25:40.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.576+0000 7fa3bb59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0afeb0 con 0x7fa3bc156060 2024-08-17T02:25:40.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.576+0000 7fa3ba59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3bc068be0 0x7fa3bc0af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.576+0000 7fa3bad9d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3bc156060 0x7fa3bc0c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.576+0000 7fa3ba59c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3bc068be0 0x7fa3bc0af380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42968/0 (socket says 172.21.15.121:42968) 2024-08-17T02:25:40.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.576+0000 7fa3bad9d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3bc156060 0x7fa3bc0c1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.121:36400/0 (socket says 172.21.15.121:36400) 2024-08-17T02:25:40.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.576+0000 7fa3ba59c700 1 -- 172.21.15.121:0/1054215848 learned_addr learned my addr 172.21.15.121:0/1054215848 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-17T02:25:40.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.576+0000 7fa3b9d9b700 1 --2- 172.21.15.121:0/1054215848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3bc155c90 0x7fa3bc14e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.580+0000 7fa3bad9d700 1 -- 172.21.15.121:0/1054215848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3bc068be0 msgr2=0x7fa3bc0af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.580+0000 7fa3bad9d700 1 --2- 172.21.15.121:0/1054215848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3bc068be0 0x7fa3bc0af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.580+0000 7fa3bad9d700 1 -- 172.21.15.121:0/1054215848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3bc155c90 msgr2=0x7fa3bc14e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.580+0000 7fa3bad9d700 1 --2- 172.21.15.121:0/1054215848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3bc155c90 0x7fa3bc14e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.580+0000 7fa3bad9d700 1 -- 172.21.15.121:0/1054215848 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0009420 con 0x7fa3bc156060 2024-08-17T02:25:40.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.580+0000 7fa3bad9d700 1 --2- 172.21.15.121:0/1054215848 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3bc156060 0x7fa3bc0c1ff0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400cb60 tx=0x7fa3b40018e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.580+0000 7fa3aa7fc700 1 -- 172.21.15.121:0/1054215848 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b400a7e0 con 0x7fa3bc156060 2024-08-17T02:25:40.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.580+0000 7fa3aa7fc700 1 -- 172.21.15.121:0/1054215848 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b400a960 con 0x7fa3bc156060 2024-08-17T02:25:40.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.580+0000 7fa3bb59e700 1 -- 172.21.15.121:0/1054215848 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3bc0b0190 con 0x7fa3bc156060 2024-08-17T02:25:40.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.580+0000 7fa3aa7fc700 1 -- 172.21.15.121:0/1054215848 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b400ad20 con 0x7fa3bc156060 2024-08-17T02:25:40.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.580+0000 7fa3bb59e700 1 -- 172.21.15.121:0/1054215848 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3bc0af8c0 con 0x7fa3bc156060 2024-08-17T02:25:40.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.580+0000 7fa3aa7fc700 1 -- 172.21.15.121:0/1054215848 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa3b4007300 con 0x7fa3bc156060 2024-08-17T02:25:40.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.580+0000 7fa3aa7fc700 1 -- 172.21.15.121:0/1054215848 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fa3b401ba00 con 0x7fa3bc156060 2024-08-17T02:25:40.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.580+0000 7fa3bb59e700 1 -- 172.21.15.121:0/1054215848 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3bc1568a0 con 0x7fa3bc156060 2024-08-17T02:25:40.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.584+0000 7fa3aa7fc700 1 -- 172.21.15.121:0/1054215848 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fa3b4007740 con 0x7fa3bc156060 2024-08-17T02:25:40.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.660+0000 7fa3bb59e700 1 -- 172.21.15.121:0/1054215848 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b8c70c26-5b75-4054-aca3-628720883022", "id": 6} v 0) v1 -- 0x7fa3bc064330 con 0x7fa3bc156060 2024-08-17T02:25:40.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.668+0000 7fa3aa7fc700 1 -- 172.21.15.121:0/1054215848 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b8c70c26-5b75-4054-aca3-628720883022", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa3b402a0b0 con 0x7fa3bc156060 2024-08-17T02:25:40.673 INFO:teuthology.orchestra.run.smithi121.stdout:6 2024-08-17T02:25:40.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.672+0000 7fa3bb59e700 1 -- 172.21.15.121:0/1054215848 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3bc156060 msgr2=0x7fa3bc0c1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.672+0000 7fa3bb59e700 1 --2- 172.21.15.121:0/1054215848 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3bc156060 0x7fa3bc0c1ff0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400cb60 tx=0x7fa3b40018e0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.672+0000 7fa3bb59e700 1 -- 172.21.15.121:0/1054215848 shutdown_connections 2024-08-17T02:25:40.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.672+0000 7fa3bb59e700 1 --2- 172.21.15.121:0/1054215848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3bc155c90 0x7fa3bc14e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.672+0000 7fa3bb59e700 1 --2- 172.21.15.121:0/1054215848 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa3bc156060 0x7fa3bc0c1ff0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.672+0000 7fa3bb59e700 1 --2- 172.21.15.121:0/1054215848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3bc068be0 0x7fa3bc0af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.672+0000 7fa3bb59e700 1 -- 172.21.15.121:0/1054215848 >> 172.21.15.121:0/1054215848 conn(0x7fa3bc0c9a80 msgr2=0x7fa3bc0c7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.672+0000 7fa3bb59e700 1 -- 172.21.15.121:0/1054215848 shutdown_connections 2024-08-17T02:25:40.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.672+0000 7fa3bb59e700 1 -- 172.21.15.121:0/1054215848 wait complete. 2024-08-17T02:25:40.686 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 492af925-add4-465d-9bc5-e01a7ebff78e 7 2024-08-17T02:25:40.691 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:40.688+0000 7f679f7ae000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:25:40.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedd48ef700 1 Processor -- start 2024-08-17T02:25:40.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedd48ef700 1 -- start start 2024-08-17T02:25:40.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedd48ef700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fedd0156d80 0x7fedd00b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedd48ef700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fedd00cbd60 0x7fedd00ac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedd48ef700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd00ca700 con 0x7fedd0157150 2024-08-17T02:25:40.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedd48ef700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd00b21c0 con 0x7fedd0156d80 2024-08-17T02:25:40.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedd48ef700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd00b24a0 con 0x7fedd00cbd60 2024-08-17T02:25:40.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedce59c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fedd00cbd60 0x7fedd00ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedce59c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fedd00cbd60 0x7fedd00ac070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42980/0 (socket says 172.21.15.121:42980) 2024-08-17T02:25:40.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedce59c700 1 -- 172.21.15.121:0/1308280583 learned_addr learned my addr 172.21.15.121:0/1308280583 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-17T02:25:40.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedced9d700 1 --2- 172.21.15.121:0/1308280583 >> v2:172.21.15.102:3300/0 conn(0x7fedd0156d80 0x7fedd00b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedce59c700 1 -- 172.21.15.121:0/1308280583 >> v2:172.21.15.102:3300/0 conn(0x7fedd0156d80 msgr2=0x7fedd00b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:40.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedce59c700 1 --2- 172.21.15.121:0/1308280583 >> v2:172.21.15.102:3300/0 conn(0x7fedd0156d80 0x7fedd00b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedce59c700 1 -- 172.21.15.121:0/1308280583 >> v1:172.21.15.102:6789/0 conn(0x7fedd0157150 legacy=0x7fedd00cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedce59c700 1 -- 172.21.15.121:0/1308280583 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd00ca390 con 0x7fedd00cbd60 2024-08-17T02:25:40.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedce59c700 1 --2- 172.21.15.121:0/1308280583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedd00cbd60 0x7fedd00ac070 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fedd00cc560 tx=0x7fedc0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=927d01024fa8f407 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedcdd9b700 1 -- 172.21.15.121:0/1308280583 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0009e70 con 0x7fedd00cbd60 2024-08-17T02:25:40.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedcdd9b700 1 -- 172.21.15.121:0/1308280583 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc000b860 con 0x7fedd00cbd60 2024-08-17T02:25:40.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.792+0000 7fedcdd9b700 1 -- 172.21.15.121:0/1308280583 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc000bc20 con 0x7fedd00cbd60 2024-08-17T02:25:40.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedd48ef700 1 -- 172.21.15.121:0/1308280583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedd00cbd60 msgr2=0x7fedd00ac070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedd48ef700 1 --2- 172.21.15.121:0/1308280583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedd00cbd60 0x7fedd00ac070 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fedd00cc560 tx=0x7fedc0009250 comp rx=0 tx=0).stop 2024-08-17T02:25:40.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedd48ef700 1 -- 172.21.15.121:0/1308280583 shutdown_connections 2024-08-17T02:25:40.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedd48ef700 1 --2- 172.21.15.121:0/1308280583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedd00cbd60 0x7fedd00ac070 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedd48ef700 1 --2- 172.21.15.121:0/1308280583 >> v2:172.21.15.102:3300/0 conn(0x7fedd0156d80 0x7fedd00b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedd48ef700 1 -- 172.21.15.121:0/1308280583 >> 172.21.15.121:0/1308280583 conn(0x7fedd006e310 msgr2=0x7fedd006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedd48ef700 1 -- 172.21.15.121:0/1308280583 shutdown_connections 2024-08-17T02:25:40.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedd48ef700 1 -- 172.21.15.121:0/1308280583 wait complete. 2024-08-17T02:25:40.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedd48ef700 1 Processor -- start 2024-08-17T02:25:40.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedd48ef700 1 -- start start 2024-08-17T02:25:40.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedd48ef700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fedd00cbd60 0x7fedd0154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedd48ef700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedd0156d80 0x7fedd016a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedd48ef700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedd0157150 0x7fedd0144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedd48ef700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd00c4a80 con 0x7fedd0156d80 2024-08-17T02:25:40.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedd48ef700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd016acf0 con 0x7fedd0157150 2024-08-17T02:25:40.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedd48ef700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd016afd0 con 0x7fedd00cbd60 2024-08-17T02:25:40.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedcf59e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedd0157150 0x7fedd0144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedcf59e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedd0157150 0x7fedd0144ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42984/0 (socket says 172.21.15.121:42984) 2024-08-17T02:25:40.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedced9d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fedd00cbd60 0x7fedd0154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedcf59e700 1 -- 172.21.15.121:0/2517720446 learned_addr learned my addr 172.21.15.121:0/2517720446 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-17T02:25:40.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedce59c700 1 --2- 172.21.15.121:0/2517720446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedd0156d80 0x7fedd016a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedced9d700 1 -- 172.21.15.121:0/2517720446 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedd0157150 msgr2=0x7fedd0144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedced9d700 1 --2- 172.21.15.121:0/2517720446 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedd0157150 0x7fedd0144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedced9d700 1 -- 172.21.15.121:0/2517720446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedd0156d80 msgr2=0x7fedd016a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedced9d700 1 --2- 172.21.15.121:0/2517720446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedd0156d80 0x7fedd016a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedced9d700 1 -- 172.21.15.121:0/2517720446 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc00094f0 con 0x7fedd00cbd60 2024-08-17T02:25:40.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.796+0000 7fedcf59e700 1 --2- 172.21.15.121:0/2517720446 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedd0157150 0x7fedd0144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:40.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.800+0000 7fedced9d700 1 --2- 172.21.15.121:0/2517720446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fedd00cbd60 0x7fedd0154ac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009ef0 tx=0x7fedc800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.800+0000 7fedc6ffd700 1 -- 172.21.15.121:0/2517720446 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc800cb70 con 0x7fedd00cbd60 2024-08-17T02:25:40.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.800+0000 7fedc6ffd700 1 -- 172.21.15.121:0/2517720446 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc800f040 con 0x7fedd00cbd60 2024-08-17T02:25:40.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.800+0000 7fedc6ffd700 1 -- 172.21.15.121:0/2517720446 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc8014480 con 0x7fedd00cbd60 2024-08-17T02:25:40.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.800+0000 7fedd48ef700 1 -- 172.21.15.121:0/2517720446 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd00c4710 con 0x7fedd00cbd60 2024-08-17T02:25:40.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.800+0000 7fedd48ef700 1 -- 172.21.15.121:0/2517720446 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd0155000 con 0x7fedd00cbd60 2024-08-17T02:25:40.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.800+0000 7fedc6ffd700 1 -- 172.21.15.121:0/2517720446 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fedc8014ac0 con 0x7fedd00cbd60 2024-08-17T02:25:40.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.800+0000 7fedc6ffd700 1 -- 172.21.15.121:0/2517720446 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fedc801dd40 con 0x7fedd00cbd60 2024-08-17T02:25:40.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.800+0000 7fedd48ef700 1 -- 172.21.15.121:0/2517720446 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd00c4570 con 0x7fedd00cbd60 2024-08-17T02:25:40.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.804+0000 7fedc6ffd700 1 -- 172.21.15.121:0/2517720446 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fedc803b7a0 con 0x7fedd00cbd60 2024-08-17T02:25:40.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.880+0000 7fedd48ef700 1 -- 172.21.15.121:0/2517720446 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd new", "uuid": "492af925-add4-465d-9bc5-e01a7ebff78e", "id": 7} v 0) v1 -- 0x7fedd016b1f0 con 0x7fedd00cbd60 2024-08-17T02:25:40.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.892+0000 7fedc6ffd700 1 -- 172.21.15.121:0/2517720446 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "492af925-add4-465d-9bc5-e01a7ebff78e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fedc802a070 con 0x7fedd00cbd60 2024-08-17T02:25:40.894 INFO:teuthology.orchestra.run.smithi121.stdout:7 2024-08-17T02:25:40.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.892+0000 7fedd48ef700 1 -- 172.21.15.121:0/2517720446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fedd00cbd60 msgr2=0x7fedd0154ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.892+0000 7fedd48ef700 1 --2- 172.21.15.121:0/2517720446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fedd00cbd60 0x7fedd0154ac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009ef0 tx=0x7fedc800b040 comp rx=0 tx=0).stop 2024-08-17T02:25:40.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.892+0000 7fedd48ef700 1 -- 172.21.15.121:0/2517720446 shutdown_connections 2024-08-17T02:25:40.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.892+0000 7fedd48ef700 1 --2- 172.21.15.121:0/2517720446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedd0156d80 0x7fedd016a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.892+0000 7fedd48ef700 1 --2- 172.21.15.121:0/2517720446 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedd0157150 0x7fedd0144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.892+0000 7fedd48ef700 1 --2- 172.21.15.121:0/2517720446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fedd00cbd60 0x7fedd0154ac0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.892+0000 7fedd48ef700 1 -- 172.21.15.121:0/2517720446 >> 172.21.15.121:0/2517720446 conn(0x7fedd006e310 msgr2=0x7fedd0068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.892+0000 7fedd48ef700 1 -- 172.21.15.121:0/2517720446 shutdown_connections 2024-08-17T02:25:40.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-17T02:25:40.892+0000 7fedd48ef700 1 -- 172.21.15.121:0/2517720446 wait complete. 2024-08-17T02:25:40.911 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:25:40.911 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:25:40.913 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:25:40.913 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:25:40.914 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:25:40.916 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:25:40.916 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:25:40.916 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:25:40.918 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:25:40.919 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:25:40.919 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:25:40.921 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:25:40.921 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:25:40.921 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:25:40.923 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:25:40.923 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:25:40.923 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:25:40.925 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:25:40.926 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:25:40.926 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:25:40.927 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:40.924+0000 7f679f7ae000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:25:40.927 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:25:40.928 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:25:40.928 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:25:40.929 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:25:40.930 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:40.999 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:40.996+0000 7f679f7ae000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:25:41.043 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:41.037+0000 7f85fa208000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:25:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4f0531f700 1 Processor -- start 2024-08-17T02:25:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4f0531f700 1 -- start start 2024-08-17T02:25:41.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4f0531f700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f00156c40 0x7f4f000cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4f0531f700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f00157010 0x7f4f000686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4f0531f700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f001585b0 con 0x7f4f00157420 2024-08-17T02:25:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4f0531f700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f000c9fd0 con 0x7f4f00157010 2024-08-17T02:25:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4f0531f700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f001579c0 con 0x7f4f00156c40 2024-08-17T02:25:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4eff7fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f00157010 0x7f4f000686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4eff7fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f00157010 0x7f4f000686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37208/0 (socket says 172.21.15.102:37208) 2024-08-17T02:25:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4eff7fe700 1 -- 172.21.15.102:0/3982074180 learned_addr learned my addr 172.21.15.102:0/3982074180 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4f04b1e700 1 --1- 172.21.15.102:0/3982074180 >> v1:172.21.15.102:6789/0 conn(0x7f4f00157420 0x7f4f0015ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:58904/0 (socket says 172.21.15.102:58904) 2024-08-17T02:25:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4efffff700 1 --2- 172.21.15.102:0/3982074180 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f00156c40 0x7f4f000cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4eff7fe700 1 -- 172.21.15.102:0/3982074180 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f00156c40 msgr2=0x7f4f000cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4eff7fe700 1 --2- 172.21.15.102:0/3982074180 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f00156c40 0x7f4f000cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4eff7fe700 1 -- 172.21.15.102:0/3982074180 >> v1:172.21.15.102:6789/0 conn(0x7f4f00157420 legacy=0x7f4f0015ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4eff7fe700 1 -- 172.21.15.102:0/3982074180 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f00157c80 con 0x7f4f00157010 2024-08-17T02:25:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4eff7fe700 1 --2- 172.21.15.102:0/3982074180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f00157010 0x7f4f000686a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40099b0 tx=0x7f4ef4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f71b38285bbb7d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4efeffd700 1 -- 172.21.15.102:0/3982074180 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef400b860 con 0x7f4f00157010 2024-08-17T02:25:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4efeffd700 1 -- 172.21.15.102:0/3982074180 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef400b9c0 con 0x7f4f00157010 2024-08-17T02:25:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4efeffd700 1 -- 172.21.15.102:0/3982074180 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef400bd60 con 0x7f4f00157010 2024-08-17T02:25:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4f0531f700 1 -- 172.21.15.102:0/3982074180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f00157010 msgr2=0x7f4f000686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4f0531f700 1 --2- 172.21.15.102:0/3982074180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f00157010 0x7f4f000686a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40099b0 tx=0x7f4ef4009250 comp rx=0 tx=0).stop 2024-08-17T02:25:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4f0531f700 1 -- 172.21.15.102:0/3982074180 shutdown_connections 2024-08-17T02:25:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4f0531f700 1 --2- 172.21.15.102:0/3982074180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f00157010 0x7f4f000686a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4f0531f700 1 --2- 172.21.15.102:0/3982074180 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f00156c40 0x7f4f000cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4f0531f700 1 -- 172.21.15.102:0/3982074180 >> 172.21.15.102:0/3982074180 conn(0x7f4f0006d800 msgr2=0x7f4f0006dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4f0531f700 1 -- 172.21.15.102:0/3982074180 shutdown_connections 2024-08-17T02:25:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.041+0000 7f4f0531f700 1 -- 172.21.15.102:0/3982074180 wait complete. 2024-08-17T02:25:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4f0531f700 1 Processor -- start 2024-08-17T02:25:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4f0531f700 1 -- start start 2024-08-17T02:25:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4f0531f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f00156c40 0x7f4f0014cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4f0531f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f00157010 0x7f4f000af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4f0531f700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f00157420 0x7f4f00151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4f0531f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000b0ae0 con 0x7f4f00156c40 2024-08-17T02:25:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4f0531f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000afed0 con 0x7f4f00157010 2024-08-17T02:25:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4f0531f700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000b01b0 con 0x7f4f00157420 2024-08-17T02:25:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4efffff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f00156c40 0x7f4f0014cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4efffff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f00156c40 0x7f4f0014cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37222/0 (socket says 172.21.15.102:37222) 2024-08-17T02:25:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4efffff700 1 -- 172.21.15.102:0/3685423121 learned_addr learned my addr 172.21.15.102:0/3685423121 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4eff7fe700 1 --2- 172.21.15.102:0/3685423121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f00157010 0x7f4f000af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4f04b1e700 1 --2- 172.21.15.102:0/3685423121 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f00157420 0x7f4f00151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4efffff700 1 -- 172.21.15.102:0/3685423121 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f00157420 msgr2=0x7f4f00151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4efffff700 1 --2- 172.21.15.102:0/3685423121 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f00157420 0x7f4f00151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4efffff700 1 -- 172.21.15.102:0/3685423121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f00157010 msgr2=0x7f4f000af4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4efffff700 1 --2- 172.21.15.102:0/3685423121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f00157010 0x7f4f000af4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4efffff700 1 -- 172.21.15.102:0/3685423121 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef40094f0 con 0x7f4f00156c40 2024-08-17T02:25:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.045+0000 7f4efffff700 1 --2- 172.21.15.102:0/3685423121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f00156c40 0x7f4f0014cd10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000d890 tx=0x7f4ef0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.049+0000 7f4ee7fff700 1 -- 172.21.15.102:0/3685423121 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef00125f0 con 0x7f4f00156c40 2024-08-17T02:25:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.049+0000 7f4ee7fff700 1 -- 172.21.15.102:0/3685423121 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef0012750 con 0x7f4f00156c40 2024-08-17T02:25:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.049+0000 7f4ee7fff700 1 -- 172.21.15.102:0/3685423121 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0012af0 con 0x7f4f00156c40 2024-08-17T02:25:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.049+0000 7f4f0531f700 1 -- 172.21.15.102:0/3685423121 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f000b0490 con 0x7f4f00156c40 2024-08-17T02:25:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.049+0000 7f4f0531f700 1 -- 172.21.15.102:0/3685423121 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0014d250 con 0x7f4f00156c40 2024-08-17T02:25:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.049+0000 7f4ee7fff700 1 -- 172.21.15.102:0/3685423121 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f4ef001e6f0 con 0x7f4f00156c40 2024-08-17T02:25:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.049+0000 7f4ee7fff700 1 -- 172.21.15.102:0/3685423121 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f4ef0014b10 con 0x7f4f00156c40 2024-08-17T02:25:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.049+0000 7f4f0531f700 1 -- 172.21.15.102:0/3685423121 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f000638f0 con 0x7f4f00156c40 2024-08-17T02:25:41.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.053+0000 7f4ee7fff700 1 -- 172.21.15.102:0/3685423121 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f4ef0014df0 con 0x7f4f00156c40 2024-08-17T02:25:41.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.117+0000 7f4f0531f700 1 -- 172.21.15.102:0/3685423121 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f0006e590 con 0x7f4f00156c40 2024-08-17T02:25:41.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.117+0000 7f4ee7fff700 1 -- 172.21.15.102:0/3685423121 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f4ef001ea40 con 0x7f4f00156c40 2024-08-17T02:25:41.124 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:41.124 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":10,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:40.883633+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:41.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.117+0000 7f4f0531f700 1 -- 172.21.15.102:0/3685423121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f00156c40 msgr2=0x7f4f0014cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.117+0000 7f4f0531f700 1 --2- 172.21.15.102:0/3685423121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f00156c40 0x7f4f0014cd10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000d890 tx=0x7f4ef0008040 comp rx=0 tx=0).stop 2024-08-17T02:25:41.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.117+0000 7f4f0531f700 1 -- 172.21.15.102:0/3685423121 shutdown_connections 2024-08-17T02:25:41.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.117+0000 7f4f0531f700 1 --2- 172.21.15.102:0/3685423121 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f00157420 0x7f4f00151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.117+0000 7f4f0531f700 1 --2- 172.21.15.102:0/3685423121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f00157010 0x7f4f000af4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.117+0000 7f4f0531f700 1 --2- 172.21.15.102:0/3685423121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f00156c40 0x7f4f0014cd10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.117+0000 7f4f0531f700 1 -- 172.21.15.102:0/3685423121 >> 172.21.15.102:0/3685423121 conn(0x7f4f0006d800 msgr2=0x7f4f00159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:41.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.117+0000 7f4f0531f700 1 -- 172.21.15.102:0/3685423121 shutdown_connections 2024-08-17T02:25:41.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:41.117+0000 7f4f0531f700 1 -- 172.21.15.102:0/3685423121 wait complete. 2024-08-17T02:25:41.137 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:25:41.137 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:25:41.159 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:41.156+0000 7f679f7ae000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:25:41.167 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:41.161+0000 7f85fa208000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:25:41.217 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:41.212+0000 7f679f7ae000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:25:41.278 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:41.272+0000 7f679f7ae000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:25:41.295 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-08-17T02:25:41.289+0000 7f68d80603c0 -1 Falling back to public interface 2024-08-17T02:25:41.306 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-08-17T02:25:41.301+0000 7f7bb66673c0 -1 Falling back to public interface 2024-08-17T02:25:41.312 INFO:tasks.ceph.osd.7.smithi121.stderr:2024-08-17T02:25:41.308+0000 7f8d904e63c0 -1 Falling back to public interface 2024-08-17T02:25:41.318 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-08-17T02:25:41.313+0000 7fb20f5513c0 -1 Falling back to public interface 2024-08-17T02:25:41.479 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:41.473+0000 7f85fa208000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:25:41.523 INFO:tasks.ceph.osd.5.smithi121.stderr:2024-08-17T02:25:41.520+0000 7f4194e523c0 -1 Falling back to public interface 2024-08-17T02:25:41.543 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-08-17T02:25:41.537+0000 7f42755903c0 -1 Falling back to public interface 2024-08-17T02:25:41.547 INFO:tasks.ceph.osd.6.smithi121.stderr:2024-08-17T02:25:41.544+0000 7f35af8013c0 -1 Falling back to public interface 2024-08-17T02:25:41.555 INFO:tasks.ceph.osd.4.smithi121.stderr:2024-08-17T02:25:41.552+0000 7fcde3b043c0 -1 Falling back to public interface 2024-08-17T02:25:41.641 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:41.633+0000 7f85fa208000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:25:41.677 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:41.672+0000 7f679f7ae000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:25:41.707 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:41.701+0000 7f85fa208000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:25:41.758 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:41.753+0000 7f85fa208000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:25:41.789 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:41.784+0000 7f679f7ae000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:25:41.815 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:41.809+0000 7f85fa208000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:25:41.942 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:41.979 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:41.973+0000 7f85fa208000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:25:42.042 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.033+0000 7f9e2d087700 1 Processor -- start 2024-08-17T02:25:42.042 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.033+0000 7f9e2d087700 1 -- start start 2024-08-17T02:25:42.046 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e2d087700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9e280ac700 0x7f9e2806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.046 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e2d087700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e280b00c0 con 0x7f9e280abc20 2024-08-17T02:25:42.046 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e2d087700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e280b0950 con 0x7f9e280b0550 2024-08-17T02:25:42.046 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e2d087700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e280af570 con 0x7f9e280ac700 2024-08-17T02:25:42.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e27fff700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f9e280abc20 0x7f9e280aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45698/0 (socket says 172.21.15.102:45698) 2024-08-17T02:25:42.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e27fff700 1 -- 172.21.15.102:0/1359158591 learned_addr learned my addr 172.21.15.102:0/1359158591 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:25:42.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e2c886700 1 --2- 172.21.15.102:0/1359158591 >> v2:172.21.15.121:3300/0 conn(0x7f9e280ac700 0x7f9e2806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 -- 172.21.15.102:0/1359158591 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098456638 0 0) 0x7f9e280b00c0 con 0x7f9e280abc20 2024-08-17T02:25:42.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 -- 172.21.15.102:0/1359158591 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e10003570 con 0x7f9e280abc20 2024-08-17T02:25:42.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 -- 172.21.15.102:0/1359158591 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 456909262 0 0) 0x7f9e10003570 con 0x7f9e280abc20 2024-08-17T02:25:42.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 -- 172.21.15.102:0/1359158591 >> v2:172.21.15.121:3300/0 conn(0x7f9e280ac700 msgr2=0x7f9e2806d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:42.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 --2- 172.21.15.102:0/1359158591 >> v2:172.21.15.121:3300/0 conn(0x7f9e280ac700 0x7f9e2806d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 -- 172.21.15.102:0/1359158591 >> v1:172.21.15.121:6789/0 conn(0x7f9e280b0550 legacy=0x7f9e280abff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 -- 172.21.15.102:0/1359158591 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e280af810 con 0x7f9e280abc20 2024-08-17T02:25:42.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 -- 172.21.15.102:0/1359158591 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7f9e18001470 con 0x7f9e280abc20 2024-08-17T02:25:42.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 -- 172.21.15.102:0/1359158591 >> v1:172.21.15.102:6789/0 conn(0x7f9e280abc20 legacy=0x7f9e280aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 --2- 172.21.15.102:0/1359158591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e10003a60 0x7f9e10003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 --2- 172.21.15.102:0/1359158591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e10004810 0x7f9e10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 --2- 172.21.15.102:0/1359158591 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e100051c0 0x7f9e1000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 -- 172.21.15.102:0/1359158591 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e280af570 con 0x7f9e10003a60 2024-08-17T02:25:42.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 -- 172.21.15.102:0/1359158591 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1000c0d0 con 0x7f9e10004810 2024-08-17T02:25:42.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 -- 172.21.15.102:0/1359158591 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1000c290 con 0x7f9e100051c0 2024-08-17T02:25:42.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e27fff700 1 --2- 172.21.15.102:0/1359158591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e10003a60 0x7f9e10003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e277fe700 1 --2- 172.21.15.102:0/1359158591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e10004810 0x7f9e10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e2c886700 1 --2- 172.21.15.102:0/1359158591 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e100051c0 0x7f9e1000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e27fff700 1 -- 172.21.15.102:0/1359158591 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e100051c0 msgr2=0x7f9e1000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:42.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e27fff700 1 --2- 172.21.15.102:0/1359158591 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e100051c0 0x7f9e1000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e27fff700 1 -- 172.21.15.102:0/1359158591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e10004810 msgr2=0x7f9e10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:42.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e27fff700 1 --2- 172.21.15.102:0/1359158591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e10004810 0x7f9e10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e27fff700 1 -- 172.21.15.102:0/1359158591 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e10003570 con 0x7f9e10003a60 2024-08-17T02:25:42.049 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e2c886700 1 -- 172.21.15.102:0/1359158591 reap_dead start 2024-08-17T02:25:42.049 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e277fe700 1 --2- 172.21.15.102:0/1359158591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e10004810 0x7f9e10004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:42.049 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e27fff700 1 --2- 172.21.15.102:0/1359158591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e10003a60 0x7f9e10003e70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9e1800c340 tx=0x7f9e2806acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7665f87b67a2c7e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.049 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 -- 172.21.15.102:0/1359158591 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800cbf0 con 0x7f9e10003a60 2024-08-17T02:25:42.049 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 -- 172.21.15.102:0/1359158591 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1800cd70 con 0x7f9e10003a60 2024-08-17T02:25:42.049 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e26ffd700 1 -- 172.21.15.102:0/1359158591 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18005b70 con 0x7f9e10003a60 2024-08-17T02:25:42.049 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e2d087700 1 -- 172.21.15.102:0/1359158591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e10003a60 msgr2=0x7f9e10003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.049 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e2d087700 1 --2- 172.21.15.102:0/1359158591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e10003a60 0x7f9e10003e70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9e1800c340 tx=0x7f9e2806acb0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.049 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e2d087700 1 -- 172.21.15.102:0/1359158591 shutdown_connections 2024-08-17T02:25:42.049 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e2d087700 1 --2- 172.21.15.102:0/1359158591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e10003a60 0x7f9e10003e70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.049 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e2d087700 1 -- 172.21.15.102:0/1359158591 >> 172.21.15.102:0/1359158591 conn(0x7f9e280cea10 msgr2=0x7f9e28096a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:42.049 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e2d087700 1 -- 172.21.15.102:0/1359158591 shutdown_connections 2024-08-17T02:25:42.049 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.037+0000 7f9e2d087700 1 -- 172.21.15.102:0/1359158591 wait complete. 2024-08-17T02:25:42.052 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e2d087700 1 Processor -- start 2024-08-17T02:25:42.052 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e2d087700 1 -- start start 2024-08-17T02:25:42.052 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e2d087700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e10003a60 0x7f9e28155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.052 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e2d087700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e28157320 0x7f9e28154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.052 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e2d087700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e28155250 0x7f9e2809b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.052 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e2d087700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e28156e90 con 0x7f9e10003a60 2024-08-17T02:25:42.052 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e2d087700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e28156280 con 0x7f9e28157320 2024-08-17T02:25:42.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e2d087700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e28156560 con 0x7f9e28155250 2024-08-17T02:25:42.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e27fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e10003a60 0x7f9e28155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e27fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e10003a60 0x7f9e28155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39626/0 (socket says 172.21.15.102:39626) 2024-08-17T02:25:42.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e27fff700 1 -- 172.21.15.102:0/1573294971 learned_addr learned my addr 172.21.15.102:0/1573294971 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:42.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e277fe700 1 --2- 172.21.15.102:0/1573294971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e28157320 0x7f9e28154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e2c886700 1 --2- 172.21.15.102:0/1573294971 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e28155250 0x7f9e2809b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e27fff700 1 -- 172.21.15.102:0/1573294971 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e28155250 msgr2=0x7f9e2809b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e27fff700 1 --2- 172.21.15.102:0/1573294971 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e28155250 0x7f9e2809b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e27fff700 1 -- 172.21.15.102:0/1573294971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e28157320 msgr2=0x7f9e28154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.041+0000 7f9e27fff700 1 --2- 172.21.15.102:0/1573294971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e28157320 0x7f9e28154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.045+0000 7f9e27fff700 1 -- 172.21.15.102:0/1573294971 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e28156840 con 0x7f9e10003a60 2024-08-17T02:25:42.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.045+0000 7f9e27fff700 1 --2- 172.21.15.102:0/1573294971 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e10003a60 0x7f9e28155c30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000c0a0 tx=0x7f9e18012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.045+0000 7f9e0ffff700 1 -- 172.21.15.102:0/1573294971 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800cee0 con 0x7f9e10003a60 2024-08-17T02:25:42.054 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.045+0000 7f9e0ffff700 1 -- 172.21.15.102:0/1573294971 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1800cbf0 con 0x7f9e10003a60 2024-08-17T02:25:42.054 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.045+0000 7f9e2d087700 1 -- 172.21.15.102:0/1573294971 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e28156b20 con 0x7f9e10003a60 2024-08-17T02:25:42.054 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.045+0000 7f9e0ffff700 1 -- 172.21.15.102:0/1573294971 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18007300 con 0x7f9e10003a60 2024-08-17T02:25:42.054 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.045+0000 7f9e2d087700 1 -- 172.21.15.102:0/1573294971 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2809ba20 con 0x7f9e10003a60 2024-08-17T02:25:42.054 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.045+0000 7f9e0ffff700 1 -- 172.21.15.102:0/1573294971 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9e1801e430 con 0x7f9e10003a60 2024-08-17T02:25:42.054 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.045+0000 7f9e0ffff700 1 -- 172.21.15.102:0/1573294971 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f9e180076f0 con 0x7f9e10003a60 2024-08-17T02:25:42.054 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.045+0000 7f9e2d087700 1 -- 172.21.15.102:0/1573294971 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e281520b0 con 0x7f9e10003a60 2024-08-17T02:25:42.054 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.049+0000 7f9e0ffff700 1 -- 172.21.15.102:0/1573294971 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f9e18017070 con 0x7f9e10003a60 2024-08-17T02:25:42.082 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:42.080+0000 7f679f7ae000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:25:42.120 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.113+0000 7f9e2d087700 1 -- 172.21.15.102:0/1573294971 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e28064ba0 con 0x7f9e10003a60 2024-08-17T02:25:42.121 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.113+0000 7f9e0ffff700 1 -- 172.21.15.102:0/1573294971 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f9e1801e6e0 con 0x7f9e10003a60 2024-08-17T02:25:42.122 INFO:teuthology.misc.health.smithi102.stdout: 2024-08-17T02:25:42.122 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":10,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:40.883633+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:42.123 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.117+0000 7f9e2d087700 1 -- 172.21.15.102:0/1573294971 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e10003a60 msgr2=0x7f9e28155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.123 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.117+0000 7f9e2d087700 1 --2- 172.21.15.102:0/1573294971 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e10003a60 0x7f9e28155c30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000c0a0 tx=0x7f9e18012000 comp rx=0 tx=0).stop 2024-08-17T02:25:42.123 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.117+0000 7f9e2d087700 1 -- 172.21.15.102:0/1573294971 shutdown_connections 2024-08-17T02:25:42.123 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.117+0000 7f9e2d087700 1 --2- 172.21.15.102:0/1573294971 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9e28155250 0x7f9e2809b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.123 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.117+0000 7f9e2d087700 1 --2- 172.21.15.102:0/1573294971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e28157320 0x7f9e28154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.123 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.117+0000 7f9e2d087700 1 --2- 172.21.15.102:0/1573294971 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e10003a60 0x7f9e28155c30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.124 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.117+0000 7f9e2d087700 1 -- 172.21.15.102:0/1573294971 >> 172.21.15.102:0/1573294971 conn(0x7f9e280cea10 msgr2=0x7f9e2806e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:42.124 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.117+0000 7f9e2d087700 1 -- 172.21.15.102:0/1573294971 shutdown_connections 2024-08-17T02:25:42.124 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:42.117+0000 7f9e2d087700 1 -- 172.21.15.102:0/1573294971 wait complete. 2024-08-17T02:25:42.133 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:25:42.148 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:42.141+0000 7f85fa208000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:25:42.214 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:42.205+0000 7f85fa208000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:25:42.244 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:42.240+0000 7f679f7ae000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:25:42.306 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:42.300+0000 7f679f7ae000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:25:42.357 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:42.352+0000 7f679f7ae000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:25:42.370 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:42.365+0000 7f85fa208000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:25:42.413 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:42.408+0000 7f679f7ae000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:25:42.436 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:42.429+0000 7f85fa208000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:25:42.581 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:42.576+0000 7f679f7ae000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:25:42.742 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:42.740+0000 7f679f7ae000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:25:42.808 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:42.804+0000 7f679f7ae000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:25:42.968 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:42.964+0000 7f679f7ae000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:25:43.035 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:43.032+0000 7f679f7ae000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:25:43.137 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:43.129+0000 7f85fa208000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:25:43.747 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-08-17T02:25:43.744+0000 7f679f7ae000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:25:44.187 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:44.181+0000 7f85e3280700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:25:44.187 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-08-17T02:25:44.181+0000 7f85e3280700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:25:45.035 INFO:tasks.ceph.osd.7.smithi121.stderr:2024-08-17T02:25:45.032+0000 7f8d904e63c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:25:45.120 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-08-17T02:25:45.113+0000 7f7bb66673c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:25:45.142 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-08-17T02:25:45.137+0000 7f68d80603c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:25:45.151 INFO:tasks.ceph.osd.6.smithi121.stderr:2024-08-17T02:25:45.148+0000 7f35af8013c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:25:45.157 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-08-17T02:25:45.149+0000 7fb20f5513c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:25:45.247 INFO:tasks.ceph.osd.5.smithi121.stderr:2024-08-17T02:25:45.244+0000 7f4194e523c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:25:45.357 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-08-17T02:25:45.353+0000 7f42755903c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:25:45.428 INFO:tasks.ceph.osd.4.smithi121.stderr:2024-08-17T02:25:45.424+0000 7fcde3b043c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:25:47.841 INFO:tasks.ceph.osd.7.smithi121.stderr:2024-08-17T02:25:47.836+0000 7f8d8d4ab700 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:25:47.858 INFO:tasks.ceph.osd.7.smithi121.stderr:2024-08-17T02:25:47.856+0000 7f8d84a29700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:47.944 INFO:tasks.ceph.osd.6.smithi121.stderr:2024-08-17T02:25:47.940+0000 7f35aafa1700 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:25:47.964 INFO:tasks.ceph.osd.6.smithi121.stderr:2024-08-17T02:25:47.960+0000 7f35a3d44700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:48.154 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-08-17T02:25:48.153+0000 7fb20acf1700 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:25:48.157 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-08-17T02:25:48.153+0000 7f68d5025700 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:25:48.161 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-08-17T02:25:48.157+0000 7fb203a94700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:48.163 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-08-17T02:25:48.161+0000 7f68cc5a3700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:48.201 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-08-17T02:25:48.197+0000 7f7bb1e07700 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:25:48.211 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-08-17T02:25:48.209+0000 7f7baabaa700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:48.611 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-08-17T02:25:48.609+0000 7f4272555700 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:25:48.616 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-08-17T02:25:48.613+0000 7f4269ad3700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:48.802 INFO:tasks.ceph.osd.5.smithi121.stderr:2024-08-17T02:25:48.800+0000 7f41905f2700 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:25:48.806 INFO:tasks.ceph.osd.5.smithi121.stderr:2024-08-17T02:25:48.804+0000 7f4189395700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:48.813 INFO:tasks.ceph.osd.4.smithi121.stderr:2024-08-17T02:25:48.808+0000 7fcddf2a4700 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:25:48.817 INFO:tasks.ceph.osd.4.smithi121.stderr:2024-08-17T02:25:48.816+0000 7fcdd8047700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:48.939 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:49.044 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.041+0000 7fa8db59e700 1 Processor -- start 2024-08-17T02:25:49.044 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.041+0000 7fa8db59e700 1 -- start start 2024-08-17T02:25:49.045 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.041+0000 7fa8db59e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa8dc142f00 0x7fa8dc0c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.045 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.041+0000 7fa8db59e700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8dc0c6050 con 0x7fa8dc0cc890 2024-08-17T02:25:49.045 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.041+0000 7fa8db59e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8dc0c5720 con 0x7fa8dc142b30 2024-08-17T02:25:49.045 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.041+0000 7fa8db59e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8dc0c5a00 con 0x7fa8dc142f00 2024-08-17T02:25:49.045 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.041+0000 7fa8d3fff700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa8dc0cc890 0x7fa8dc15d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45706/0 (socket says 172.21.15.102:45706) 2024-08-17T02:25:49.045 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.041+0000 7fa8d3fff700 1 -- 172.21.15.102:0/2735096251 learned_addr learned my addr 172.21.15.102:0/2735096251 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:25:49.045 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.041+0000 7fa8dad9d700 1 --2- 172.21.15.102:0/2735096251 >> v2:172.21.15.121:3300/0 conn(0x7fa8dc142f00 0x7fa8dc0c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.041+0000 7fa8d9d9b700 1 -- 172.21.15.102:0/2735096251 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136296665 0 0) 0x7fa8dc0c6050 con 0x7fa8dc0cc890 2024-08-17T02:25:49.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.041+0000 7fa8d9d9b700 1 -- 172.21.15.102:0/2735096251 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8c8003570 con 0x7fa8dc0cc890 2024-08-17T02:25:49.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.041+0000 7fa8d9d9b700 1 -- 172.21.15.102:0/2735096251 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819709890 0 0) 0x7fa8dc0c5720 con 0x7fa8dc142b30 2024-08-17T02:25:49.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8d9d9b700 1 -- 172.21.15.102:0/2735096251 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8dc0c6050 con 0x7fa8dc142b30 2024-08-17T02:25:49.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8dad9d700 1 -- 172.21.15.102:0/2735096251 >> v1:172.21.15.121:6789/0 conn(0x7fa8dc142b30 legacy=0x7fa8dc0cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8dad9d700 1 -- 172.21.15.102:0/2735096251 >> v1:172.21.15.102:6789/0 conn(0x7fa8dc0cc890 legacy=0x7fa8dc15d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8dad9d700 1 -- 172.21.15.102:0/2735096251 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc0c5ce0 con 0x7fa8dc142f00 2024-08-17T02:25:49.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8dad9d700 1 --2- 172.21.15.102:0/2735096251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8dc142f00 0x7fa8dc0c64e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009e60 tx=0x7fa8d4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df7f36b833c9b093 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8d9d9b700 1 -- 172.21.15.102:0/2735096251 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d400e070 con 0x7fa8dc142f00 2024-08-17T02:25:49.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8d9d9b700 1 -- 172.21.15.102:0/2735096251 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d400bab0 con 0x7fa8dc142f00 2024-08-17T02:25:49.047 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8d9d9b700 1 -- 172.21.15.102:0/2735096251 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d400be70 con 0x7fa8dc142f00 2024-08-17T02:25:49.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8db59e700 1 -- 172.21.15.102:0/2735096251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8dc142f00 msgr2=0x7fa8dc0c64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8db59e700 1 --2- 172.21.15.102:0/2735096251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8dc142f00 0x7fa8dc0c64e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009e60 tx=0x7fa8d4009780 comp rx=0 tx=0).stop 2024-08-17T02:25:49.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8db59e700 1 -- 172.21.15.102:0/2735096251 shutdown_connections 2024-08-17T02:25:49.048 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8db59e700 1 --2- 172.21.15.102:0/2735096251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8dc142f00 0x7fa8dc0c64e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.049 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8db59e700 1 -- 172.21.15.102:0/2735096251 >> 172.21.15.102:0/2735096251 conn(0x7fa8dc06c090 msgr2=0x7fa8dc06c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.049 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8db59e700 1 -- 172.21.15.102:0/2735096251 shutdown_connections 2024-08-17T02:25:49.049 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8db59e700 1 -- 172.21.15.102:0/2735096251 wait complete. 2024-08-17T02:25:49.050 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8db59e700 1 Processor -- start 2024-08-17T02:25:49.050 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8db59e700 1 -- start start 2024-08-17T02:25:49.050 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8db59e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc0cc890 0x7fa8dc0ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.050 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.045+0000 7fa8db59e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8dc142b30 0x7fa8dc15ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.050 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8db59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa8dc142f00 0x7fa8dc15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.051 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8db59e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0af780 con 0x7fa8dc0cc890 2024-08-17T02:25:49.051 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8db59e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc15cf60 con 0x7fa8dc142b30 2024-08-17T02:25:49.051 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8db59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0adcf0 con 0x7fa8dc142f00 2024-08-17T02:25:49.051 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8da59c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc0cc890 0x7fa8dc0ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.051 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8da59c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc0cc890 0x7fa8dc0ad6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39756/0 (socket says 172.21.15.102:39756) 2024-08-17T02:25:49.051 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8da59c700 1 -- 172.21.15.102:0/843548675 learned_addr learned my addr 172.21.15.102:0/843548675 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:49.051 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8d3fff700 1 --2- 172.21.15.102:0/843548675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8dc142b30 0x7fa8dc15ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.051 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8dad9d700 1 --2- 172.21.15.102:0/843548675 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa8dc142f00 0x7fa8dc15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.052 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8da59c700 1 -- 172.21.15.102:0/843548675 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa8dc142f00 msgr2=0x7fa8dc15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8da59c700 1 --2- 172.21.15.102:0/843548675 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa8dc142f00 0x7fa8dc15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8da59c700 1 -- 172.21.15.102:0/843548675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8dc142b30 msgr2=0x7fa8dc15ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8da59c700 1 --2- 172.21.15.102:0/843548675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8dc142b30 0x7fa8dc15ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8da59c700 1 -- 172.21.15.102:0/843548675 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d4009a20 con 0x7fa8dc0cc890 2024-08-17T02:25:49.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8da59c700 1 --2- 172.21.15.102:0/843548675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc0cc890 0x7fa8dc0ad6a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00c790 tx=0x7fa8cc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8d27fc700 1 -- 172.21.15.102:0/843548675 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc010510 con 0x7fa8dc0cc890 2024-08-17T02:25:49.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8d27fc700 1 -- 172.21.15.102:0/843548675 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc010670 con 0x7fa8dc0cc890 2024-08-17T02:25:49.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8db59e700 1 -- 172.21.15.102:0/843548675 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8dc0adfd0 con 0x7fa8dc0cc890 2024-08-17T02:25:49.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8d27fc700 1 -- 172.21.15.102:0/843548675 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc010a10 con 0x7fa8dc0cc890 2024-08-17T02:25:49.053 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8db59e700 1 -- 172.21.15.102:0/843548675 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8dc0ae590 con 0x7fa8dc0cc890 2024-08-17T02:25:49.054 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.049+0000 7fa8db59e700 1 -- 172.21.15.102:0/843548675 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8dc064ba0 con 0x7fa8dc0cc890 2024-08-17T02:25:49.054 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.053+0000 7fa8d27fc700 1 -- 172.21.15.102:0/843548675 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 80087+0+0 (secure 0 0 0) 0x7fa8cc01b3b0 con 0x7fa8dc0cc890 2024-08-17T02:25:49.055 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.053+0000 7fa8d27fc700 1 --2- 172.21.15.102:0/843548675 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa8bc0607d0 0x7fa8bc062c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.055 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.053+0000 7fa8d27fc700 1 -- 172.21.15.102:0/843548675 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7fa8cc07be60 con 0x7fa8dc0cc890 2024-08-17T02:25:49.055 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.053+0000 7fa8d3fff700 1 --2- 172.21.15.102:0/843548675 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa8bc0607d0 0x7fa8bc062c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.055 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.053+0000 7fa8d3fff700 1 --2- 172.21.15.102:0/843548675 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa8bc0607d0 0x7fa8bc062c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc1421d0 tx=0x7fa8c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.061 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.057+0000 7fa8d27fc700 1 -- 172.21.15.102:0/843548675 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa8cc04c860 con 0x7fa8dc0cc890 2024-08-17T02:25:49.231 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.229+0000 7fa8db59e700 1 -- 172.21.15.102:0/843548675 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8dc0677c0 con 0x7fa8dc0cc890 2024-08-17T02:25:49.239 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.237+0000 7fa8d27fc700 1 -- 172.21.15.102:0/843548675 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10444 (secure 0 0 0) 0x7fa8cc017090 con 0x7fa8dc0cc890 2024-08-17T02:25:49.239 INFO:teuthology.misc.health.smithi102.stdout: 2024-08-17T02:25:49.239 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":14,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:48.850102+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:49.241 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.237+0000 7fa8db59e700 1 -- 172.21.15.102:0/843548675 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa8bc0607d0 msgr2=0x7fa8bc062c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.241 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.237+0000 7fa8db59e700 1 --2- 172.21.15.102:0/843548675 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa8bc0607d0 0x7fa8bc062c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc1421d0 tx=0x7fa8c4009040 comp rx=0 tx=0).stop 2024-08-17T02:25:49.242 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.237+0000 7fa8db59e700 1 -- 172.21.15.102:0/843548675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc0cc890 msgr2=0x7fa8dc0ad6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.242 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.237+0000 7fa8db59e700 1 --2- 172.21.15.102:0/843548675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc0cc890 0x7fa8dc0ad6a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00c790 tx=0x7fa8cc007e10 comp rx=0 tx=0).stop 2024-08-17T02:25:49.242 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.237+0000 7fa8db59e700 1 -- 172.21.15.102:0/843548675 shutdown_connections 2024-08-17T02:25:49.242 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.237+0000 7fa8db59e700 1 --2- 172.21.15.102:0/843548675 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa8bc0607d0 0x7fa8bc062c80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.242 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.237+0000 7fa8db59e700 1 --2- 172.21.15.102:0/843548675 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa8dc142f00 0x7fa8dc15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.242 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.237+0000 7fa8db59e700 1 --2- 172.21.15.102:0/843548675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8dc142b30 0x7fa8dc15ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.242 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.237+0000 7fa8db59e700 1 --2- 172.21.15.102:0/843548675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc0cc890 0x7fa8dc0ad6a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.242 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.237+0000 7fa8db59e700 1 -- 172.21.15.102:0/843548675 >> 172.21.15.102:0/843548675 conn(0x7fa8dc06c090 msgr2=0x7fa8dc0ca180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.242 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.237+0000 7fa8db59e700 1 -- 172.21.15.102:0/843548675 shutdown_connections 2024-08-17T02:25:49.242 INFO:teuthology.misc.health.smithi102.stderr:2024-08-17T02:25:49.237+0000 7fa8db59e700 1 -- 172.21.15.102:0/843548675 wait complete. 2024-08-17T02:25:49.255 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:25:49.255 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:25:49.255 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:25:49.255 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:25:49.257 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:25:49.257 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:25:49.257 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:25:49.259 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:25:49.259 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:25:49.259 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:25:49.262 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:25:49.262 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:25:49.262 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:25:49.264 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:25:49.264 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:25:49.264 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:49.318 INFO:tasks.ceph.mds.c.smithi102.stdout:starting mds.c at 2024-08-17T02:25:49.336 INFO:tasks.ceph.mds.d.smithi121.stdout:starting mds.d at 2024-08-17T02:25:49.337 INFO:tasks.ceph.mds.a.smithi102.stdout:starting mds.a at 2024-08-17T02:25:49.342 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-08-17T02:25:49.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.365+0000 7fa174dcb700 1 Processor -- start 2024-08-17T02:25:49.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.365+0000 7fa174dcb700 1 -- start start 2024-08-17T02:25:49.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.365+0000 7fa174dcb700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa170068c10 0x7fa170158a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.365+0000 7fa174dcb700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa170158fa0 0x7fa1700ab310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.365+0000 7fa174dcb700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1700aa270 con 0x7fa170068840 2024-08-17T02:25:49.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.365+0000 7fa174dcb700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa170069090 con 0x7fa170158fa0 2024-08-17T02:25:49.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.365+0000 7fa174dcb700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1700aa550 con 0x7fa170068c10 2024-08-17T02:25:49.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.365+0000 7fa16ffff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa170158fa0 0x7fa1700ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.365+0000 7fa16ffff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa170158fa0 0x7fa1700ab310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39794/0 (socket says 172.21.15.102:39794) 2024-08-17T02:25:49.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.365+0000 7fa16ffff700 1 -- 172.21.15.102:0/2426480228 learned_addr learned my addr 172.21.15.102:0/2426480228 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:49.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.365+0000 7fa16effd700 1 --2- 172.21.15.102:0/2426480228 >> v2:172.21.15.121:3300/0 conn(0x7fa170068c10 0x7fa170158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa16ffff700 1 -- 172.21.15.102:0/2426480228 >> v2:172.21.15.121:3300/0 conn(0x7fa170068c10 msgr2=0x7fa170158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:49.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa16ffff700 1 --2- 172.21.15.102:0/2426480228 >> v2:172.21.15.121:3300/0 conn(0x7fa170068c10 0x7fa170158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa16ffff700 1 -- 172.21.15.102:0/2426480228 >> v1:172.21.15.121:6789/0 conn(0x7fa170068840 legacy=0x7fa1700a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa16ffff700 1 -- 172.21.15.102:0/2426480228 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1700aa830 con 0x7fa170158fa0 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa16ffff700 1 --2- 172.21.15.102:0/2426480228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa170158fa0 0x7fa1700ab310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa168009f20 tx=0x7fa168009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399d272f127b1efb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa16e7fc700 1 -- 172.21.15.102:0/2426480228 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16800e070 con 0x7fa170158fa0 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa16e7fc700 1 -- 172.21.15.102:0/2426480228 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16800b990 con 0x7fa170158fa0 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa16e7fc700 1 -- 172.21.15.102:0/2426480228 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1680092e0 con 0x7fa170158fa0 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa174dcb700 1 -- 172.21.15.102:0/2426480228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa170158fa0 msgr2=0x7fa1700ab310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa174dcb700 1 --2- 172.21.15.102:0/2426480228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa170158fa0 0x7fa1700ab310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa168009f20 tx=0x7fa168009840 comp rx=0 tx=0).stop 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa174dcb700 1 -- 172.21.15.102:0/2426480228 shutdown_connections 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa174dcb700 1 --2- 172.21.15.102:0/2426480228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa170158fa0 0x7fa1700ab310 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa174dcb700 1 --2- 172.21.15.102:0/2426480228 >> v2:172.21.15.121:3300/0 conn(0x7fa170068c10 0x7fa170158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa174dcb700 1 -- 172.21.15.102:0/2426480228 >> 172.21.15.102:0/2426480228 conn(0x7fa17006d800 msgr2=0x7fa17006dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa174dcb700 1 -- 172.21.15.102:0/2426480228 shutdown_connections 2024-08-17T02:25:49.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa174dcb700 1 -- 172.21.15.102:0/2426480228 wait complete. 2024-08-17T02:25:49.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa174dcb700 1 Processor -- start 2024-08-17T02:25:49.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.369+0000 7fa174dcb700 1 -- start start 2024-08-17T02:25:49.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa174dcb700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa170068840 0x7fa170155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa174dcb700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa170068c10 0x7fa1700c1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa174dcb700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa170158fa0 0x7fa1700c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa174dcb700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17006b2c0 con 0x7fa170158fa0 2024-08-17T02:25:49.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa174dcb700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1700c1ee0 con 0x7fa170068c10 2024-08-17T02:25:49.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa174dcb700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1700c21c0 con 0x7fa170068840 2024-08-17T02:25:49.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa16ffff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa170158fa0 0x7fa1700c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa16ffff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa170158fa0 0x7fa1700c18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39804/0 (socket says 172.21.15.102:39804) 2024-08-17T02:25:49.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa16ffff700 1 -- 172.21.15.102:0/2027623470 learned_addr learned my addr 172.21.15.102:0/2027623470 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:49.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa16f7fe700 1 --2- 172.21.15.102:0/2027623470 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa170068840 0x7fa170155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa16effd700 1 --2- 172.21.15.102:0/2027623470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa170068c10 0x7fa1700c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa16ffff700 1 -- 172.21.15.102:0/2027623470 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa170068840 msgr2=0x7fa170155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa16ffff700 1 --2- 172.21.15.102:0/2027623470 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa170068840 0x7fa170155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa16ffff700 1 -- 172.21.15.102:0/2027623470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa170068c10 msgr2=0x7fa1700c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa16ffff700 1 --2- 172.21.15.102:0/2027623470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa170068c10 0x7fa1700c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa16ffff700 1 -- 172.21.15.102:0/2027623470 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168009ae0 con 0x7fa170158fa0 2024-08-17T02:25:49.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa16ffff700 1 --2- 172.21.15.102:0/2027623470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa170158fa0 0x7fa1700c18b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa168009880 tx=0x7fa168018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa1577fe700 1 -- 172.21.15.102:0/2027623470 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168008c30 con 0x7fa170158fa0 2024-08-17T02:25:49.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa1577fe700 1 -- 172.21.15.102:0/2027623470 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa168008d90 con 0x7fa170158fa0 2024-08-17T02:25:49.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa1577fe700 1 -- 172.21.15.102:0/2027623470 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168025690 con 0x7fa170158fa0 2024-08-17T02:25:49.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa174dcb700 1 -- 172.21.15.102:0/2027623470 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1700c24a0 con 0x7fa170158fa0 2024-08-17T02:25:49.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa174dcb700 1 -- 172.21.15.102:0/2027623470 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa170169090 con 0x7fa170158fa0 2024-08-17T02:25:49.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.373+0000 7fa174dcb700 1 -- 172.21.15.102:0/2027623470 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1700638f0 con 0x7fa170158fa0 2024-08-17T02:25:49.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.377+0000 7fa1577fe700 1 -- 172.21.15.102:0/2027623470 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 80087+0+0 (secure 0 0 0) 0x7fa168003040 con 0x7fa170158fa0 2024-08-17T02:25:49.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.377+0000 7fa1577fe700 1 --2- 172.21.15.102:0/2027623470 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa15c0607d0 0x7fa15c062c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.377+0000 7fa1577fe700 1 -- 172.21.15.102:0/2027623470 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7fa16807e270 con 0x7fa170158fa0 2024-08-17T02:25:49.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.377+0000 7fa16f7fe700 1 --2- 172.21.15.102:0/2027623470 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa15c0607d0 0x7fa15c062c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.377+0000 7fa16f7fe700 1 --2- 172.21.15.102:0/2027623470 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa15c0607d0 0x7fa15c062c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa164003860 tx=0x7fa164009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.381+0000 7fa1577fe700 1 -- 172.21.15.102:0/2027623470 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa16804ebd0 con 0x7fa170158fa0 2024-08-17T02:25:49.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.545+0000 7fa174dcb700 1 -- 172.21.15.102:0/2027623470 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa17006e590 con 0x7fa170158fa0 2024-08-17T02:25:49.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.549+0000 7fa1577fe700 1 -- 172.21.15.102:0/2027623470 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10444 (secure 0 0 0) 0x7fa1680521f0 con 0x7fa170158fa0 2024-08-17T02:25:49.550 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:49.550 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":14,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:48.850102+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:49.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.549+0000 7fa174dcb700 1 -- 172.21.15.102:0/2027623470 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa15c0607d0 msgr2=0x7fa15c062c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.549+0000 7fa174dcb700 1 --2- 172.21.15.102:0/2027623470 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa15c0607d0 0x7fa15c062c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa164003860 tx=0x7fa164009040 comp rx=0 tx=0).stop 2024-08-17T02:25:49.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.549+0000 7fa174dcb700 1 -- 172.21.15.102:0/2027623470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa170158fa0 msgr2=0x7fa1700c18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.549+0000 7fa174dcb700 1 --2- 172.21.15.102:0/2027623470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa170158fa0 0x7fa1700c18b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa168009880 tx=0x7fa168018000 comp rx=0 tx=0).stop 2024-08-17T02:25:49.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.549+0000 7fa174dcb700 1 -- 172.21.15.102:0/2027623470 shutdown_connections 2024-08-17T02:25:49.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.549+0000 7fa174dcb700 1 --2- 172.21.15.102:0/2027623470 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa15c0607d0 0x7fa15c062c80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.549+0000 7fa174dcb700 1 --2- 172.21.15.102:0/2027623470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa170158fa0 0x7fa1700c18b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.549+0000 7fa174dcb700 1 --2- 172.21.15.102:0/2027623470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa170068c10 0x7fa1700c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.549+0000 7fa174dcb700 1 --2- 172.21.15.102:0/2027623470 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa170068840 0x7fa170155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.549+0000 7fa174dcb700 1 -- 172.21.15.102:0/2027623470 >> 172.21.15.102:0/2027623470 conn(0x7fa17006d800 msgr2=0x7fa1700ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.549+0000 7fa174dcb700 1 -- 172.21.15.102:0/2027623470 shutdown_connections 2024-08-17T02:25:49.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.549+0000 7fa174dcb700 1 -- 172.21.15.102:0/2027623470 wait complete. 2024-08-17T02:25:49.564 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-08-17T02:25:49.564 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:49.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037eadc700 1 Processor -- start 2024-08-17T02:25:49.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037eadc700 1 -- start start 2024-08-17T02:25:49.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037eadc700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03780b1320 0x7f037806e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037eadc700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03780b1750 con 0x7f037806ef10 2024-08-17T02:25:49.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037eadc700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03780aba70 con 0x7f03780ab540 2024-08-17T02:25:49.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037eadc700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037806e620 con 0x7f03780b1320 2024-08-17T02:25:49.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037e2db700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f037806ef10 0x7f0378155010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45720/0 (socket says 172.21.15.102:45720) 2024-08-17T02:25:49.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037e2db700 1 -- 172.21.15.102:0/569818813 learned_addr learned my addr 172.21.15.102:0/569818813 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:25:49.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037d2d9700 1 --2- 172.21.15.102:0/569818813 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03780b1320 0x7f037806e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037cad8700 1 -- 172.21.15.102:0/569818813 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236405739 0 0) 0x7f03780b1750 con 0x7f037806ef10 2024-08-17T02:25:49.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037cad8700 1 -- 172.21.15.102:0/569818813 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0364003570 con 0x7f037806ef10 2024-08-17T02:25:49.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037cad8700 1 -- 172.21.15.102:0/569818813 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938632260 0 0) 0x7f03780aba70 con 0x7f03780ab540 2024-08-17T02:25:49.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037cad8700 1 -- 172.21.15.102:0/569818813 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03780b1750 con 0x7f03780ab540 2024-08-17T02:25:49.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037d2d9700 1 -- 172.21.15.102:0/569818813 >> v1:172.21.15.121:6789/0 conn(0x7f03780ab540 legacy=0x7f037806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037d2d9700 1 -- 172.21.15.102:0/569818813 >> v1:172.21.15.102:6789/0 conn(0x7f037806ef10 legacy=0x7f0378155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037d2d9700 1 -- 172.21.15.102:0/569818813 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03780abd50 con 0x7f03780b1320 2024-08-17T02:25:49.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037d2d9700 1 --2- 172.21.15.102:0/569818813 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03780b1320 0x7f037806e9d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0368009910 tx=0x7f03680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be8fea923aa59682 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037cad8700 1 -- 172.21.15.102:0/569818813 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368011630 con 0x7f03780b1320 2024-08-17T02:25:49.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037cad8700 1 -- 172.21.15.102:0/569818813 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0368011790 con 0x7f03780b1320 2024-08-17T02:25:49.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.673+0000 7f037cad8700 1 -- 172.21.15.102:0/569818813 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368011b10 con 0x7f03780b1320 2024-08-17T02:25:49.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.677+0000 7f037eadc700 1 -- 172.21.15.102:0/569818813 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03780b1320 msgr2=0x7f037806e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.677+0000 7f037eadc700 1 --2- 172.21.15.102:0/569818813 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03780b1320 0x7f037806e9d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0368009910 tx=0x7f03680091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.677+0000 7f037eadc700 1 -- 172.21.15.102:0/569818813 shutdown_connections 2024-08-17T02:25:49.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.677+0000 7f037eadc700 1 --2- 172.21.15.102:0/569818813 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03780b1320 0x7f037806e9d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.677+0000 7f037eadc700 1 -- 172.21.15.102:0/569818813 >> 172.21.15.102:0/569818813 conn(0x7f03780678d0 msgr2=0x7f0378067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.677+0000 7f037eadc700 1 -- 172.21.15.102:0/569818813 shutdown_connections 2024-08-17T02:25:49.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.677+0000 7f037eadc700 1 -- 172.21.15.102:0/569818813 wait complete. 2024-08-17T02:25:49.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.677+0000 7f037eadc700 1 Processor -- start 2024-08-17T02:25:49.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.677+0000 7f037eadc700 1 -- start start 2024-08-17T02:25:49.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037eadc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f037806ef10 0x7f03781354f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037eadc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03780ab540 0x7f037815a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037eadc700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03780b1320 0x7f037815ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037eadc700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0378146f40 con 0x7f037806ef10 2024-08-17T02:25:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037eadc700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0378137660 con 0x7f03780ab540 2024-08-17T02:25:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037eadc700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0378137af0 con 0x7f03780b1320 2024-08-17T02:25:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037dada700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f037806ef10 0x7f03781354f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037dada700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f037806ef10 0x7f03781354f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39816/0 (socket says 172.21.15.102:39816) 2024-08-17T02:25:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037dada700 1 -- 172.21.15.102:0/2697291988 learned_addr learned my addr 172.21.15.102:0/2697291988 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037e2db700 1 --2- 172.21.15.102:0/2697291988 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03780b1320 0x7f037815ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037d2d9700 1 --2- 172.21.15.102:0/2697291988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03780ab540 0x7f037815a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037dada700 1 -- 172.21.15.102:0/2697291988 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03780b1320 msgr2=0x7f037815ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037dada700 1 --2- 172.21.15.102:0/2697291988 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03780b1320 0x7f037815ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037dada700 1 -- 172.21.15.102:0/2697291988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03780ab540 msgr2=0x7f037815a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037dada700 1 --2- 172.21.15.102:0/2697291988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03780ab540 0x7f037815a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037dada700 1 -- 172.21.15.102:0/2697291988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0368009420 con 0x7f037806ef10 2024-08-17T02:25:49.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037dada700 1 --2- 172.21.15.102:0/2697291988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f037806ef10 0x7f03781354f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f037400c790 tx=0x7f0374007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f036dffb700 1 -- 172.21.15.102:0/2697291988 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374010510 con 0x7f037806ef10 2024-08-17T02:25:49.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f036dffb700 1 -- 172.21.15.102:0/2697291988 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0374010670 con 0x7f037806ef10 2024-08-17T02:25:49.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037eadc700 1 -- 172.21.15.102:0/2697291988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0378149c80 con 0x7f037806ef10 2024-08-17T02:25:49.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f036dffb700 1 -- 172.21.15.102:0/2697291988 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374010a10 con 0x7f037806ef10 2024-08-17T02:25:49.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.681+0000 7f037eadc700 1 -- 172.21.15.102:0/2697291988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0378137090 con 0x7f037806ef10 2024-08-17T02:25:49.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.685+0000 7f037eadc700 1 -- 172.21.15.102:0/2697291988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03780643a0 con 0x7f037806ef10 2024-08-17T02:25:49.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.685+0000 7f036dffb700 1 -- 172.21.15.102:0/2697291988 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 80087+0+0 (secure 0 0 0) 0x7f037401b3b0 con 0x7f037806ef10 2024-08-17T02:25:49.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.685+0000 7f036dffb700 1 --2- 172.21.15.102:0/2697291988 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f035c0607d0 0x7f035c062c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.685+0000 7f037d2d9700 1 --2- 172.21.15.102:0/2697291988 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f035c0607d0 0x7f035c062c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.685+0000 7f036dffb700 1 -- 172.21.15.102:0/2697291988 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f037407bf00 con 0x7f037806ef10 2024-08-17T02:25:49.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.685+0000 7f037d2d9700 1 --2- 172.21.15.102:0/2697291988 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f035c0607d0 0x7f035c062c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0368009860 tx=0x7f0368017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.693+0000 7f036dffb700 1 -- 172.21.15.102:0/2697291988 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f037404c860 con 0x7f037806ef10 2024-08-17T02:25:49.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.893+0000 7f037eadc700 1 -- 172.21.15.102:0/2697291988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f037806f5f0 con 0x7f037806ef10 2024-08-17T02:25:49.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.893+0000 7f036dffb700 1 -- 172.21.15.102:0/2697291988 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f0374017090 con 0x7f037806ef10 2024-08-17T02:25:49.898 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:49.898 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/932475255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":932475255},{"type":"v1","addr":"172.21.15.102:6835","nonce":932475255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:25:49.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.897+0000 7f037eadc700 1 -- 172.21.15.102:0/2697291988 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f035c0607d0 msgr2=0x7f035c062c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.897+0000 7f037eadc700 1 --2- 172.21.15.102:0/2697291988 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f035c0607d0 0x7f035c062c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0368009860 tx=0x7f0368017000 comp rx=0 tx=0).stop 2024-08-17T02:25:49.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.897+0000 7f037eadc700 1 -- 172.21.15.102:0/2697291988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f037806ef10 msgr2=0x7f03781354f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.897+0000 7f037eadc700 1 --2- 172.21.15.102:0/2697291988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f037806ef10 0x7f03781354f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f037400c790 tx=0x7f0374007e10 comp rx=0 tx=0).stop 2024-08-17T02:25:49.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.897+0000 7f037eadc700 1 -- 172.21.15.102:0/2697291988 shutdown_connections 2024-08-17T02:25:49.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.897+0000 7f037eadc700 1 --2- 172.21.15.102:0/2697291988 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f035c0607d0 0x7f035c062c80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.897+0000 7f037eadc700 1 --2- 172.21.15.102:0/2697291988 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f03780b1320 0x7f037815ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.897+0000 7f037eadc700 1 --2- 172.21.15.102:0/2697291988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f03780ab540 0x7f037815a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.897+0000 7f037eadc700 1 --2- 172.21.15.102:0/2697291988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f037806ef10 0x7f03781354f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.897+0000 7f037eadc700 1 -- 172.21.15.102:0/2697291988 >> 172.21.15.102:0/2697291988 conn(0x7f03780678d0 msgr2=0x7f037806cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.897+0000 7f037eadc700 1 -- 172.21.15.102:0/2697291988 shutdown_connections 2024-08-17T02:25:49.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:49.897+0000 7f037eadc700 1 -- 172.21.15.102:0/2697291988 wait complete. 2024-08-17T02:25:49.901 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 2 2024-08-17T02:25:51.912 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:52.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cdbbb700 1 Processor -- start 2024-08-17T02:25:52.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cdbbb700 1 -- start start 2024-08-17T02:25:52.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cdbbb700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f53c80af5f0 0x7f53c80acb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cdbbb700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f53c80ad090 0x7f53c8157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cdbbb700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c80ad8a0 con 0x7f53c8155d80 2024-08-17T02:25:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cdbbb700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c80adb80 con 0x7f53c80ad090 2024-08-17T02:25:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cdbbb700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c80ade60 con 0x7f53c80af5f0 2024-08-17T02:25:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cd3ba700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f53c80ad090 0x7f53c8157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cd3ba700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f53c80ad090 0x7f53c8157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47786/0 (socket says 172.21.15.102:47786) 2024-08-17T02:25:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cd3ba700 1 -- 172.21.15.102:0/772758845 learned_addr learned my addr 172.21.15.102:0/772758845 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53c7fff700 1 --2- 172.21.15.102:0/772758845 >> v2:172.21.15.121:3300/0 conn(0x7f53c80af5f0 0x7f53c80acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cd3ba700 1 -- 172.21.15.102:0/772758845 >> v2:172.21.15.121:3300/0 conn(0x7f53c80af5f0 msgr2=0x7f53c80acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cd3ba700 1 --2- 172.21.15.102:0/772758845 >> v2:172.21.15.121:3300/0 conn(0x7f53c80af5f0 0x7f53c80acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cd3ba700 1 -- 172.21.15.102:0/772758845 >> v1:172.21.15.121:6789/0 conn(0x7f53c8155d80 legacy=0x7f53c80aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cd3ba700 1 -- 172.21.15.102:0/772758845 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c80ae140 con 0x7f53c80ad090 2024-08-17T02:25:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cd3ba700 1 --2- 172.21.15.102:0/772758845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c80ad090 0x7f53c8157a90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f53c806d4c0 tx=0x7f53b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7986795170f58af5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53c77fe700 1 -- 172.21.15.102:0/772758845 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b800b820 con 0x7f53c80ad090 2024-08-17T02:25:52.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53c77fe700 1 -- 172.21.15.102:0/772758845 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b800b980 con 0x7f53c80ad090 2024-08-17T02:25:52.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53c77fe700 1 -- 172.21.15.102:0/772758845 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b800bd20 con 0x7f53c80ad090 2024-08-17T02:25:52.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cdbbb700 1 -- 172.21.15.102:0/772758845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c80ad090 msgr2=0x7f53c8157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cdbbb700 1 --2- 172.21.15.102:0/772758845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c80ad090 0x7f53c8157a90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f53c806d4c0 tx=0x7f53b8009250 comp rx=0 tx=0).stop 2024-08-17T02:25:52.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cdbbb700 1 -- 172.21.15.102:0/772758845 shutdown_connections 2024-08-17T02:25:52.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cdbbb700 1 --2- 172.21.15.102:0/772758845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c80ad090 0x7f53c8157a90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cdbbb700 1 --2- 172.21.15.102:0/772758845 >> v2:172.21.15.121:3300/0 conn(0x7f53c80af5f0 0x7f53c80acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cdbbb700 1 -- 172.21.15.102:0/772758845 >> 172.21.15.102:0/772758845 conn(0x7f53c806e070 msgr2=0x7f53c80b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:52.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cdbbb700 1 -- 172.21.15.102:0/772758845 shutdown_connections 2024-08-17T02:25:52.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.013+0000 7f53cdbbb700 1 -- 172.21.15.102:0/772758845 wait complete. 2024-08-17T02:25:52.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53cdbbb700 1 Processor -- start 2024-08-17T02:25:52.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53cdbbb700 1 -- start start 2024-08-17T02:25:52.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53cdbbb700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53c80ad090 0x7f53c8167e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53cdbbb700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c80af5f0 0x7f53c81467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53cdbbb700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53c8155d80 0x7f53c8067690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53cdbbb700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80b14c0 con 0x7f53c80af5f0 2024-08-17T02:25:52.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53cdbbb700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c81492f0 con 0x7f53c8155d80 2024-08-17T02:25:52.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53cdbbb700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c8168360 con 0x7f53c80ad090 2024-08-17T02:25:52.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53c7fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c80af5f0 0x7f53c81467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53c7fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c80af5f0 0x7f53c81467c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47800/0 (socket says 172.21.15.102:47800) 2024-08-17T02:25:52.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53c7fff700 1 -- 172.21.15.102:0/1168394527 learned_addr learned my addr 172.21.15.102:0/1168394527 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:52.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53cd3ba700 1 --2- 172.21.15.102:0/1168394527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53c8155d80 0x7f53c8067690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53ccbb9700 1 --2- 172.21.15.102:0/1168394527 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53c80ad090 0x7f53c8167e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53c7fff700 1 -- 172.21.15.102:0/1168394527 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53c80ad090 msgr2=0x7f53c8167e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53c7fff700 1 --2- 172.21.15.102:0/1168394527 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53c80ad090 0x7f53c8167e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53c7fff700 1 -- 172.21.15.102:0/1168394527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53c8155d80 msgr2=0x7f53c8067690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53c7fff700 1 --2- 172.21.15.102:0/1168394527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53c8155d80 0x7f53c8067690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53c7fff700 1 -- 172.21.15.102:0/1168394527 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b80094f0 con 0x7f53c80af5f0 2024-08-17T02:25:52.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53ccbb9700 1 --2- 172.21.15.102:0/1168394527 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53c80ad090 0x7f53c8167e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:52.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53c7fff700 1 --2- 172.21.15.102:0/1168394527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c80af5f0 0x7f53c81467c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00d890 tx=0x7f53bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:52.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53c4ff9700 1 -- 172.21.15.102:0/1168394527 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc0125f0 con 0x7f53c80af5f0 2024-08-17T02:25:52.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53c4ff9700 1 -- 172.21.15.102:0/1168394527 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc012770 con 0x7f53c80af5f0 2024-08-17T02:25:52.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53cdbbb700 1 -- 172.21.15.102:0/1168394527 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c814faa0 con 0x7f53c80af5f0 2024-08-17T02:25:52.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53c4ff9700 1 -- 172.21.15.102:0/1168394527 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc012b30 con 0x7f53c80af5f0 2024-08-17T02:25:52.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.017+0000 7f53cdbbb700 1 -- 172.21.15.102:0/1168394527 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c8149820 con 0x7f53c80af5f0 2024-08-17T02:25:52.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.021+0000 7f53cdbbb700 1 -- 172.21.15.102:0/1168394527 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c80638f0 con 0x7f53c80af5f0 2024-08-17T02:25:52.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.021+0000 7f53c4ff9700 1 -- 172.21.15.102:0/1168394527 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 80087+0+0 (secure 0 0 0) 0x7f53bc01e460 con 0x7f53c80af5f0 2024-08-17T02:25:52.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.021+0000 7f53c4ff9700 1 --2- 172.21.15.102:0/1168394527 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f53b40607d0 0x7f53b4062c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.021+0000 7f53c4ff9700 1 -- 172.21.15.102:0/1168394527 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f53bc07cda0 con 0x7f53c80af5f0 2024-08-17T02:25:52.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.029+0000 7f53c4ff9700 1 -- 172.21.15.102:0/1168394527 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f53bc04d620 con 0x7f53c80af5f0 2024-08-17T02:25:52.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.053+0000 7f53ccbb9700 1 --2- 172.21.15.102:0/1168394527 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f53b40607d0 0x7f53b4062c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.053+0000 7f53ccbb9700 1 --2- 172.21.15.102:0/1168394527 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f53b40607d0 0x7f53b4062c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f53c000c330 tx=0x7f53c00074d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:52.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.233+0000 7f53cdbbb700 1 -- 172.21.15.102:0/1168394527 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53c80aeaf0 con 0x7f53c80af5f0 2024-08-17T02:25:52.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.233+0000 7f53c4ff9700 1 -- 172.21.15.102:0/1168394527 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7f53bc050c40 con 0x7f53c80af5f0 2024-08-17T02:25:52.237 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:52.237 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/3384500830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3384500830},{"type":"v1","addr":"172.21.15.121:6833","nonce":3384500830}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1668690087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1668690087},{"type":"v1","addr":"172.21.15.102:6837","nonce":1668690087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/932475255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":932475255},{"type":"v1","addr":"172.21.15.102:6835","nonce":932475255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/4026340784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4026340784},{"type":"v1","addr":"172.21.15.121:6835","nonce":4026340784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-08-17T02:25:52.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.237+0000 7f53cdbbb700 1 -- 172.21.15.102:0/1168394527 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f53b40607d0 msgr2=0x7f53b4062c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.237+0000 7f53cdbbb700 1 --2- 172.21.15.102:0/1168394527 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f53b40607d0 0x7f53b4062c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f53c000c330 tx=0x7f53c00074d0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.237+0000 7f53cdbbb700 1 -- 172.21.15.102:0/1168394527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c80af5f0 msgr2=0x7f53c81467c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.237+0000 7f53cdbbb700 1 --2- 172.21.15.102:0/1168394527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c80af5f0 0x7f53c81467c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00d890 tx=0x7f53bc008040 comp rx=0 tx=0).stop 2024-08-17T02:25:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.237+0000 7f53cdbbb700 1 -- 172.21.15.102:0/1168394527 shutdown_connections 2024-08-17T02:25:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.237+0000 7f53cdbbb700 1 --2- 172.21.15.102:0/1168394527 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f53b40607d0 0x7f53b4062c80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.237+0000 7f53cdbbb700 1 --2- 172.21.15.102:0/1168394527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c80af5f0 0x7f53c81467c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.237+0000 7f53cdbbb700 1 --2- 172.21.15.102:0/1168394527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53c8155d80 0x7f53c8067690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.237+0000 7f53cdbbb700 1 --2- 172.21.15.102:0/1168394527 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f53c80ad090 0x7f53c8167e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.237+0000 7f53cdbbb700 1 -- 172.21.15.102:0/1168394527 >> 172.21.15.102:0/1168394527 conn(0x7f53c806e070 msgr2=0x7f53c8158840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.237+0000 7f53cdbbb700 1 -- 172.21.15.102:0/1168394527 shutdown_connections 2024-08-17T02:25:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.237+0000 7f53cdbbb700 1 -- 172.21.15.102:0/1168394527 wait complete. 2024-08-17T02:25:52.241 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 3 2024-08-17T02:25:52.251 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:52.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.353+0000 7fb525789700 1 Processor -- start 2024-08-17T02:25:52.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.353+0000 7fb525789700 1 -- start start 2024-08-17T02:25:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.353+0000 7fb525789700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb520155760 0x7fb5200682a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.353+0000 7fb525789700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb520155b50 con 0x7fb5200c9dd0 2024-08-17T02:25:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.353+0000 7fb525789700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb52006b6d0 con 0x7fb520155390 2024-08-17T02:25:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.353+0000 7fb525789700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb52006b3f0 con 0x7fb520155760 2024-08-17T02:25:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.353+0000 7fb524f88700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb520155760 0x7fb5200682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb51f7fe700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fb5200c9dd0 0x7fb5200697d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49506/0 (socket says 172.21.15.102:49506) 2024-08-17T02:25:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb51f7fe700 1 -- 172.21.15.102:0/300872278 learned_addr learned my addr 172.21.15.102:0/300872278 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:25:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb524f88700 1 -- 172.21.15.102:0/300872278 >> v1:172.21.15.121:6789/0 conn(0x7fb520155390 legacy=0x7fb5200c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb524f88700 1 -- 172.21.15.102:0/300872278 >> v1:172.21.15.102:6789/0 conn(0x7fb5200c9dd0 legacy=0x7fb5200697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb524f88700 1 -- 172.21.15.102:0/300872278 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5200677c0 con 0x7fb520155760 2024-08-17T02:25:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb51effd700 1 -- 172.21.15.102:0/300872278 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640651592 0 0) 0x7fb520155b50 con 0x7fb5200c9dd0 2024-08-17T02:25:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb524f88700 1 --2- 172.21.15.102:0/300872278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb520155760 0x7fb5200682a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb518009e60 tx=0x7fb518009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57353c02731a0046 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb51effd700 1 -- 172.21.15.102:0/300872278 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51800e070 con 0x7fb520155760 2024-08-17T02:25:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb51effd700 1 -- 172.21.15.102:0/300872278 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51800bc30 con 0x7fb520155760 2024-08-17T02:25:52.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb51effd700 1 -- 172.21.15.102:0/300872278 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb518012430 con 0x7fb520155760 2024-08-17T02:25:52.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb525789700 1 -- 172.21.15.102:0/300872278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb520155760 msgr2=0x7fb5200682a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb525789700 1 --2- 172.21.15.102:0/300872278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb520155760 0x7fb5200682a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb518009e60 tx=0x7fb518009780 comp rx=0 tx=0).stop 2024-08-17T02:25:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb525789700 1 -- 172.21.15.102:0/300872278 shutdown_connections 2024-08-17T02:25:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb525789700 1 --2- 172.21.15.102:0/300872278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb520155760 0x7fb5200682a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb525789700 1 -- 172.21.15.102:0/300872278 >> 172.21.15.102:0/300872278 conn(0x7fb5200ccfc0 msgr2=0x7fb5200c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb525789700 1 -- 172.21.15.102:0/300872278 shutdown_connections 2024-08-17T02:25:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.357+0000 7fb525789700 1 -- 172.21.15.102:0/300872278 wait complete. 2024-08-17T02:25:52.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb525789700 1 Processor -- start 2024-08-17T02:25:52.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb525789700 1 -- start start 2024-08-17T02:25:52.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb525789700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb5200c9dd0 0x7fb520159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb525789700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb520155390 0x7fb5200c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb525789700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb520155760 0x7fb520167820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb525789700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb520167d60 con 0x7fb520155760 2024-08-17T02:25:52.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb525789700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52015a4c0 con 0x7fb520155390 2024-08-17T02:25:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb525789700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52015a7a0 con 0x7fb5200c9dd0 2024-08-17T02:25:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb524f88700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb520155760 0x7fb520167820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb51f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb520155390 0x7fb5200c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb524f88700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb520155760 0x7fb520167820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47814/0 (socket says 172.21.15.102:47814) 2024-08-17T02:25:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb51f7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb520155390 0x7fb5200c13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:52130/0 (socket says 172.21.15.102:52130) 2024-08-17T02:25:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb51ffff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb5200c9dd0 0x7fb520159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb524f88700 1 -- 172.21.15.102:0/1626280161 learned_addr learned my addr 172.21.15.102:0/1626280161 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb51f7fe700 1 -- 172.21.15.102:0/1626280161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb5200c9dd0 msgr2=0x7fb520159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb51f7fe700 1 --2- 172.21.15.102:0/1626280161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb5200c9dd0 0x7fb520159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb51f7fe700 1 -- 172.21.15.102:0/1626280161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb520155760 msgr2=0x7fb520167820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb51f7fe700 1 --2- 172.21.15.102:0/1626280161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb520155760 0x7fb520167820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb51f7fe700 1 -- 172.21.15.102:0/1626280161 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb518009a20 con 0x7fb520155390 2024-08-17T02:25:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb524f88700 1 --2- 172.21.15.102:0/1626280161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb520155760 0x7fb520167820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.361+0000 7fb51f7fe700 1 --2- 172.21.15.102:0/1626280161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb520155390 0x7fb5200c13e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb51400c4c0 tx=0x7fb514007f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.365+0000 7fb507fff700 1 -- 172.21.15.102:0/1626280161 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51400ce70 con 0x7fb520155390 2024-08-17T02:25:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.365+0000 7fb507fff700 1 -- 172.21.15.102:0/1626280161 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb514005b30 con 0x7fb520155390 2024-08-17T02:25:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.365+0000 7fb525789700 1 -- 172.21.15.102:0/1626280161 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb52015aa80 con 0x7fb520155390 2024-08-17T02:25:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.365+0000 7fb507fff700 1 -- 172.21.15.102:0/1626280161 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5140070d0 con 0x7fb520155390 2024-08-17T02:25:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.365+0000 7fb525789700 1 -- 172.21.15.102:0/1626280161 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb52015b9c0 con 0x7fb520155390 2024-08-17T02:25:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.365+0000 7fb525789700 1 -- 172.21.15.102:0/1626280161 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52015bbe0 con 0x7fb520155390 2024-08-17T02:25:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.365+0000 7fb507fff700 1 -- 172.21.15.102:0/1626280161 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) v1 ==== 80087+0+0 (secure 0 0 0) 0x7fb5140074c0 con 0x7fb520155390 2024-08-17T02:25:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.365+0000 7fb507fff700 1 --2- 172.21.15.102:0/1626280161 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb50c0607d0 0x7fb50c062c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.365+0000 7fb507fff700 1 -- 172.21.15.102:0/1626280161 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb51407bae0 con 0x7fb520155390 2024-08-17T02:25:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.365+0000 7fb51ffff700 1 --2- 172.21.15.102:0/1626280161 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb50c0607d0 0x7fb50c062c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.365+0000 7fb51ffff700 1 --2- 172.21.15.102:0/1626280161 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb50c0607d0 0x7fb50c062c80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb520164990 tx=0x7fb510009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.377+0000 7fb507fff700 1 -- 172.21.15.102:0/1626280161 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb51404c360 con 0x7fb520155390 2024-08-17T02:25:52.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.541+0000 7fb525789700 1 -- 172.21.15.102:0/1626280161 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5200638f0 con 0x7fb520155390 2024-08-17T02:25:52.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.545+0000 7fb507fff700 1 -- 172.21.15.102:0/1626280161 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12175 (secure 0 0 0) 0x7fb51404f980 con 0x7fb520155390 2024-08-17T02:25:52.546 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:52.547 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":17,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:51.885645+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.545+0000 7fb525789700 1 -- 172.21.15.102:0/1626280161 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb50c0607d0 msgr2=0x7fb50c062c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.545+0000 7fb525789700 1 --2- 172.21.15.102:0/1626280161 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb50c0607d0 0x7fb50c062c80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb520164990 tx=0x7fb510009040 comp rx=0 tx=0).stop 2024-08-17T02:25:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.545+0000 7fb525789700 1 -- 172.21.15.102:0/1626280161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb520155390 msgr2=0x7fb5200c13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.545+0000 7fb525789700 1 --2- 172.21.15.102:0/1626280161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb520155390 0x7fb5200c13e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb51400c4c0 tx=0x7fb514007f50 comp rx=0 tx=0).stop 2024-08-17T02:25:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.545+0000 7fb525789700 1 -- 172.21.15.102:0/1626280161 shutdown_connections 2024-08-17T02:25:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.545+0000 7fb525789700 1 --2- 172.21.15.102:0/1626280161 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb50c0607d0 0x7fb50c062c80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.545+0000 7fb525789700 1 --2- 172.21.15.102:0/1626280161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb520155760 0x7fb520167820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.545+0000 7fb525789700 1 --2- 172.21.15.102:0/1626280161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb520155390 0x7fb5200c13e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.545+0000 7fb525789700 1 --2- 172.21.15.102:0/1626280161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb5200c9dd0 0x7fb520159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.545+0000 7fb525789700 1 -- 172.21.15.102:0/1626280161 >> 172.21.15.102:0/1626280161 conn(0x7fb5200ccfc0 msgr2=0x7fb5200ca440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.545+0000 7fb525789700 1 -- 172.21.15.102:0/1626280161 shutdown_connections 2024-08-17T02:25:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.545+0000 7fb525789700 1 -- 172.21.15.102:0/1626280161 wait complete. 2024-08-17T02:25:52.560 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:49.236728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:25:52.560 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:52.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f4870ccc700 1 Processor -- start 2024-08-17T02:25:52.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f4870ccc700 1 -- start start 2024-08-17T02:25:52.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f4870ccc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f486c159400 0x7f486c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f4870ccc700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f486c1597d0 0x7f486c0ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f4870ccc700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f486c0686a0 0x7f486c068b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f4870ccc700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f486c069060 con 0x7f486c0686a0 2024-08-17T02:25:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f4870ccc700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f486c0ac630 con 0x7f486c159400 2024-08-17T02:25:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f4870ccc700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486c0ac910 con 0x7f486c1597d0 2024-08-17T02:25:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f486ad9d700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f486c0686a0 0x7f486c068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f486ad9d700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f486c0686a0 0x7f486c068b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47826/0 (socket says 172.21.15.102:47826) 2024-08-17T02:25:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f486ad9d700 1 -- 172.21.15.102:0/3818781297 learned_addr learned my addr 172.21.15.102:0/3818781297 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f486a59c700 1 --2- 172.21.15.102:0/3818781297 >> v2:172.21.15.121:3300/0 conn(0x7f486c159400 0x7f486c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f4869d9b700 1 --2- 172.21.15.102:0/3818781297 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f486c1597d0 0x7f486c0ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f486ad9d700 1 -- 172.21.15.102:0/3818781297 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f486c1597d0 msgr2=0x7f486c0ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f486ad9d700 1 --2- 172.21.15.102:0/3818781297 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f486c1597d0 0x7f486c0ad3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f486ad9d700 1 -- 172.21.15.102:0/3818781297 >> v2:172.21.15.121:3300/0 conn(0x7f486c159400 msgr2=0x7f486c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f486ad9d700 1 --2- 172.21.15.102:0/3818781297 >> v2:172.21.15.121:3300/0 conn(0x7f486c159400 0x7f486c0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f486ad9d700 1 -- 172.21.15.102:0/3818781297 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c0acbf0 con 0x7f486c0686a0 2024-08-17T02:25:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f486a59c700 1 --2- 172.21.15.102:0/3818781297 >> v2:172.21.15.121:3300/0 conn(0x7f486c159400 0x7f486c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:52.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.661+0000 7f486ad9d700 1 --2- 172.21.15.102:0/3818781297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f486c0686a0 0x7f486c068b20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f486c0701a0 tx=0x7f4864009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460280dd04aba54b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:52.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.717+0000 7f486959a700 1 -- 172.21.15.102:0/3818781297 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486400e070 con 0x7f486c0686a0 2024-08-17T02:25:52.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.717+0000 7f486959a700 1 -- 172.21.15.102:0/3818781297 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486400b970 con 0x7f486c0686a0 2024-08-17T02:25:52.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.717+0000 7f486959a700 1 -- 172.21.15.102:0/3818781297 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48640092e0 con 0x7f486c0686a0 2024-08-17T02:25:52.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.717+0000 7f4870ccc700 1 -- 172.21.15.102:0/3818781297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f486c0686a0 msgr2=0x7f486c068b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.717+0000 7f4870ccc700 1 --2- 172.21.15.102:0/3818781297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f486c0686a0 0x7f486c068b20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f486c0701a0 tx=0x7f4864009840 comp rx=0 tx=0).stop 2024-08-17T02:25:52.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.717+0000 7f4870ccc700 1 -- 172.21.15.102:0/3818781297 shutdown_connections 2024-08-17T02:25:52.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.717+0000 7f4870ccc700 1 --2- 172.21.15.102:0/3818781297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f486c0686a0 0x7f486c068b20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.717+0000 7f4870ccc700 1 --2- 172.21.15.102:0/3818781297 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f486c1597d0 0x7f486c0ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.717+0000 7f4870ccc700 1 --2- 172.21.15.102:0/3818781297 >> v2:172.21.15.121:3300/0 conn(0x7f486c159400 0x7f486c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.717+0000 7f4870ccc700 1 -- 172.21.15.102:0/3818781297 >> 172.21.15.102:0/3818781297 conn(0x7f486c0c9bf0 msgr2=0x7f486c06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:52.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.717+0000 7f4870ccc700 1 -- 172.21.15.102:0/3818781297 shutdown_connections 2024-08-17T02:25:52.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.717+0000 7f4870ccc700 1 -- 172.21.15.102:0/3818781297 wait complete. 2024-08-17T02:25:52.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.721+0000 7f4870ccc700 1 Processor -- start 2024-08-17T02:25:52.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.721+0000 7f4870ccc700 1 -- start start 2024-08-17T02:25:52.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.721+0000 7f4870ccc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f486c0686a0 0x7f486c0a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.721+0000 7f4870ccc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f486c159400 0x7f486c154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.721+0000 7f4870ccc700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f486c1597d0 0x7f486c0a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.721+0000 7f4870ccc700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c0a6b20 con 0x7f486c0686a0 2024-08-17T02:25:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.721+0000 7f4870ccc700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c0a74f0 con 0x7f486c159400 2024-08-17T02:25:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.721+0000 7f4870ccc700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486c0a5f10 con 0x7f486c1597d0 2024-08-17T02:25:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.721+0000 7f486a59c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f486c0686a0 0x7f486c0a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.721+0000 7f486a59c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f486c0686a0 0x7f486c0a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47832/0 (socket says 172.21.15.102:47832) 2024-08-17T02:25:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.721+0000 7f486a59c700 1 -- 172.21.15.102:0/621976956 learned_addr learned my addr 172.21.15.102:0/621976956 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.721+0000 7f486ad9d700 1 --2- 172.21.15.102:0/621976956 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f486c1597d0 0x7f486c0a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.725+0000 7f4869d9b700 1 --2- 172.21.15.102:0/621976956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f486c159400 0x7f486c154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.725+0000 7f486a59c700 1 -- 172.21.15.102:0/621976956 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f486c1597d0 msgr2=0x7f486c0a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.725+0000 7f486a59c700 1 --2- 172.21.15.102:0/621976956 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f486c1597d0 0x7f486c0a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.725+0000 7f486a59c700 1 -- 172.21.15.102:0/621976956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f486c159400 msgr2=0x7f486c154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.725+0000 7f486a59c700 1 --2- 172.21.15.102:0/621976956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f486c159400 0x7f486c154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.725+0000 7f486a59c700 1 -- 172.21.15.102:0/621976956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4854009420 con 0x7f486c0686a0 2024-08-17T02:25:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.725+0000 7f486a59c700 1 --2- 172.21.15.102:0/621976956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f486c0686a0 0x7f486c0a6fb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f485400ec80 tx=0x7f48540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.725+0000 7f48627fc700 1 -- 172.21.15.102:0/621976956 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485400c920 con 0x7f486c0686a0 2024-08-17T02:25:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.725+0000 7f48627fc700 1 -- 172.21.15.102:0/621976956 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485400ca80 con 0x7f486c0686a0 2024-08-17T02:25:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.725+0000 7f4870ccc700 1 -- 172.21.15.102:0/621976956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4864009ae0 con 0x7f486c0686a0 2024-08-17T02:25:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.725+0000 7f48627fc700 1 -- 172.21.15.102:0/621976956 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485400ce00 con 0x7f486c0686a0 2024-08-17T02:25:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.725+0000 7f4870ccc700 1 -- 172.21.15.102:0/621976956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486c0a67b0 con 0x7f486c0686a0 2024-08-17T02:25:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.725+0000 7f4870ccc700 1 -- 172.21.15.102:0/621976956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486c0645c0 con 0x7f486c0686a0 2024-08-17T02:25:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.729+0000 7f48627fc700 1 -- 172.21.15.102:0/621976956 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 80087+0+0 (secure 0 0 0) 0x7f4854013680 con 0x7f486c0686a0 2024-08-17T02:25:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.729+0000 7f48627fc700 1 --2- 172.21.15.102:0/621976956 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f484c060800 0x7f484c062cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.729+0000 7f4869d9b700 1 --2- 172.21.15.102:0/621976956 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f484c060800 0x7f484c062cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.729+0000 7f48627fc700 1 -- 172.21.15.102:0/621976956 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f485407cb70 con 0x7f486c0686a0 2024-08-17T02:25:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.729+0000 7f4869d9b700 1 --2- 172.21.15.102:0/621976956 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f484c060800 0x7f484c062cb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f486c15bee0 tx=0x7f485c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.737+0000 7f48627fc700 1 -- 172.21.15.102:0/621976956 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f485407ee60 con 0x7f486c0686a0 2024-08-17T02:25:52.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.901+0000 7f4870ccc700 1 -- 172.21.15.102:0/621976956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f486c0cc330 con 0x7f486c0686a0 2024-08-17T02:25:52.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.901+0000 7f48627fc700 1 -- 172.21.15.102:0/621976956 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f485404d350 con 0x7f486c0686a0 2024-08-17T02:25:52.904 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-08-17T02:25:52.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.905+0000 7f4870ccc700 1 -- 172.21.15.102:0/621976956 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f484c060800 msgr2=0x7f484c062cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.905+0000 7f4870ccc700 1 --2- 172.21.15.102:0/621976956 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f484c060800 0x7f484c062cb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f486c15bee0 tx=0x7f485c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.905+0000 7f4870ccc700 1 -- 172.21.15.102:0/621976956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f486c0686a0 msgr2=0x7f486c0a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.905+0000 7f4870ccc700 1 --2- 172.21.15.102:0/621976956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f486c0686a0 0x7f486c0a6fb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f485400ec80 tx=0x7f48540091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.905+0000 7f4870ccc700 1 -- 172.21.15.102:0/621976956 shutdown_connections 2024-08-17T02:25:52.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.905+0000 7f4870ccc700 1 --2- 172.21.15.102:0/621976956 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f484c060800 0x7f484c062cb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.905+0000 7f4870ccc700 1 --2- 172.21.15.102:0/621976956 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f486c1597d0 0x7f486c0a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.905+0000 7f4870ccc700 1 --2- 172.21.15.102:0/621976956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f486c159400 0x7f486c154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.905+0000 7f4870ccc700 1 --2- 172.21.15.102:0/621976956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f486c0686a0 0x7f486c0a6fb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.905+0000 7f4870ccc700 1 -- 172.21.15.102:0/621976956 >> 172.21.15.102:0/621976956 conn(0x7f486c0c9bf0 msgr2=0x7f486c067100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:52.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.905+0000 7f4870ccc700 1 -- 172.21.15.102:0/621976956 shutdown_connections 2024-08-17T02:25:52.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:52.905+0000 7f4870ccc700 1 -- 172.21.15.102:0/621976956 wait complete. 2024-08-17T02:25:52.918 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:25:53.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f1192bd5700 1 Processor -- start 2024-08-17T02:25:53.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f1192bd5700 1 -- start start 2024-08-17T02:25:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f1192bd5700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f118c0cddc0 0x7f118c0ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f1192bd5700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c0cef40 con 0x7f118c0cb240 2024-08-17T02:25:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f1192bd5700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c0ce330 con 0x7f118c159340 2024-08-17T02:25:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f1192bd5700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c0ad930 con 0x7f118c0cddc0 2024-08-17T02:25:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f118bfff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f118c0cddc0 0x7f118c0ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f118bfff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f118c0cddc0 0x7f118c0ad3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47836/0 (socket says 172.21.15.102:47836) 2024-08-17T02:25:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f118bfff700 1 -- 172.21.15.102:0/4136954097 learned_addr learned my addr 172.21.15.102:0/4136954097 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f1191172700 1 --1- 172.21.15.102:0/4136954097 >> v1:172.21.15.102:6789/0 conn(0x7f118c0cb240 0x7f118c0cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49522/0 (socket says 172.21.15.102:49522) 2024-08-17T02:25:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f118bfff700 1 -- 172.21.15.102:0/4136954097 >> v1:172.21.15.121:6789/0 conn(0x7f118c159340 legacy=0x7f118c0cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f118bfff700 1 -- 172.21.15.102:0/4136954097 >> v1:172.21.15.102:6789/0 conn(0x7f118c0cb240 legacy=0x7f118c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f118b7fe700 1 -- 172.21.15.102:0/4136954097 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761749417 0 0) 0x7f118c0cef40 con 0x7f118c0cb240 2024-08-17T02:25:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f118bfff700 1 -- 172.21.15.102:0/4136954097 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c0ce610 con 0x7f118c0cddc0 2024-08-17T02:25:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f118bfff700 1 --2- 172.21.15.102:0/4136954097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118c0cddc0 0x7f118c0ad3f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f11740099b0 tx=0x7f1174009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fa6ca04dfc4a9f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f118b7fe700 1 -- 172.21.15.102:0/4136954097 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117400b8f0 con 0x7f118c0cddc0 2024-08-17T02:25:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f118b7fe700 1 -- 172.21.15.102:0/4136954097 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117400ba50 con 0x7f118c0cddc0 2024-08-17T02:25:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.025+0000 7f118b7fe700 1 -- 172.21.15.102:0/4136954097 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117400bdf0 con 0x7f118c0cddc0 2024-08-17T02:25:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.029+0000 7f1192bd5700 1 -- 172.21.15.102:0/4136954097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118c0cddc0 msgr2=0x7f118c0ad3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.029+0000 7f1192bd5700 1 --2- 172.21.15.102:0/4136954097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118c0cddc0 0x7f118c0ad3f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f11740099b0 tx=0x7f1174009250 comp rx=0 tx=0).stop 2024-08-17T02:25:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.029+0000 7f1192bd5700 1 -- 172.21.15.102:0/4136954097 shutdown_connections 2024-08-17T02:25:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.029+0000 7f1192bd5700 1 --2- 172.21.15.102:0/4136954097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118c0cddc0 0x7f118c0ad3f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.029+0000 7f1192bd5700 1 -- 172.21.15.102:0/4136954097 >> 172.21.15.102:0/4136954097 conn(0x7f118c0994e0 msgr2=0x7f118c0675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.029+0000 7f1192bd5700 1 -- 172.21.15.102:0/4136954097 shutdown_connections 2024-08-17T02:25:53.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.029+0000 7f1192bd5700 1 -- 172.21.15.102:0/4136954097 wait complete. 2024-08-17T02:25:53.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1192bd5700 1 Processor -- start 2024-08-17T02:25:53.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1192bd5700 1 -- start start 2024-08-17T02:25:53.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1192bd5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118c0cb240 0x7f118c147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1192bd5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f118c0cddc0 0x7f118c0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1192bd5700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f118c159340 0x7f118c0caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1192bd5700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0af880 con 0x7f118c0cb240 2024-08-17T02:25:53.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1192bd5700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0afe40 con 0x7f118c0cddc0 2024-08-17T02:25:53.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1192bd5700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c147860 con 0x7f118c159340 2024-08-17T02:25:53.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1190971700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118c0cb240 0x7f118c147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1190971700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118c0cb240 0x7f118c147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47848/0 (socket says 172.21.15.102:47848) 2024-08-17T02:25:53.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1190971700 1 -- 172.21.15.102:0/638891938 learned_addr learned my addr 172.21.15.102:0/638891938 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:53.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f118bfff700 1 --2- 172.21.15.102:0/638891938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f118c0cddc0 0x7f118c0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1191172700 1 --2- 172.21.15.102:0/638891938 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f118c159340 0x7f118c0caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1190971700 1 -- 172.21.15.102:0/638891938 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f118c159340 msgr2=0x7f118c0caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1190971700 1 --2- 172.21.15.102:0/638891938 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f118c159340 0x7f118c0caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1190971700 1 -- 172.21.15.102:0/638891938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f118c0cddc0 msgr2=0x7f118c0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1190971700 1 --2- 172.21.15.102:0/638891938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f118c0cddc0 0x7f118c0ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1190971700 1 -- 172.21.15.102:0/638891938 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740094f0 con 0x7f118c0cb240 2024-08-17T02:25:53.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1190971700 1 --2- 172.21.15.102:0/638891938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118c0cb240 0x7f118c147320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f117c00c910 tx=0x7f117c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1188ff9700 1 -- 172.21.15.102:0/638891938 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c00a7a0 con 0x7f118c0cb240 2024-08-17T02:25:53.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1188ff9700 1 -- 172.21.15.102:0/638891938 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c00a920 con 0x7f118c0cb240 2024-08-17T02:25:53.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1192bd5700 1 -- 172.21.15.102:0/638891938 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c0b5b30 con 0x7f118c0cb240 2024-08-17T02:25:53.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1188ff9700 1 -- 172.21.15.102:0/638891938 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c00ace0 con 0x7f118c0cb240 2024-08-17T02:25:53.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.033+0000 7f1192bd5700 1 -- 172.21.15.102:0/638891938 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c0afad0 con 0x7f118c0cb240 2024-08-17T02:25:53.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.037+0000 7f1192bd5700 1 -- 172.21.15.102:0/638891938 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c0645c0 con 0x7f118c0cb240 2024-08-17T02:25:53.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.037+0000 7f1188ff9700 1 -- 172.21.15.102:0/638891938 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 80087+0+0 (secure 0 0 0) 0x7f117c003030 con 0x7f118c0cb240 2024-08-17T02:25:53.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.037+0000 7f1188ff9700 1 --2- 172.21.15.102:0/638891938 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f116c0607d0 0x7f116c062c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.037+0000 7f1188ff9700 1 -- 172.21.15.102:0/638891938 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f117c07c7d0 con 0x7f118c0cb240 2024-08-17T02:25:53.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.037+0000 7f118bfff700 1 --2- 172.21.15.102:0/638891938 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f116c0607d0 0x7f116c062c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.037+0000 7f118bfff700 1 --2- 172.21.15.102:0/638891938 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f116c0607d0 0x7f116c062c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f11740099b0 tx=0x7f1174017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.041+0000 7f1188ff9700 1 -- 172.21.15.102:0/638891938 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f117c04d050 con 0x7f118c0cb240 2024-08-17T02:25:53.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.209+0000 7f1192bd5700 1 -- 172.21.15.102:0/638891938 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f118c0d0570 con 0x7f118c0cb240 2024-08-17T02:25:53.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.213+0000 7f1188ff9700 1 -- 172.21.15.102:0/638891938 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f117c001380 con 0x7f118c0cb240 2024-08-17T02:25:53.214 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:53.214 INFO:teuthology.orchestra.run.smithi102.stdout:[ 2024-08-17T02:25:53.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:25:53.214 INFO:teuthology.orchestra.run.smithi102.stdout: "poolnum": 1, 2024-08-17T02:25:53.214 INFO:teuthology.orchestra.run.smithi102.stdout: "poolname": ".mgr" 2024-08-17T02:25:53.214 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:25:53.214 INFO:teuthology.orchestra.run.smithi102.stdout:] 2024-08-17T02:25:53.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.213+0000 7f1192bd5700 1 -- 172.21.15.102:0/638891938 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f116c0607d0 msgr2=0x7f116c062c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.213+0000 7f1192bd5700 1 --2- 172.21.15.102:0/638891938 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f116c0607d0 0x7f116c062c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f11740099b0 tx=0x7f1174017000 comp rx=0 tx=0).stop 2024-08-17T02:25:53.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.213+0000 7f1192bd5700 1 -- 172.21.15.102:0/638891938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118c0cb240 msgr2=0x7f118c147320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.213+0000 7f1192bd5700 1 --2- 172.21.15.102:0/638891938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118c0cb240 0x7f118c147320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f117c00c910 tx=0x7f117c001710 comp rx=0 tx=0).stop 2024-08-17T02:25:53.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.213+0000 7f1192bd5700 1 -- 172.21.15.102:0/638891938 shutdown_connections 2024-08-17T02:25:53.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.213+0000 7f1192bd5700 1 --2- 172.21.15.102:0/638891938 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f116c0607d0 0x7f116c062c80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.213+0000 7f1192bd5700 1 --2- 172.21.15.102:0/638891938 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f118c159340 0x7f118c0caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.213+0000 7f1192bd5700 1 --2- 172.21.15.102:0/638891938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f118c0cddc0 0x7f118c0ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.213+0000 7f1192bd5700 1 --2- 172.21.15.102:0/638891938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118c0cb240 0x7f118c147320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.213+0000 7f1192bd5700 1 -- 172.21.15.102:0/638891938 >> 172.21.15.102:0/638891938 conn(0x7f118c0994e0 msgr2=0x7f118c068cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:53.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.213+0000 7f1192bd5700 1 -- 172.21.15.102:0/638891938 shutdown_connections 2024-08-17T02:25:53.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.213+0000 7f1192bd5700 1 -- 172.21.15.102:0/638891938 wait complete. 2024-08-17T02:25:53.228 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:25:53.228 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:25:53.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.333+0000 7f0d8b114700 1 Processor -- start 2024-08-17T02:25:53.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.333+0000 7f0d8b114700 1 -- start start 2024-08-17T02:25:53.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.333+0000 7f0d8b114700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0d840ae250 0x7f0d840ae620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.333+0000 7f0d8b114700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0d84159de0 0x7f0d840cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.333+0000 7f0d8b114700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d840cb7d0 con 0x7f0d841599d0 2024-08-17T02:25:53.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.333+0000 7f0d8b114700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d840af590 con 0x7f0d84159de0 2024-08-17T02:25:53.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.333+0000 7f0d8b114700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8415a500 con 0x7f0d840ae250 2024-08-17T02:25:53.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.333+0000 7f0d89911700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0d841599d0 0x7f0d840cbc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49528/0 (socket says 172.21.15.102:49528) 2024-08-17T02:25:53.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d89911700 1 -- 172.21.15.102:0/4160922951 learned_addr learned my addr 172.21.15.102:0/4160922951 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:25:53.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d8a913700 1 --2- 172.21.15.102:0/4160922951 >> v2:172.21.15.102:3300/0 conn(0x7f0d84159de0 0x7f0d840cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d8a112700 1 --2- 172.21.15.102:0/4160922951 >> v2:172.21.15.121:3300/0 conn(0x7f0d840ae250 0x7f0d840ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d8a913700 1 -- 172.21.15.102:0/4160922951 >> v2:172.21.15.121:3300/0 conn(0x7f0d840ae250 msgr2=0x7f0d840ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:53.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d8a913700 1 --2- 172.21.15.102:0/4160922951 >> v2:172.21.15.121:3300/0 conn(0x7f0d840ae250 0x7f0d840ae620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d8a913700 1 -- 172.21.15.102:0/4160922951 >> v1:172.21.15.102:6789/0 conn(0x7f0d841599d0 legacy=0x7f0d840cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d89110700 1 -- 172.21.15.102:0/4160922951 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015059123 0 0) 0x7f0d840cb7d0 con 0x7f0d841599d0 2024-08-17T02:25:53.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d8a913700 1 -- 172.21.15.102:0/4160922951 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8415a7e0 con 0x7f0d84159de0 2024-08-17T02:25:53.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d8a913700 1 --2- 172.21.15.102:0/4160922951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d84159de0 0x7f0d840cc370 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0d8406d070 tx=0x7f0d7c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3498539fa6d383da server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d89110700 1 -- 172.21.15.102:0/4160922951 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c010070 con 0x7f0d84159de0 2024-08-17T02:25:53.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d89110700 1 -- 172.21.15.102:0/4160922951 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c00b2e0 con 0x7f0d84159de0 2024-08-17T02:25:53.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d89110700 1 -- 172.21.15.102:0/4160922951 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00dd50 con 0x7f0d84159de0 2024-08-17T02:25:53.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d8b114700 1 -- 172.21.15.102:0/4160922951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d84159de0 msgr2=0x7f0d840cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d8b114700 1 --2- 172.21.15.102:0/4160922951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d84159de0 0x7f0d840cc370 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0d8406d070 tx=0x7f0d7c00b990 comp rx=0 tx=0).stop 2024-08-17T02:25:53.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d8b114700 1 -- 172.21.15.102:0/4160922951 shutdown_connections 2024-08-17T02:25:53.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d8b114700 1 --2- 172.21.15.102:0/4160922951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d84159de0 0x7f0d840cc370 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d8b114700 1 --2- 172.21.15.102:0/4160922951 >> v2:172.21.15.121:3300/0 conn(0x7f0d840ae250 0x7f0d840ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d8b114700 1 -- 172.21.15.102:0/4160922951 >> 172.21.15.102:0/4160922951 conn(0x7f0d840a9d30 msgr2=0x7f0d840ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:53.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d8b114700 1 -- 172.21.15.102:0/4160922951 shutdown_connections 2024-08-17T02:25:53.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.337+0000 7f0d8b114700 1 -- 172.21.15.102:0/4160922951 wait complete. 2024-08-17T02:25:53.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d8b114700 1 Processor -- start 2024-08-17T02:25:53.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d8b114700 1 -- start start 2024-08-17T02:25:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d8b114700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d840ae250 0x7f0d8406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d8b114700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d841599d0 0x7f0d84152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d8b114700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d84159de0 0x7f0d84144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d8b114700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8416c690 con 0x7f0d841599d0 2024-08-17T02:25:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d8b114700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8416c970 con 0x7f0d840ae250 2024-08-17T02:25:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d8b114700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8416cc50 con 0x7f0d84159de0 2024-08-17T02:25:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d89911700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d841599d0 0x7f0d84152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d89911700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d841599d0 0x7f0d84152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47862/0 (socket says 172.21.15.102:47862) 2024-08-17T02:25:53.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d8a112700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d840ae250 0x7f0d8406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d89911700 1 -- 172.21.15.102:0/3714773483 learned_addr learned my addr 172.21.15.102:0/3714773483 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:53.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d8a913700 1 --2- 172.21.15.102:0/3714773483 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d84159de0 0x7f0d84144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d89911700 1 -- 172.21.15.102:0/3714773483 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d84159de0 msgr2=0x7f0d84144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d89911700 1 --2- 172.21.15.102:0/3714773483 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d84159de0 0x7f0d84144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d89911700 1 -- 172.21.15.102:0/3714773483 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d840ae250 msgr2=0x7f0d8406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d89911700 1 --2- 172.21.15.102:0/3714773483 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d840ae250 0x7f0d8406bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d89911700 1 -- 172.21.15.102:0/3714773483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c00bc30 con 0x7f0d841599d0 2024-08-17T02:25:53.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d89911700 1 --2- 172.21.15.102:0/3714773483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d841599d0 0x7f0d84152590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400c7e0 tx=0x7f0d74007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d7a7fc700 1 -- 172.21.15.102:0/3714773483 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74005b30 con 0x7f0d841599d0 2024-08-17T02:25:53.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d7a7fc700 1 -- 172.21.15.102:0/3714773483 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d74005c90 con 0x7f0d841599d0 2024-08-17T02:25:53.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d8b114700 1 -- 172.21.15.102:0/3714773483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8416cf30 con 0x7f0d841599d0 2024-08-17T02:25:53.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d7a7fc700 1 -- 172.21.15.102:0/3714773483 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74007300 con 0x7f0d841599d0 2024-08-17T02:25:53.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.341+0000 7f0d8b114700 1 -- 172.21.15.102:0/3714773483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d84153050 con 0x7f0d841599d0 2024-08-17T02:25:53.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.345+0000 7f0d8b114700 1 -- 172.21.15.102:0/3714773483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8416d170 con 0x7f0d841599d0 2024-08-17T02:25:53.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.345+0000 7f0d7a7fc700 1 -- 172.21.15.102:0/3714773483 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 80087+0+0 (secure 0 0 0) 0x7f0d7401b3b0 con 0x7f0d841599d0 2024-08-17T02:25:53.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.345+0000 7f0d7a7fc700 1 --2- 172.21.15.102:0/3714773483 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d680607d0 0x7f0d68062c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.345+0000 7f0d7a7fc700 1 -- 172.21.15.102:0/3714773483 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0d7407bc50 con 0x7f0d841599d0 2024-08-17T02:25:53.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.345+0000 7f0d8a112700 1 --2- 172.21.15.102:0/3714773483 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d680607d0 0x7f0d68062c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.345+0000 7f0d8a112700 1 --2- 172.21.15.102:0/3714773483 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d680607d0 0x7f0d68062c80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0d840aee70 tx=0x7f0d800091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.353+0000 7f0d7a7fc700 1 -- 172.21.15.102:0/3714773483 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0d8416d170 con 0x7f0d841599d0 2024-08-17T02:25:53.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.517+0000 7f0d8b114700 1 -- 172.21.15.102:0/3714773483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0d8416c7d0 con 0x7f0d841599d0 2024-08-17T02:25:53.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.977+0000 7f0d7a7fc700 1 -- 172.21.15.102:0/3714773483 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0d7404c8a0 con 0x7f0d841599d0 2024-08-17T02:25:53.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.981+0000 7f0d7a7fc700 1 -- 172.21.15.102:0/3714773483 <== mon.0 v2:172.21.15.102:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0d740693e0 con 0x7f0d841599d0 2024-08-17T02:25:53.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.985+0000 7f0d8b114700 1 -- 172.21.15.102:0/3714773483 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d680607d0 msgr2=0x7f0d68062c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.985+0000 7f0d8b114700 1 --2- 172.21.15.102:0/3714773483 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d680607d0 0x7f0d68062c80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0d840aee70 tx=0x7f0d800091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.985+0000 7f0d8b114700 1 -- 172.21.15.102:0/3714773483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d841599d0 msgr2=0x7f0d84152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.985+0000 7f0d8b114700 1 --2- 172.21.15.102:0/3714773483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d841599d0 0x7f0d84152590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400c7e0 tx=0x7f0d74007df0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.985+0000 7f0d8b114700 1 -- 172.21.15.102:0/3714773483 shutdown_connections 2024-08-17T02:25:53.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.985+0000 7f0d8b114700 1 --2- 172.21.15.102:0/3714773483 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d680607d0 0x7f0d68062c80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.985+0000 7f0d8b114700 1 --2- 172.21.15.102:0/3714773483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d841599d0 0x7f0d84152590 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.985+0000 7f0d8b114700 1 --2- 172.21.15.102:0/3714773483 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d84159de0 0x7f0d84144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.985+0000 7f0d8b114700 1 --2- 172.21.15.102:0/3714773483 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d840ae250 0x7f0d8406bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.985+0000 7f0d8b114700 1 -- 172.21.15.102:0/3714773483 >> 172.21.15.102:0/3714773483 conn(0x7f0d840a9d30 msgr2=0x7f0d840aaaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:53.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.985+0000 7f0d8b114700 1 -- 172.21.15.102:0/3714773483 shutdown_connections 2024-08-17T02:25:53.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:53.985+0000 7f0d8b114700 1 -- 172.21.15.102:0/3714773483 wait complete. 2024-08-17T02:25:53.991 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_metadata' created 2024-08-17T02:25:54.003 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:25:54.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.113+0000 7fb1ef049700 1 Processor -- start 2024-08-17T02:25:54.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.113+0000 7fb1ef049700 1 -- start start 2024-08-17T02:25:54.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.113+0000 7fb1ef049700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1e8153840 0x7fb1e80adb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.113+0000 7fb1ef049700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e815a870 con 0x7fb1e80b3950 2024-08-17T02:25:54.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.113+0000 7fb1ef049700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e80b0530 con 0x7fb1e80b34e0 2024-08-17T02:25:54.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.113+0000 7fb1ef049700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80ccc80 con 0x7fb1e8153840 2024-08-17T02:25:54.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.113+0000 7fb1ed5e6700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fb1e80b3950 0x7fb1e815d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49540/0 (socket says 172.21.15.102:49540) 2024-08-17T02:25:54.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.113+0000 7fb1ed5e6700 1 -- 172.21.15.102:0/2065054442 learned_addr learned my addr 172.21.15.102:0/2065054442 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:25:54.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.113+0000 7fb1ecde5700 1 --2- 172.21.15.102:0/2065054442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1e8153840 0x7fb1e80adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1e77fe700 1 -- 172.21.15.102:0/2065054442 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164602128 0 0) 0x7fb1e0001490 con 0x7fb1e80b3950 2024-08-17T02:25:54.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1e77fe700 1 -- 172.21.15.102:0/2065054442 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1d0003570 con 0x7fb1e80b3950 2024-08-17T02:25:54.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1ecde5700 1 -- 172.21.15.102:0/2065054442 >> v1:172.21.15.121:6789/0 conn(0x7fb1e80b34e0 legacy=0x7fb1e815ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1ecde5700 1 -- 172.21.15.102:0/2065054442 >> v1:172.21.15.102:6789/0 conn(0x7fb1e80b3950 legacy=0x7fb1e815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1e77fe700 1 -- 172.21.15.102:0/2065054442 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201216854 0 0) 0x7fb1e80b0530 con 0x7fb1e80b34e0 2024-08-17T02:25:54.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1ecde5700 1 -- 172.21.15.102:0/2065054442 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e80ae4f0 con 0x7fb1e8153840 2024-08-17T02:25:54.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1ecde5700 1 --2- 172.21.15.102:0/2065054442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1e8153840 0x7fb1e80adb80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009910 tx=0x7fb1dc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc00b0a5329e258 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:54.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1e77fe700 1 -- 172.21.15.102:0/2065054442 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc00b680 con 0x7fb1e8153840 2024-08-17T02:25:54.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1e77fe700 1 -- 172.21.15.102:0/2065054442 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc00b7e0 con 0x7fb1e8153840 2024-08-17T02:25:54.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1e77fe700 1 -- 172.21.15.102:0/2065054442 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc00bba0 con 0x7fb1e8153840 2024-08-17T02:25:54.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1ef049700 1 -- 172.21.15.102:0/2065054442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1e8153840 msgr2=0x7fb1e80adb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1ef049700 1 --2- 172.21.15.102:0/2065054442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1e8153840 0x7fb1e80adb80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009910 tx=0x7fb1dc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1ef049700 1 -- 172.21.15.102:0/2065054442 shutdown_connections 2024-08-17T02:25:54.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1ef049700 1 --2- 172.21.15.102:0/2065054442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1e8153840 0x7fb1e80adb80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1ef049700 1 -- 172.21.15.102:0/2065054442 >> 172.21.15.102:0/2065054442 conn(0x7fb1e80cab30 msgr2=0x7fb1e80caf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:54.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1ef049700 1 -- 172.21.15.102:0/2065054442 shutdown_connections 2024-08-17T02:25:54.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.117+0000 7fb1ef049700 1 -- 172.21.15.102:0/2065054442 wait complete. 2024-08-17T02:25:54.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ef049700 1 Processor -- start 2024-08-17T02:25:54.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ef049700 1 -- start start 2024-08-17T02:25:54.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ef049700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1e80b34e0 0x7fb1e814ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ef049700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1e80b3950 0x7fb1e815c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ef049700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1e8153840 0x7fb1e806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ef049700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80c7700 con 0x7fb1e8153840 2024-08-17T02:25:54.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ef049700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80c73b0 con 0x7fb1e80b34e0 2024-08-17T02:25:54.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ef049700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e815ccb0 con 0x7fb1e80b3950 2024-08-17T02:25:54.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ed5e6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1e8153840 0x7fb1e806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ed5e6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1e8153840 0x7fb1e806a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47876/0 (socket says 172.21.15.102:47876) 2024-08-17T02:25:54.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1e7fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1e80b3950 0x7fb1e815c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ed5e6700 1 -- 172.21.15.102:0/1521400474 learned_addr learned my addr 172.21.15.102:0/1521400474 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:54.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ecde5700 1 --2- 172.21.15.102:0/1521400474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1e80b34e0 0x7fb1e814ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ed5e6700 1 -- 172.21.15.102:0/1521400474 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1e80b3950 msgr2=0x7fb1e815c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ed5e6700 1 --2- 172.21.15.102:0/1521400474 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1e80b3950 0x7fb1e815c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ed5e6700 1 -- 172.21.15.102:0/1521400474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1e80b34e0 msgr2=0x7fb1e814ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ed5e6700 1 --2- 172.21.15.102:0/1521400474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1e80b34e0 0x7fb1e814ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ed5e6700 1 -- 172.21.15.102:0/1521400474 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc009420 con 0x7fb1e8153840 2024-08-17T02:25:54.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ecde5700 1 --2- 172.21.15.102:0/1521400474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1e80b34e0 0x7fb1e814ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:54.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1e7fff700 1 --2- 172.21.15.102:0/1521400474 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1e80b3950 0x7fb1e815c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:54.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ed5e6700 1 --2- 172.21.15.102:0/1521400474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1e8153840 0x7fb1e806a7d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000cc70 tx=0x7fb1e0001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:54.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1e4ff9700 1 -- 172.21.15.102:0/1521400474 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e000a890 con 0x7fb1e8153840 2024-08-17T02:25:54.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1ef049700 1 -- 172.21.15.102:0/1521400474 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e815cf90 con 0x7fb1e8153840 2024-08-17T02:25:54.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.121+0000 7fb1e4ff9700 1 -- 172.21.15.102:0/1521400474 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e000a9f0 con 0x7fb1e8153840 2024-08-17T02:25:54.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.125+0000 7fb1ef049700 1 -- 172.21.15.102:0/1521400474 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e814f180 con 0x7fb1e8153840 2024-08-17T02:25:54.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.125+0000 7fb1e4ff9700 1 -- 172.21.15.102:0/1521400474 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e000ad70 con 0x7fb1e8153840 2024-08-17T02:25:54.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.125+0000 7fb1ef049700 1 -- 172.21.15.102:0/1521400474 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e80c7870 con 0x7fb1e8153840 2024-08-17T02:25:54.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.125+0000 7fb1e4ff9700 1 -- 172.21.15.102:0/1521400474 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb1e0007300 con 0x7fb1e8153840 2024-08-17T02:25:54.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.125+0000 7fb1e4ff9700 1 --2- 172.21.15.102:0/1521400474 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb1d4060860 0x7fb1d4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.125+0000 7fb1e4ff9700 1 -- 172.21.15.102:0/1521400474 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fb1e007cca0 con 0x7fb1e8153840 2024-08-17T02:25:54.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.125+0000 7fb1ecde5700 1 --2- 172.21.15.102:0/1521400474 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb1d4060860 0x7fb1d4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.129+0000 7fb1ecde5700 1 --2- 172.21.15.102:0/1521400474 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb1d4060860 0x7fb1d4062d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0093f0 tx=0x7fb1dc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:54.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.133+0000 7fb1e4ff9700 1 -- 172.21.15.102:0/1521400474 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb1e004d230 con 0x7fb1e8153840 2024-08-17T02:25:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.301+0000 7fb1ef049700 1 -- 172.21.15.102:0/1521400474 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb1e815a870 con 0x7fb1e8153840 2024-08-17T02:25:54.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:54.981+0000 7fb1e4ff9700 1 -- 172.21.15.102:0/1521400474 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb1e815a870 con 0x7fb1e8153840 2024-08-17T02:25:55.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.001+0000 7fb1ef049700 1 -- 172.21.15.102:0/1521400474 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb1d4060860 msgr2=0x7fb1d4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.001+0000 7fb1ef049700 1 --2- 172.21.15.102:0/1521400474 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb1d4060860 0x7fb1d4062d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0093f0 tx=0x7fb1dc017000 comp rx=0 tx=0).stop 2024-08-17T02:25:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.001+0000 7fb1ef049700 1 -- 172.21.15.102:0/1521400474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1e8153840 msgr2=0x7fb1e806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.001+0000 7fb1ef049700 1 --2- 172.21.15.102:0/1521400474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1e8153840 0x7fb1e806a7d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000cc70 tx=0x7fb1e0001a50 comp rx=0 tx=0).stop 2024-08-17T02:25:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.001+0000 7fb1ef049700 1 -- 172.21.15.102:0/1521400474 shutdown_connections 2024-08-17T02:25:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.001+0000 7fb1ef049700 1 --2- 172.21.15.102:0/1521400474 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb1d4060860 0x7fb1d4062d10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.001+0000 7fb1ef049700 1 --2- 172.21.15.102:0/1521400474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1e8153840 0x7fb1e806a7d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.001+0000 7fb1ef049700 1 --2- 172.21.15.102:0/1521400474 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb1e80b3950 0x7fb1e815c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.001+0000 7fb1ef049700 1 --2- 172.21.15.102:0/1521400474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1e80b34e0 0x7fb1e814ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.001+0000 7fb1ef049700 1 -- 172.21.15.102:0/1521400474 >> 172.21.15.102:0/1521400474 conn(0x7fb1e80cab30 msgr2=0x7fb1e8151ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.001+0000 7fb1ef049700 1 -- 172.21.15.102:0/1521400474 shutdown_connections 2024-08-17T02:25:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.001+0000 7fb1ef049700 1 -- 172.21.15.102:0/1521400474 wait complete. 2024-08-17T02:25:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data' created 2024-08-17T02:25:55.015 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:25:55.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f8615c86700 1 Processor -- start 2024-08-17T02:25:55.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f8615c86700 1 -- start start 2024-08-17T02:25:55.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f8615c86700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8608053d80 0x7f86080e67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f8615c86700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86080e26e0 con 0x7f86080e1ec0 2024-08-17T02:25:55.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f8615c86700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8608051430 con 0x7f86080e2290 2024-08-17T02:25:55.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f8615c86700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8608008a50 con 0x7f8608053d80 2024-08-17T02:25:55.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f8614c84700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f86080e1ec0 0x7f8608008270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49552/0 (socket says 172.21.15.102:49552) 2024-08-17T02:25:55.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f8614c84700 1 -- 172.21.15.102:0/3070437627 learned_addr learned my addr 172.21.15.102:0/3070437627 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:25:55.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f8615485700 1 --2- 172.21.15.102:0/3070437627 >> v2:172.21.15.121:3300/0 conn(0x7f8608053d80 0x7f86080e67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f860f7fe700 1 -- 172.21.15.102:0/3070437627 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664029496 0 0) 0x7f86080e26e0 con 0x7f86080e1ec0 2024-08-17T02:25:55.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f860f7fe700 1 -- 172.21.15.102:0/3070437627 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85f8003570 con 0x7f86080e1ec0 2024-08-17T02:25:55.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f860f7fe700 1 -- 172.21.15.102:0/3070437627 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1599495520 0 0) 0x7f85f8003570 con 0x7f86080e1ec0 2024-08-17T02:25:55.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f860f7fe700 1 -- 172.21.15.102:0/3070437627 >> v2:172.21.15.121:3300/0 conn(0x7f8608053d80 msgr2=0x7f86080e67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:55.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f860f7fe700 1 --2- 172.21.15.102:0/3070437627 >> v2:172.21.15.121:3300/0 conn(0x7f8608053d80 0x7f86080e67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f860f7fe700 1 -- 172.21.15.102:0/3070437627 >> v1:172.21.15.121:6789/0 conn(0x7f86080e2290 legacy=0x7f8608053670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f860f7fe700 1 -- 172.21.15.102:0/3070437627 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8608008d30 con 0x7f86080e1ec0 2024-08-17T02:25:55.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f860f7fe700 1 -- 172.21.15.102:0/3070437627 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7f8604001470 con 0x7f86080e1ec0 2024-08-17T02:25:55.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f860f7fe700 1 -- 172.21.15.102:0/3070437627 >> v1:172.21.15.102:6789/0 conn(0x7f86080e1ec0 legacy=0x7f8608008270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f860f7fe700 1 --2- 172.21.15.102:0/3070437627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f8003a60 0x7f85f8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f860f7fe700 1 --2- 172.21.15.102:0/3070437627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85f8004810 0x7f85f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f860f7fe700 1 --2- 172.21.15.102:0/3070437627 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f85f80052e0 0x7f85f800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f860f7fe700 1 -- 172.21.15.102:0/3070437627 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8608008a50 con 0x7f85f8003a60 2024-08-17T02:25:55.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f860f7fe700 1 -- 172.21.15.102:0/3070437627 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f800c1b0 con 0x7f85f8004810 2024-08-17T02:25:55.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f860f7fe700 1 -- 172.21.15.102:0/3070437627 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f800c370 con 0x7f85f80052e0 2024-08-17T02:25:55.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.121+0000 7f8614c84700 1 --2- 172.21.15.102:0/3070437627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f8003a60 0x7f85f8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f860ffff700 1 --2- 172.21.15.102:0/3070437627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85f8004810 0x7f85f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8615485700 1 --2- 172.21.15.102:0/3070437627 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f85f80052e0 0x7f85f800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8614c84700 1 -- 172.21.15.102:0/3070437627 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f85f80052e0 msgr2=0x7f85f800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:55.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8614c84700 1 --2- 172.21.15.102:0/3070437627 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f85f80052e0 0x7f85f800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8614c84700 1 -- 172.21.15.102:0/3070437627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85f8004810 msgr2=0x7f85f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:55.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8614c84700 1 --2- 172.21.15.102:0/3070437627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85f8004810 0x7f85f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8615485700 1 -- 172.21.15.102:0/3070437627 reap_dead start 2024-08-17T02:25:55.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8614c84700 1 -- 172.21.15.102:0/3070437627 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f8003570 con 0x7f85f8003a60 2024-08-17T02:25:55.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8614c84700 1 --2- 172.21.15.102:0/3070437627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f8003a60 0x7f85f8003e70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f860400c3c0 tx=0x7f8604001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b530ec84694f844 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:55.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f860f7fe700 1 -- 172.21.15.102:0/3070437627 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860400cc10 con 0x7f85f8003a60 2024-08-17T02:25:55.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f860f7fe700 1 -- 172.21.15.102:0/3070437627 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860400cd70 con 0x7f85f8003a60 2024-08-17T02:25:55.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f860f7fe700 1 -- 172.21.15.102:0/3070437627 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604005b50 con 0x7f85f8003a60 2024-08-17T02:25:55.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8615c86700 1 -- 172.21.15.102:0/3070437627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f8003a60 msgr2=0x7f85f8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8615c86700 1 --2- 172.21.15.102:0/3070437627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f8003a60 0x7f85f8003e70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f860400c3c0 tx=0x7f8604001e50 comp rx=0 tx=0).stop 2024-08-17T02:25:55.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8615c86700 1 -- 172.21.15.102:0/3070437627 shutdown_connections 2024-08-17T02:25:55.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8615c86700 1 --2- 172.21.15.102:0/3070437627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f8003a60 0x7f85f8003e70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8615c86700 1 -- 172.21.15.102:0/3070437627 >> 172.21.15.102:0/3070437627 conn(0x7f8608009e10 msgr2=0x7f860800a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:55.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8615c86700 1 -- 172.21.15.102:0/3070437627 shutdown_connections 2024-08-17T02:25:55.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8615c86700 1 -- 172.21.15.102:0/3070437627 wait complete. 2024-08-17T02:25:55.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8615c86700 1 Processor -- start 2024-08-17T02:25:55.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.125+0000 7f8615c86700 1 -- start start 2024-08-17T02:25:55.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8615c86700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f8003a60 0x7f860804bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8615c86700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f860804d480 0x7f86080e1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8615c86700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f86080de710 0x7f86080e49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8615c86700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860804c3e0 con 0x7f85f8003a60 2024-08-17T02:25:55.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8615c86700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860804c6c0 con 0x7f860804d480 2024-08-17T02:25:55.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8615c86700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860804c9a0 con 0x7f86080de710 2024-08-17T02:25:55.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8614c84700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f8003a60 0x7f860804bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f860ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f860804d480 0x7f86080e1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8614c84700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f8003a60 0x7f860804bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47884/0 (socket says 172.21.15.102:47884) 2024-08-17T02:25:55.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8614c84700 1 -- 172.21.15.102:0/3122002754 learned_addr learned my addr 172.21.15.102:0/3122002754 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:55.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8615485700 1 --2- 172.21.15.102:0/3122002754 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f86080de710 0x7f86080e49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8614c84700 1 -- 172.21.15.102:0/3122002754 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f86080de710 msgr2=0x7f86080e49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8614c84700 1 --2- 172.21.15.102:0/3122002754 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f86080de710 0x7f86080e49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8614c84700 1 -- 172.21.15.102:0/3122002754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f860804d480 msgr2=0x7f86080e1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8614c84700 1 --2- 172.21.15.102:0/3122002754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f860804d480 0x7f86080e1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8614c84700 1 -- 172.21.15.102:0/3122002754 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860804cc80 con 0x7f85f8003a60 2024-08-17T02:25:55.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f860ffff700 1 --2- 172.21.15.102:0/3122002754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f860804d480 0x7f86080e1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:55.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8614c84700 1 --2- 172.21.15.102:0/3122002754 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f8003a60 0x7f860804bd90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f85f800c180 tx=0x7f8604015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:55.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f860cff9700 1 -- 172.21.15.102:0/3122002754 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860400cc10 con 0x7f85f8003a60 2024-08-17T02:25:55.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f860cff9700 1 -- 172.21.15.102:0/3122002754 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8604004e70 con 0x7f85f8003a60 2024-08-17T02:25:55.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8615c86700 1 -- 172.21.15.102:0/3122002754 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860804cf60 con 0x7f85f8003a60 2024-08-17T02:25:55.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f8615c86700 1 -- 172.21.15.102:0/3122002754 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86080deb80 con 0x7f85f8003a60 2024-08-17T02:25:55.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.129+0000 7f860cff9700 1 -- 172.21.15.102:0/3122002754 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860400cee0 con 0x7f85f8003a60 2024-08-17T02:25:55.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.133+0000 7f8615c86700 1 -- 172.21.15.102:0/3122002754 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8608005800 con 0x7f85f8003a60 2024-08-17T02:25:55.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.133+0000 7f860cff9700 1 -- 172.21.15.102:0/3122002754 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8604007550 con 0x7f85f8003a60 2024-08-17T02:25:55.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.133+0000 7f860cff9700 1 --2- 172.21.15.102:0/3122002754 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f85fc060890 0x7f85fc062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.133+0000 7f860cff9700 1 -- 172.21.15.102:0/3122002754 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f860407dfc0 con 0x7f85f8003a60 2024-08-17T02:25:55.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.133+0000 7f860ffff700 1 --2- 172.21.15.102:0/3122002754 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f85fc060890 0x7f85fc062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.133+0000 7f860ffff700 1 --2- 172.21.15.102:0/3122002754 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f85fc060890 0x7f85fc062d40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8608054760 tx=0x7f8600009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:55.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.141+0000 7f860cff9700 1 -- 172.21.15.102:0/3122002754 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f860404e3d0 con 0x7f85f8003a60 2024-08-17T02:25:55.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:55.337+0000 7f8615c86700 1 -- 172.21.15.102:0/3122002754 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8608035e00 con 0x7f85f8003a60 2024-08-17T02:25:56.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.025+0000 7f860cff9700 1 -- 172.21.15.102:0/3122002754 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8604017020 con 0x7f85f8003a60 2024-08-17T02:25:56.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.029+0000 7f8615c86700 1 -- 172.21.15.102:0/3122002754 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f85fc060890 msgr2=0x7f85fc062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.029+0000 7f8615c86700 1 --2- 172.21.15.102:0/3122002754 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f85fc060890 0x7f85fc062d40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8608054760 tx=0x7f8600009040 comp rx=0 tx=0).stop 2024-08-17T02:25:56.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.029+0000 7f8615c86700 1 -- 172.21.15.102:0/3122002754 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f8003a60 msgr2=0x7f860804bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.029+0000 7f8615c86700 1 --2- 172.21.15.102:0/3122002754 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f8003a60 0x7f860804bd90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f85f800c180 tx=0x7f8604015000 comp rx=0 tx=0).stop 2024-08-17T02:25:56.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.029+0000 7f8615c86700 1 -- 172.21.15.102:0/3122002754 shutdown_connections 2024-08-17T02:25:56.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.029+0000 7f8615c86700 1 --2- 172.21.15.102:0/3122002754 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f85fc060890 0x7f85fc062d40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.029+0000 7f8615c86700 1 --2- 172.21.15.102:0/3122002754 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f86080de710 0x7f86080e49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.029+0000 7f8615c86700 1 --2- 172.21.15.102:0/3122002754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f860804d480 0x7f86080e1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.029+0000 7f8615c86700 1 --2- 172.21.15.102:0/3122002754 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f8003a60 0x7f860804bd90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.029+0000 7f8615c86700 1 -- 172.21.15.102:0/3122002754 >> 172.21.15.102:0/3122002754 conn(0x7f8608009e10 msgr2=0x7f8608008270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:56.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.029+0000 7f8615c86700 1 -- 172.21.15.102:0/3122002754 shutdown_connections 2024-08-17T02:25:56.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.029+0000 7f8615c86700 1 -- 172.21.15.102:0/3122002754 wait complete. 2024-08-17T02:25:56.040 INFO:teuthology.orchestra.run.smithi102.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:25:56.052 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:56.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.145+0000 7ff9b704b700 1 Processor -- start 2024-08-17T02:25:56.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.145+0000 7ff9b704b700 1 -- start start 2024-08-17T02:25:56.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b704b700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff9b00af3f0 0x7ff9b0068c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b704b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff9b00b0a70 0x7ff9b0155810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b704b700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b00b05e0 con 0x7ff9b0068840 2024-08-17T02:25:56.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b704b700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b00af9d0 con 0x7ff9b00af3f0 2024-08-17T02:25:56.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b704b700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b00afcb0 con 0x7ff9b00b0a70 2024-08-17T02:25:56.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b5848700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff9b00af3f0 0x7ff9b0068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b5848700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff9b00af3f0 0x7ff9b0068c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47894/0 (socket says 172.21.15.102:47894) 2024-08-17T02:25:56.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b5848700 1 -- 172.21.15.102:0/4101687111 learned_addr learned my addr 172.21.15.102:0/4101687111 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:56.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b684a700 1 --2- 172.21.15.102:0/4101687111 >> v2:172.21.15.121:3300/0 conn(0x7ff9b00b0a70 0x7ff9b0155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b5848700 1 -- 172.21.15.102:0/4101687111 >> v2:172.21.15.121:3300/0 conn(0x7ff9b00b0a70 msgr2=0x7ff9b0155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:56.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b5848700 1 --2- 172.21.15.102:0/4101687111 >> v2:172.21.15.121:3300/0 conn(0x7ff9b00b0a70 0x7ff9b0155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b5848700 1 -- 172.21.15.102:0/4101687111 >> v1:172.21.15.121:6789/0 conn(0x7ff9b0068840 legacy=0x7ff9b00ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b5848700 1 -- 172.21.15.102:0/4101687111 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b00aff90 con 0x7ff9b00af3f0 2024-08-17T02:25:56.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b5848700 1 --2- 172.21.15.102:0/4101687111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b00af3f0 0x7ff9b0068c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00b2360 tx=0x7ff9a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e225371c69fd584 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b5047700 1 -- 172.21.15.102:0/4101687111 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0009e70 con 0x7ff9b00af3f0 2024-08-17T02:25:56.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b5047700 1 -- 172.21.15.102:0/4101687111 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a000b860 con 0x7ff9b00af3f0 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.149+0000 7ff9b5047700 1 -- 172.21.15.102:0/4101687111 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000bc00 con 0x7ff9b00af3f0 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.153+0000 7ff9b704b700 1 -- 172.21.15.102:0/4101687111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b00af3f0 msgr2=0x7ff9b0068c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.153+0000 7ff9b704b700 1 --2- 172.21.15.102:0/4101687111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b00af3f0 0x7ff9b0068c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00b2360 tx=0x7ff9a0009250 comp rx=0 tx=0).stop 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.153+0000 7ff9b704b700 1 -- 172.21.15.102:0/4101687111 shutdown_connections 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.153+0000 7ff9b704b700 1 --2- 172.21.15.102:0/4101687111 >> v2:172.21.15.121:3300/0 conn(0x7ff9b00b0a70 0x7ff9b0155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.153+0000 7ff9b704b700 1 --2- 172.21.15.102:0/4101687111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b00af3f0 0x7ff9b0068c10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.153+0000 7ff9b704b700 1 -- 172.21.15.102:0/4101687111 >> 172.21.15.102:0/4101687111 conn(0x7ff9b006d800 msgr2=0x7ff9b006dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.153+0000 7ff9b704b700 1 -- 172.21.15.102:0/4101687111 shutdown_connections 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.153+0000 7ff9b704b700 1 -- 172.21.15.102:0/4101687111 wait complete. 2024-08-17T02:25:56.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.153+0000 7ff9b704b700 1 Processor -- start 2024-08-17T02:25:56.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.153+0000 7ff9b704b700 1 -- start start 2024-08-17T02:25:56.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b704b700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9b0068840 0x7ff9b013e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b704b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b00af3f0 0x7ff9b00671b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b704b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9b00b0a70 0x7ff9b00676f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b704b700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b0150460 con 0x7ff9b00af3f0 2024-08-17T02:25:56.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b704b700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00cb270 con 0x7ff9b00b0a70 2024-08-17T02:25:56.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b704b700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00c8670 con 0x7ff9b0068840 2024-08-17T02:25:56.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b5848700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b00af3f0 0x7ff9b00671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b5848700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b00af3f0 0x7ff9b00671b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47908/0 (socket says 172.21.15.102:47908) 2024-08-17T02:25:56.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b5848700 1 -- 172.21.15.102:0/1061537238 learned_addr learned my addr 172.21.15.102:0/1061537238 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:56.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b6049700 1 --2- 172.21.15.102:0/1061537238 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9b0068840 0x7ff9b013e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b684a700 1 --2- 172.21.15.102:0/1061537238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9b00b0a70 0x7ff9b00676f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b5848700 1 -- 172.21.15.102:0/1061537238 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9b0068840 msgr2=0x7ff9b013e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b5848700 1 --2- 172.21.15.102:0/1061537238 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9b0068840 0x7ff9b013e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b5848700 1 -- 172.21.15.102:0/1061537238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9b00b0a70 msgr2=0x7ff9b00676f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b5848700 1 --2- 172.21.15.102:0/1061537238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9b00b0a70 0x7ff9b00676f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b5848700 1 -- 172.21.15.102:0/1061537238 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a00094f0 con 0x7ff9b00af3f0 2024-08-17T02:25:56.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b5848700 1 --2- 172.21.15.102:0/1061537238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b00af3f0 0x7ff9b00671b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0069650 tx=0x7ff9a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9a67fc700 1 -- 172.21.15.102:0/1061537238 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000bbe0 con 0x7ff9b00af3f0 2024-08-17T02:25:56.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9a67fc700 1 -- 172.21.15.102:0/1061537238 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a0011420 con 0x7ff9b00af3f0 2024-08-17T02:25:56.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9a67fc700 1 -- 172.21.15.102:0/1061537238 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a00117c0 con 0x7ff9b00af3f0 2024-08-17T02:25:56.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b704b700 1 -- 172.21.15.102:0/1061537238 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b00c8950 con 0x7ff9b00af3f0 2024-08-17T02:25:56.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b704b700 1 -- 172.21.15.102:0/1061537238 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b013ebd0 con 0x7ff9b00af3f0 2024-08-17T02:25:56.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9a67fc700 1 -- 172.21.15.102:0/1061537238 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff9a0011bf0 con 0x7ff9b00af3f0 2024-08-17T02:25:56.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.157+0000 7ff9b704b700 1 -- 172.21.15.102:0/1061537238 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b013edc0 con 0x7ff9b00af3f0 2024-08-17T02:25:56.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.161+0000 7ff9a67fc700 1 --2- 172.21.15.102:0/1061537238 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff994060860 0x7ff994062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.161+0000 7ff9b6049700 1 --2- 172.21.15.102:0/1061537238 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff994060860 0x7ff994062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.161+0000 7ff9a67fc700 1 -- 172.21.15.102:0/1061537238 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9a007e020 con 0x7ff9b00af3f0 2024-08-17T02:25:56.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.161+0000 7ff9b6049700 1 --2- 172.21.15.102:0/1061537238 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff994060860 0x7ff994062d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac003a80 tx=0x7ff9ac007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.169+0000 7ff9a67fc700 1 -- 172.21.15.102:0/1061537238 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff9b013edc0 con 0x7ff9b00af3f0 2024-08-17T02:25:56.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.325+0000 7ff9b704b700 1 -- 172.21.15.102:0/1061537238 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9b013edc0 con 0x7ff9b00af3f0 2024-08-17T02:25:56.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.325+0000 7ff9a67fc700 1 -- 172.21.15.102:0/1061537238 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15411 (secure 0 0 0) 0x7ff9b013edc0 con 0x7ff9b00af3f0 2024-08-17T02:25:56.330 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:56.330 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":20,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:55.339725+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:53.562223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:54.343618+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:56.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.329+0000 7ff9b704b700 1 -- 172.21.15.102:0/1061537238 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff994060860 msgr2=0x7ff994062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.329+0000 7ff9b704b700 1 --2- 172.21.15.102:0/1061537238 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff994060860 0x7ff994062d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac003a80 tx=0x7ff9ac007ec0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.329+0000 7ff9b704b700 1 -- 172.21.15.102:0/1061537238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b00af3f0 msgr2=0x7ff9b00671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.329+0000 7ff9b704b700 1 --2- 172.21.15.102:0/1061537238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b00af3f0 0x7ff9b00671b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0069650 tx=0x7ff9a0017000 comp rx=0 tx=0).stop 2024-08-17T02:25:56.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.329+0000 7ff9b704b700 1 -- 172.21.15.102:0/1061537238 shutdown_connections 2024-08-17T02:25:56.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.329+0000 7ff9b704b700 1 --2- 172.21.15.102:0/1061537238 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff994060860 0x7ff994062d10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.329+0000 7ff9b704b700 1 --2- 172.21.15.102:0/1061537238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9b00af3f0 0x7ff9b00671b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.329+0000 7ff9b704b700 1 --2- 172.21.15.102:0/1061537238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9b00b0a70 0x7ff9b00676f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.329+0000 7ff9b704b700 1 --2- 172.21.15.102:0/1061537238 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9b0068840 0x7ff9b013e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.329+0000 7ff9b704b700 1 -- 172.21.15.102:0/1061537238 >> 172.21.15.102:0/1061537238 conn(0x7ff9b006d800 msgr2=0x7ff9b0150fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:56.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.329+0000 7ff9b704b700 1 -- 172.21.15.102:0/1061537238 shutdown_connections 2024-08-17T02:25:56.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.329+0000 7ff9b704b700 1 -- 172.21.15.102:0/1061537238 wait complete. 2024-08-17T02:25:56.344 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:56.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.449+0000 7f6bf1dfc700 1 Processor -- start 2024-08-17T02:25:56.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.449+0000 7f6bf1dfc700 1 -- start start 2024-08-17T02:25:56.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf1dfc700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6bec159040 0x7f6bec0cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf1dfc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6bec15d5b0 0x7f6bec0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf1dfc700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bec0cf190 con 0x7f6bec0d0010 2024-08-17T02:25:56.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf1dfc700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec15d9f0 con 0x7f6bec159040 2024-08-17T02:25:56.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf1dfc700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec0d09a0 con 0x7f6bec15d5b0 2024-08-17T02:25:56.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf0dfa700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6bec159040 0x7f6bec0cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bebfff700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f6bec0d0010 0x7f6bec15cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49562/0 (socket says 172.21.15.102:49562) 2024-08-17T02:25:56.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bebfff700 1 -- 172.21.15.102:0/1471364615 learned_addr learned my addr 172.21.15.102:0/1471364615 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:25:56.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf15fb700 1 --2- 172.21.15.102:0/1471364615 >> v2:172.21.15.121:3300/0 conn(0x7f6bec15d5b0 0x7f6bec0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6beb7fe700 1 -- 172.21.15.102:0/1471364615 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001753296 0 0) 0x7f6bec0cf190 con 0x7f6bec0d0010 2024-08-17T02:25:56.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6beb7fe700 1 -- 172.21.15.102:0/1471364615 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bdc003570 con 0x7f6bec0d0010 2024-08-17T02:25:56.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf0dfa700 1 -- 172.21.15.102:0/1471364615 >> v2:172.21.15.121:3300/0 conn(0x7f6bec15d5b0 msgr2=0x7f6bec0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:56.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf0dfa700 1 --2- 172.21.15.102:0/1471364615 >> v2:172.21.15.121:3300/0 conn(0x7f6bec15d5b0 0x7f6bec0d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf0dfa700 1 -- 172.21.15.102:0/1471364615 >> v1:172.21.15.102:6789/0 conn(0x7f6bec0d0010 legacy=0x7f6bec15cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf0dfa700 1 -- 172.21.15.102:0/1471364615 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec0ce5e0 con 0x7f6bec159040 2024-08-17T02:25:56.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf0dfa700 1 --2- 172.21.15.102:0/1471364615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bec159040 0x7f6bec0cf620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0b6050 tx=0x7f6be00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a0b21a6399d6c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6beb7fe700 1 -- 172.21.15.102:0/1471364615 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0011630 con 0x7f6bec159040 2024-08-17T02:25:56.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6beb7fe700 1 -- 172.21.15.102:0/1471364615 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be00117b0 con 0x7f6bec159040 2024-08-17T02:25:56.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6beb7fe700 1 -- 172.21.15.102:0/1471364615 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0011b70 con 0x7f6bec159040 2024-08-17T02:25:56.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf1dfc700 1 -- 172.21.15.102:0/1471364615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bec159040 msgr2=0x7f6bec0cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf1dfc700 1 --2- 172.21.15.102:0/1471364615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bec159040 0x7f6bec0cf620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0b6050 tx=0x7f6be00091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf1dfc700 1 -- 172.21.15.102:0/1471364615 shutdown_connections 2024-08-17T02:25:56.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf1dfc700 1 --2- 172.21.15.102:0/1471364615 >> v2:172.21.15.121:3300/0 conn(0x7f6bec15d5b0 0x7f6bec0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf1dfc700 1 --2- 172.21.15.102:0/1471364615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bec159040 0x7f6bec0cf620 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf1dfc700 1 -- 172.21.15.102:0/1471364615 >> 172.21.15.102:0/1471364615 conn(0x7f6bec068250 msgr2=0x7f6bec068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:56.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf1dfc700 1 -- 172.21.15.102:0/1471364615 shutdown_connections 2024-08-17T02:25:56.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.453+0000 7f6bf1dfc700 1 -- 172.21.15.102:0/1471364615 wait complete. 2024-08-17T02:25:56.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.457+0000 7f6bf1dfc700 1 Processor -- start 2024-08-17T02:25:56.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.457+0000 7f6bf1dfc700 1 -- start start 2024-08-17T02:25:56.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.457+0000 7f6bf1dfc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bec0d0010 0x7f6bec14a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.457+0000 7f6bf1dfc700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6bec159040 0x7f6bec1691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.457+0000 7f6bf1dfc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bec15d5b0 0x7f6bec16ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.457+0000 7f6bf1dfc700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0b0f80 con 0x7f6bec15d5b0 2024-08-17T02:25:56.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.457+0000 7f6bf1dfc700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec14a9d0 con 0x7f6bec0d0010 2024-08-17T02:25:56.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.457+0000 7f6bf1dfc700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec14d5e0 con 0x7f6bec159040 2024-08-17T02:25:56.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.457+0000 7f6bf15fb700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bec15d5b0 0x7f6bec16ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.457+0000 7f6bf15fb700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bec15d5b0 0x7f6bec16ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47924/0 (socket says 172.21.15.102:47924) 2024-08-17T02:25:56.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.457+0000 7f6bf15fb700 1 -- 172.21.15.102:0/3652501697 learned_addr learned my addr 172.21.15.102:0/3652501697 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:56.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.457+0000 7f6bebfff700 1 --2- 172.21.15.102:0/3652501697 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6bec159040 0x7f6bec1691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.457+0000 7f6bf0dfa700 1 --2- 172.21.15.102:0/3652501697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bec0d0010 0x7f6bec14a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.461+0000 7f6bf15fb700 1 -- 172.21.15.102:0/3652501697 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6bec159040 msgr2=0x7f6bec1691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.461+0000 7f6bf15fb700 1 --2- 172.21.15.102:0/3652501697 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6bec159040 0x7f6bec1691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.461+0000 7f6bf15fb700 1 -- 172.21.15.102:0/3652501697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bec0d0010 msgr2=0x7f6bec14a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.461+0000 7f6bf15fb700 1 --2- 172.21.15.102:0/3652501697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bec0d0010 0x7f6bec14a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.461+0000 7f6bf15fb700 1 -- 172.21.15.102:0/3652501697 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0009420 con 0x7f6bec15d5b0 2024-08-17T02:25:56.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.461+0000 7f6bf0dfa700 1 --2- 172.21.15.102:0/3652501697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bec0d0010 0x7f6bec14a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:56.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.461+0000 7f6bebfff700 1 --2- 172.21.15.102:0/3652501697 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6bec159040 0x7f6bec1691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:56.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.461+0000 7f6bf15fb700 1 --2- 172.21.15.102:0/3652501697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bec15d5b0 0x7f6bec16ceb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6be4009e90 tx=0x7f6be400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.461+0000 7f6be8ff9700 1 -- 172.21.15.102:0/3652501697 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be400cc20 con 0x7f6bec15d5b0 2024-08-17T02:25:56.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.461+0000 7f6be8ff9700 1 -- 172.21.15.102:0/3652501697 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be400f040 con 0x7f6bec15d5b0 2024-08-17T02:25:56.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.461+0000 7f6bf1dfc700 1 -- 172.21.15.102:0/3652501697 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bec0b0930 con 0x7f6bec15d5b0 2024-08-17T02:25:56.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.461+0000 7f6be8ff9700 1 -- 172.21.15.102:0/3652501697 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4014480 con 0x7f6bec15d5b0 2024-08-17T02:25:56.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.461+0000 7f6bf1dfc700 1 -- 172.21.15.102:0/3652501697 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bec1696e0 con 0x7f6bec15d5b0 2024-08-17T02:25:56.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.461+0000 7f6bf1dfc700 1 -- 172.21.15.102:0/3652501697 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bec0b10f0 con 0x7f6bec15d5b0 2024-08-17T02:25:56.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.465+0000 7f6be8ff9700 1 -- 172.21.15.102:0/3652501697 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6be4014830 con 0x7f6bec15d5b0 2024-08-17T02:25:56.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.465+0000 7f6be8ff9700 1 --2- 172.21.15.102:0/3652501697 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6bd0060860 0x7f6bd0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.465+0000 7f6be8ff9700 1 -- 172.21.15.102:0/3652501697 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6be407d5e0 con 0x7f6bec15d5b0 2024-08-17T02:25:56.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.465+0000 7f6bf0dfa700 1 --2- 172.21.15.102:0/3652501697 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6bd0060860 0x7f6bd0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.465+0000 7f6bf0dfa700 1 --2- 172.21.15.102:0/3652501697 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6bd0060860 0x7f6bd0062d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0b6050 tx=0x7f6be0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.473+0000 7f6be8ff9700 1 -- 172.21.15.102:0/3652501697 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6be40514c0 con 0x7f6bec15d5b0 2024-08-17T02:25:56.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.637+0000 7f6bf1dfc700 1 -- 172.21.15.102:0/3652501697 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bec0643a0 con 0x7f6bec15d5b0 2024-08-17T02:25:56.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.641+0000 7f6be8ff9700 1 -- 172.21.15.102:0/3652501697 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f6be4051050 con 0x7f6bec15d5b0 2024-08-17T02:25:56.642 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:56.642 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":20,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:55.339725+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:53.562223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:54.343618+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:56.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.641+0000 7f6bf1dfc700 1 -- 172.21.15.102:0/3652501697 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6bd0060860 msgr2=0x7f6bd0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.641+0000 7f6bf1dfc700 1 --2- 172.21.15.102:0/3652501697 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6bd0060860 0x7f6bd0062d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0b6050 tx=0x7f6be0017000 comp rx=0 tx=0).stop 2024-08-17T02:25:56.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.641+0000 7f6bf1dfc700 1 -- 172.21.15.102:0/3652501697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bec15d5b0 msgr2=0x7f6bec16ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.641+0000 7f6bf1dfc700 1 --2- 172.21.15.102:0/3652501697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bec15d5b0 0x7f6bec16ceb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6be4009e90 tx=0x7f6be400b040 comp rx=0 tx=0).stop 2024-08-17T02:25:56.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.641+0000 7f6bf1dfc700 1 -- 172.21.15.102:0/3652501697 shutdown_connections 2024-08-17T02:25:56.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.641+0000 7f6bf1dfc700 1 --2- 172.21.15.102:0/3652501697 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6bd0060860 0x7f6bd0062d10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.641+0000 7f6bf1dfc700 1 --2- 172.21.15.102:0/3652501697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bec15d5b0 0x7f6bec16ceb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.641+0000 7f6bf1dfc700 1 --2- 172.21.15.102:0/3652501697 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6bec159040 0x7f6bec1691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.641+0000 7f6bf1dfc700 1 --2- 172.21.15.102:0/3652501697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bec0d0010 0x7f6bec14a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.641+0000 7f6bf1dfc700 1 -- 172.21.15.102:0/3652501697 >> 172.21.15.102:0/3652501697 conn(0x7f6bec068250 msgr2=0x7f6bec0b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:56.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.641+0000 7f6bf1dfc700 1 -- 172.21.15.102:0/3652501697 shutdown_connections 2024-08-17T02:25:56.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.641+0000 7f6bf1dfc700 1 -- 172.21.15.102:0/3652501697 wait complete. 2024-08-17T02:25:56.656 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:25:56.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.769+0000 7f8e4f50a700 1 Processor -- start 2024-08-17T02:25:56.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.769+0000 7f8e4f50a700 1 -- start start 2024-08-17T02:25:56.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.769+0000 7f8e4f50a700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8e480b22d0 0x7f8e480cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.769+0000 7f8e4f50a700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e480b26a0 0x7f8e480cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.769+0000 7f8e4f50a700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8e480cb5b0 0x7f8e4815cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.769+0000 7f8e4f50a700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4815b870 con 0x7f8e480b22d0 2024-08-17T02:25:56.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.769+0000 7f8e4f50a700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4815a990 con 0x7f8e480cb5b0 2024-08-17T02:25:56.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.769+0000 7f8e4f50a700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e480cba30 con 0x7f8e480b26a0 2024-08-17T02:25:56.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4d2a6700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8e480b22d0 0x7f8e480cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4d2a6700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8e480b22d0 0x7f8e480cd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47932/0 (socket says 172.21.15.102:47932) 2024-08-17T02:25:56.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4daa7700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8e480cb5b0 0x7f8e4815cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4d2a6700 1 -- 172.21.15.102:0/1794536238 learned_addr learned my addr 172.21.15.102:0/1794536238 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:56.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4caa5700 1 --2- 172.21.15.102:0/1794536238 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e480b26a0 0x7f8e480cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4d2a6700 1 -- 172.21.15.102:0/1794536238 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e480b26a0 msgr2=0x7f8e480cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:56.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4d2a6700 1 --2- 172.21.15.102:0/1794536238 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e480b26a0 0x7f8e480cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4d2a6700 1 -- 172.21.15.102:0/1794536238 >> v2:172.21.15.121:3300/0 conn(0x7f8e480cb5b0 msgr2=0x7f8e4815cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:56.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4d2a6700 1 --2- 172.21.15.102:0/1794536238 >> v2:172.21.15.121:3300/0 conn(0x7f8e480cb5b0 0x7f8e4815cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4d2a6700 1 -- 172.21.15.102:0/1794536238 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4815ac60 con 0x7f8e480b22d0 2024-08-17T02:25:56.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4daa7700 1 --2- 172.21.15.102:0/1794536238 >> v2:172.21.15.121:3300/0 conn(0x7f8e480cb5b0 0x7f8e4815cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:56.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4d2a6700 1 --2- 172.21.15.102:0/1794536238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e480b22d0 0x7f8e480cd4d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8e48067d10 tx=0x7f8e44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d338d255a211f65d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e3ffff700 1 -- 172.21.15.102:0/1794536238 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4400b640 con 0x7f8e480b22d0 2024-08-17T02:25:56.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e3ffff700 1 -- 172.21.15.102:0/1794536238 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4400b7a0 con 0x7f8e480b22d0 2024-08-17T02:25:56.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e3ffff700 1 -- 172.21.15.102:0/1794536238 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4400bb60 con 0x7f8e480b22d0 2024-08-17T02:25:56.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4f50a700 1 -- 172.21.15.102:0/1794536238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e480b22d0 msgr2=0x7f8e480cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4f50a700 1 --2- 172.21.15.102:0/1794536238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e480b22d0 0x7f8e480cd4d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8e48067d10 tx=0x7f8e44009250 comp rx=0 tx=0).stop 2024-08-17T02:25:56.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4f50a700 1 -- 172.21.15.102:0/1794536238 shutdown_connections 2024-08-17T02:25:56.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4f50a700 1 --2- 172.21.15.102:0/1794536238 >> v2:172.21.15.121:3300/0 conn(0x7f8e480cb5b0 0x7f8e4815cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4f50a700 1 --2- 172.21.15.102:0/1794536238 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e480b26a0 0x7f8e480cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4f50a700 1 --2- 172.21.15.102:0/1794536238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e480b22d0 0x7f8e480cd4d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4f50a700 1 -- 172.21.15.102:0/1794536238 >> 172.21.15.102:0/1794536238 conn(0x7f8e4806a4a0 msgr2=0x7f8e48066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:56.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4f50a700 1 -- 172.21.15.102:0/1794536238 shutdown_connections 2024-08-17T02:25:56.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.773+0000 7f8e4f50a700 1 -- 172.21.15.102:0/1794536238 wait complete. 2024-08-17T02:25:56.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4f50a700 1 Processor -- start 2024-08-17T02:25:56.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4f50a700 1 -- start start 2024-08-17T02:25:56.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4f50a700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e480b22d0 0x7f8e4816d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4f50a700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e480b26a0 0x7f8e48141b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4f50a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e480cb5b0 0x7f8e48150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4f50a700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e48153d30 con 0x7f8e480b22d0 2024-08-17T02:25:56.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4f50a700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4814e4a0 con 0x7f8e480cb5b0 2024-08-17T02:25:56.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4f50a700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e481531b0 con 0x7f8e480b26a0 2024-08-17T02:25:56.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4d2a6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e480b22d0 0x7f8e4816d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4d2a6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e480b22d0 0x7f8e4816d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47942/0 (socket says 172.21.15.102:47942) 2024-08-17T02:25:56.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4d2a6700 1 -- 172.21.15.102:0/4231773290 learned_addr learned my addr 172.21.15.102:0/4231773290 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:56.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4caa5700 1 --2- 172.21.15.102:0/4231773290 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e480b26a0 0x7f8e48141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4daa7700 1 --2- 172.21.15.102:0/4231773290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e480cb5b0 0x7f8e48150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4d2a6700 1 -- 172.21.15.102:0/4231773290 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e480b26a0 msgr2=0x7f8e48141b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4d2a6700 1 --2- 172.21.15.102:0/4231773290 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e480b26a0 0x7f8e48141b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4d2a6700 1 -- 172.21.15.102:0/4231773290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e480cb5b0 msgr2=0x7f8e48150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4d2a6700 1 --2- 172.21.15.102:0/4231773290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e480cb5b0 0x7f8e48150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4d2a6700 1 -- 172.21.15.102:0/4231773290 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e40009a20 con 0x7f8e480b22d0 2024-08-17T02:25:56.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4caa5700 1 --2- 172.21.15.102:0/4231773290 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e480b26a0 0x7f8e48141b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:56.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.777+0000 7f8e4d2a6700 1 --2- 172.21.15.102:0/4231773290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e480b22d0 0x7f8e4816d4b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8e44006fd0 tx=0x7f8e44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.781+0000 7f8e3d7fa700 1 -- 172.21.15.102:0/4231773290 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44000d10 con 0x7f8e480b22d0 2024-08-17T02:25:56.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.781+0000 7f8e3d7fa700 1 -- 172.21.15.102:0/4231773290 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4400b910 con 0x7f8e480b22d0 2024-08-17T02:25:56.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.781+0000 7f8e4f50a700 1 -- 172.21.15.102:0/4231773290 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e440094f0 con 0x7f8e480b22d0 2024-08-17T02:25:56.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.781+0000 7f8e3d7fa700 1 -- 172.21.15.102:0/4231773290 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44026430 con 0x7f8e480b22d0 2024-08-17T02:25:56.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.781+0000 7f8e4f50a700 1 -- 172.21.15.102:0/4231773290 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e48153770 con 0x7f8e480b22d0 2024-08-17T02:25:56.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.781+0000 7f8e4f50a700 1 -- 172.21.15.102:0/4231773290 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e480d10e0 con 0x7f8e480b22d0 2024-08-17T02:25:56.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.781+0000 7f8e3d7fa700 1 -- 172.21.15.102:0/4231773290 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8e44023030 con 0x7f8e480b22d0 2024-08-17T02:25:56.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.781+0000 7f8e3d7fa700 1 --2- 172.21.15.102:0/4231773290 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8e2c060860 0x7f8e2c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.785+0000 7f8e3d7fa700 1 -- 172.21.15.102:0/4231773290 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e4407e180 con 0x7f8e480b22d0 2024-08-17T02:25:56.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.785+0000 7f8e4caa5700 1 --2- 172.21.15.102:0/4231773290 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8e2c060860 0x7f8e2c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.785+0000 7f8e4caa5700 1 --2- 172.21.15.102:0/4231773290 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8e2c060860 0x7f8e2c062d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8e480b38e0 tx=0x7f8e380091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.789+0000 7f8e3d7fa700 1 -- 172.21.15.102:0/4231773290 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8e4404e710 con 0x7f8e480b22d0 2024-08-17T02:25:56.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:56.985+0000 7f8e4f50a700 1 -- 172.21.15.102:0/4231773290 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8e4816d9f0 con 0x7f8e480b22d0 2024-08-17T02:25:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.025+0000 7f8e3d7fa700 1 -- 172.21.15.102:0/4231773290 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8e44051d30 con 0x7f8e480b22d0 2024-08-17T02:25:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.029+0000 7f8e4f50a700 1 -- 172.21.15.102:0/4231773290 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8e2c060860 msgr2=0x7f8e2c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.029+0000 7f8e4f50a700 1 --2- 172.21.15.102:0/4231773290 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8e2c060860 0x7f8e2c062d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8e480b38e0 tx=0x7f8e380091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.029+0000 7f8e4f50a700 1 -- 172.21.15.102:0/4231773290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e480b22d0 msgr2=0x7f8e4816d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.029+0000 7f8e4f50a700 1 --2- 172.21.15.102:0/4231773290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e480b22d0 0x7f8e4816d4b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8e44006fd0 tx=0x7f8e44017000 comp rx=0 tx=0).stop 2024-08-17T02:25:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.029+0000 7f8e4f50a700 1 -- 172.21.15.102:0/4231773290 shutdown_connections 2024-08-17T02:25:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.029+0000 7f8e4f50a700 1 --2- 172.21.15.102:0/4231773290 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8e2c060860 0x7f8e2c062d10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.029+0000 7f8e4f50a700 1 --2- 172.21.15.102:0/4231773290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e480cb5b0 0x7f8e48150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.029+0000 7f8e4f50a700 1 --2- 172.21.15.102:0/4231773290 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8e480b26a0 0x7f8e48141b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.029+0000 7f8e4f50a700 1 --2- 172.21.15.102:0/4231773290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e480b22d0 0x7f8e4816d4b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.029+0000 7f8e4f50a700 1 -- 172.21.15.102:0/4231773290 >> 172.21.15.102:0/4231773290 conn(0x7f8e4806a4a0 msgr2=0x7f8e480c5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.029+0000 7f8e4f50a700 1 -- 172.21.15.102:0/4231773290 shutdown_connections 2024-08-17T02:25:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.029+0000 7f8e4f50a700 1 -- 172.21.15.102:0/4231773290 wait complete. 2024-08-17T02:25:57.047 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:25:57.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa9657e5700 1 Processor -- start 2024-08-17T02:25:57.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa9657e5700 1 -- start start 2024-08-17T02:25:57.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa9657e5700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa9600cc840 0x7fa9600ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa9657e5700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9600b5750 0x7fa9600b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa9657e5700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9600cd150 con 0x7fa9600b2210 2024-08-17T02:25:57.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa9657e5700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9600af570 con 0x7fa9600cc840 2024-08-17T02:25:57.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa9657e5700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa960159ce0 con 0x7fa9600b5750 2024-08-17T02:25:57.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa95effd700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa9600cc840 0x7fa9600ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa95effd700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa9600cc840 0x7fa9600ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47958/0 (socket says 172.21.15.102:47958) 2024-08-17T02:25:57.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa95effd700 1 -- 172.21.15.102:0/619687432 learned_addr learned my addr 172.21.15.102:0/619687432 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:57.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa95f7fe700 1 --2- 172.21.15.102:0/619687432 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9600b5750 0x7fa9600b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa95effd700 1 -- 172.21.15.102:0/619687432 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9600b5750 msgr2=0x7fa9600b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:57.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa95effd700 1 --2- 172.21.15.102:0/619687432 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9600b5750 0x7fa9600b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa95effd700 1 -- 172.21.15.102:0/619687432 >> v1:172.21.15.121:6789/0 conn(0x7fa9600b2210 legacy=0x7fa9600b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa95effd700 1 -- 172.21.15.102:0/619687432 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa960159fc0 con 0x7fa9600cc840 2024-08-17T02:25:57.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa95effd700 1 --2- 172.21.15.102:0/619687432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9600cc840 0x7fa9600ccc10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa9480099b0 tx=0x7fa948009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b76e2f66688d7e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa95dffb700 1 -- 172.21.15.102:0/619687432 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800b860 con 0x7fa9600cc840 2024-08-17T02:25:57.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa95dffb700 1 -- 172.21.15.102:0/619687432 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94800b9c0 con 0x7fa9600cc840 2024-08-17T02:25:57.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.157+0000 7fa95dffb700 1 -- 172.21.15.102:0/619687432 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800bd60 con 0x7fa9600cc840 2024-08-17T02:25:57.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.161+0000 7fa9657e5700 1 -- 172.21.15.102:0/619687432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9600cc840 msgr2=0x7fa9600ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.161+0000 7fa9657e5700 1 --2- 172.21.15.102:0/619687432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9600cc840 0x7fa9600ccc10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa9480099b0 tx=0x7fa948009250 comp rx=0 tx=0).stop 2024-08-17T02:25:57.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.161+0000 7fa9657e5700 1 -- 172.21.15.102:0/619687432 shutdown_connections 2024-08-17T02:25:57.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.161+0000 7fa9657e5700 1 --2- 172.21.15.102:0/619687432 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9600b5750 0x7fa9600b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.161+0000 7fa9657e5700 1 --2- 172.21.15.102:0/619687432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9600cc840 0x7fa9600ccc10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.161+0000 7fa9657e5700 1 -- 172.21.15.102:0/619687432 >> 172.21.15.102:0/619687432 conn(0x7fa9600682c0 msgr2=0x7fa9600686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:57.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.161+0000 7fa9657e5700 1 -- 172.21.15.102:0/619687432 shutdown_connections 2024-08-17T02:25:57.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.161+0000 7fa9657e5700 1 -- 172.21.15.102:0/619687432 wait complete. 2024-08-17T02:25:57.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.161+0000 7fa9657e5700 1 Processor -- start 2024-08-17T02:25:57.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.161+0000 7fa9657e5700 1 -- start start 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa9657e5700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9600b2210 0x7fa96015cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa9657e5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9600b5750 0x7fa9600c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa9657e5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9600cc840 0x7fa960152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa9657e5700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600c9380 con 0x7fa9600cc840 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa9657e5700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600c95b0 con 0x7fa9600b5750 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa9657e5700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600c9890 con 0x7fa9600b2210 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa95f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9600cc840 0x7fa960152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa95f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9600cc840 0x7fa960152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47966/0 (socket says 172.21.15.102:47966) 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa95f7fe700 1 -- 172.21.15.102:0/441011760 learned_addr learned my addr 172.21.15.102:0/441011760 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa95effd700 1 --2- 172.21.15.102:0/441011760 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9600b2210 0x7fa96015cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa95e7fc700 1 --2- 172.21.15.102:0/441011760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9600b5750 0x7fa9600c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa95f7fe700 1 -- 172.21.15.102:0/441011760 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9600b2210 msgr2=0x7fa96015cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa95f7fe700 1 --2- 172.21.15.102:0/441011760 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9600b2210 0x7fa96015cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa95f7fe700 1 -- 172.21.15.102:0/441011760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9600b5750 msgr2=0x7fa9600c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa95f7fe700 1 --2- 172.21.15.102:0/441011760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9600b5750 0x7fa9600c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa95f7fe700 1 -- 172.21.15.102:0/441011760 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9480094f0 con 0x7fa9600cc840 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa95e7fc700 1 --2- 172.21.15.102:0/441011760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9600b5750 0x7fa9600c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:57.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa95f7fe700 1 --2- 172.21.15.102:0/441011760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9600cc840 0x7fa960152530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa958009fa0 tx=0x7fa958009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa956ffd700 1 -- 172.21.15.102:0/441011760 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95800ec70 con 0x7fa9600cc840 2024-08-17T02:25:57.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa956ffd700 1 -- 172.21.15.102:0/441011760 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95800edd0 con 0x7fa9600cc840 2024-08-17T02:25:57.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa9657e5700 1 -- 172.21.15.102:0/441011760 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9600c9b70 con 0x7fa9600cc840 2024-08-17T02:25:57.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa956ffd700 1 -- 172.21.15.102:0/441011760 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958014670 con 0x7fa9600cc840 2024-08-17T02:25:57.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa9657e5700 1 -- 172.21.15.102:0/441011760 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa960155be0 con 0x7fa9600cc840 2024-08-17T02:25:57.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.165+0000 7fa9657e5700 1 -- 172.21.15.102:0/441011760 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa960155a40 con 0x7fa9600cc840 2024-08-17T02:25:57.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.169+0000 7fa956ffd700 1 -- 172.21.15.102:0/441011760 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa958014a20 con 0x7fa9600cc840 2024-08-17T02:25:57.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.169+0000 7fa956ffd700 1 --2- 172.21.15.102:0/441011760 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa940060860 0x7fa940062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.169+0000 7fa95effd700 1 --2- 172.21.15.102:0/441011760 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa940060860 0x7fa940062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.169+0000 7fa956ffd700 1 -- 172.21.15.102:0/441011760 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa95807d220 con 0x7fa9600cc840 2024-08-17T02:25:57.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.169+0000 7fa95effd700 1 --2- 172.21.15.102:0/441011760 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa940060860 0x7fa940062d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa9480099b0 tx=0x7fa948017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.173+0000 7fa956ffd700 1 -- 172.21.15.102:0/441011760 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa960155a40 con 0x7fa9600cc840 2024-08-17T02:25:57.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:57.373+0000 7fa9657e5700 1 -- 172.21.15.102:0/441011760 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa960155a40 con 0x7fa9600cc840 2024-08-17T02:25:58.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.029+0000 7fa956ffd700 1 -- 172.21.15.102:0/441011760 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa960155a40 con 0x7fa9600cc840 2024-08-17T02:25:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.033+0000 7fa9657e5700 1 -- 172.21.15.102:0/441011760 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa940060860 msgr2=0x7fa940062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.033+0000 7fa9657e5700 1 --2- 172.21.15.102:0/441011760 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa940060860 0x7fa940062d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa9480099b0 tx=0x7fa948017000 comp rx=0 tx=0).stop 2024-08-17T02:25:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.033+0000 7fa9657e5700 1 -- 172.21.15.102:0/441011760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9600cc840 msgr2=0x7fa960152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.033+0000 7fa9657e5700 1 --2- 172.21.15.102:0/441011760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9600cc840 0x7fa960152530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa958009fa0 tx=0x7fa958009900 comp rx=0 tx=0).stop 2024-08-17T02:25:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.033+0000 7fa9657e5700 1 -- 172.21.15.102:0/441011760 shutdown_connections 2024-08-17T02:25:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.033+0000 7fa9657e5700 1 --2- 172.21.15.102:0/441011760 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa940060860 0x7fa940062d10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.033+0000 7fa9657e5700 1 --2- 172.21.15.102:0/441011760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9600cc840 0x7fa960152530 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.033+0000 7fa9657e5700 1 --2- 172.21.15.102:0/441011760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9600b5750 0x7fa9600c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.033+0000 7fa9657e5700 1 --2- 172.21.15.102:0/441011760 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9600b2210 0x7fa96015cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.033+0000 7fa9657e5700 1 -- 172.21.15.102:0/441011760 >> 172.21.15.102:0/441011760 conn(0x7fa9600682c0 msgr2=0x7fa9600b5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.033+0000 7fa9657e5700 1 -- 172.21.15.102:0/441011760 shutdown_connections 2024-08-17T02:25:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.033+0000 7fa9657e5700 1 -- 172.21.15.102:0/441011760 wait complete. 2024-08-17T02:25:58.051 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:58.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f6203098700 1 Processor -- start 2024-08-17T02:25:58.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f6203098700 1 -- start start 2024-08-17T02:25:58.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f6203098700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f61fc0af030 0x7f61fc0a9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f6203098700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61fc1598a0 0x7f61fc0b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f6203098700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61fc0b00d0 con 0x7f61fc0a8f50 2024-08-17T02:25:58.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f6203098700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61fc0b11b0 con 0x7f61fc0af030 2024-08-17T02:25:58.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f6203098700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc159d40 con 0x7f61fc1598a0 2024-08-17T02:25:58.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f61fbfff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f61fc0af030 0x7f61fc0a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f61fbfff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f61fc0af030 0x7f61fc0a9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47976/0 (socket says 172.21.15.102:47976) 2024-08-17T02:25:58.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f61fbfff700 1 -- 172.21.15.102:0/3589047008 learned_addr learned my addr 172.21.15.102:0/3589047008 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:58.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f6201635700 1 --2- 172.21.15.102:0/3589047008 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61fc1598a0 0x7f61fc0b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f61fbfff700 1 -- 172.21.15.102:0/3589047008 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61fc1598a0 msgr2=0x7f61fc0b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:58.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f61fbfff700 1 --2- 172.21.15.102:0/3589047008 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61fc1598a0 0x7f61fc0b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f61fbfff700 1 -- 172.21.15.102:0/3589047008 >> v1:172.21.15.121:6789/0 conn(0x7f61fc0a8f50 legacy=0x7f61fc0b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f61fbfff700 1 -- 172.21.15.102:0/3589047008 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61fc0af4c0 con 0x7f61fc0af030 2024-08-17T02:25:58.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f61fbfff700 1 --2- 172.21.15.102:0/3589047008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc0af030 0x7f61fc0a9320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009f20 tx=0x7f61ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2445f9d9cb152de0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:58.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f61fb7fe700 1 -- 172.21.15.102:0/3589047008 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec00e070 con 0x7f61fc0af030 2024-08-17T02:25:58.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f61fb7fe700 1 -- 172.21.15.102:0/3589047008 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ec00ba80 con 0x7f61fc0af030 2024-08-17T02:25:58.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f61fb7fe700 1 -- 172.21.15.102:0/3589047008 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec0092e0 con 0x7f61fc0af030 2024-08-17T02:25:58.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f6203098700 1 -- 172.21.15.102:0/3589047008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc0af030 msgr2=0x7f61fc0a9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.157+0000 7f6203098700 1 --2- 172.21.15.102:0/3589047008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc0af030 0x7f61fc0a9320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009f20 tx=0x7f61ec009840 comp rx=0 tx=0).stop 2024-08-17T02:25:58.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f6203098700 1 -- 172.21.15.102:0/3589047008 shutdown_connections 2024-08-17T02:25:58.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f6203098700 1 --2- 172.21.15.102:0/3589047008 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61fc1598a0 0x7f61fc0b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f6203098700 1 --2- 172.21.15.102:0/3589047008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc0af030 0x7f61fc0a9320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f6203098700 1 -- 172.21.15.102:0/3589047008 >> 172.21.15.102:0/3589047008 conn(0x7f61fc066e00 msgr2=0x7f61fc067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:58.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f6203098700 1 -- 172.21.15.102:0/3589047008 shutdown_connections 2024-08-17T02:25:58.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f6203098700 1 -- 172.21.15.102:0/3589047008 wait complete. 2024-08-17T02:25:58.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f6203098700 1 Processor -- start 2024-08-17T02:25:58.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f6203098700 1 -- start start 2024-08-17T02:25:58.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f6203098700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61fc0a8f50 0x7f61fc134540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f6203098700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc0af030 0x7f61fc098ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f6203098700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61fc1598a0 0x7f61fc099020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f6203098700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc098150 con 0x7f61fc0af030 2024-08-17T02:25:58.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f6203098700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc142c40 con 0x7f61fc0a8f50 2024-08-17T02:25:58.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f6203098700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc0acf00 con 0x7f61fc1598a0 2024-08-17T02:25:58.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f61fbfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc0af030 0x7f61fc098ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f61fbfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc0af030 0x7f61fc098ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47980/0 (socket says 172.21.15.102:47980) 2024-08-17T02:25:58.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f61fbfff700 1 -- 172.21.15.102:0/3834753254 learned_addr learned my addr 172.21.15.102:0/3834753254 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:58.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f6201635700 1 --2- 172.21.15.102:0/3834753254 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61fc1598a0 0x7f61fc099020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.161+0000 7f6200e34700 1 --2- 172.21.15.102:0/3834753254 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61fc0a8f50 0x7f61fc134540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.165+0000 7f61fbfff700 1 -- 172.21.15.102:0/3834753254 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61fc1598a0 msgr2=0x7f61fc099020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.165+0000 7f61fbfff700 1 --2- 172.21.15.102:0/3834753254 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61fc1598a0 0x7f61fc099020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.165+0000 7f61fbfff700 1 -- 172.21.15.102:0/3834753254 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61fc0a8f50 msgr2=0x7f61fc134540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.165+0000 7f61fbfff700 1 --2- 172.21.15.102:0/3834753254 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61fc0a8f50 0x7f61fc134540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.165+0000 7f61fbfff700 1 -- 172.21.15.102:0/3834753254 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec009ae0 con 0x7f61fc0af030 2024-08-17T02:25:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.165+0000 7f61fbfff700 1 --2- 172.21.15.102:0/3834753254 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc0af030 0x7f61fc098ae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00b6c0 tx=0x7f61ec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.165+0000 7f61f8ff9700 1 -- 172.21.15.102:0/3834753254 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec0088b0 con 0x7f61fc0af030 2024-08-17T02:25:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.165+0000 7f61f8ff9700 1 -- 172.21.15.102:0/3834753254 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ec008a30 con 0x7f61fc0af030 2024-08-17T02:25:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.165+0000 7f6203098700 1 -- 172.21.15.102:0/3834753254 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61fc142960 con 0x7f61fc0af030 2024-08-17T02:25:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.165+0000 7f61f8ff9700 1 -- 172.21.15.102:0/3834753254 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec008df0 con 0x7f61fc0af030 2024-08-17T02:25:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.165+0000 7f6203098700 1 -- 172.21.15.102:0/3834753254 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61fc0ac8b0 con 0x7f61fc0af030 2024-08-17T02:25:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.165+0000 7f6203098700 1 -- 172.21.15.102:0/3834753254 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61fc0ad090 con 0x7f61fc0af030 2024-08-17T02:25:58.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.165+0000 7f61f8ff9700 1 -- 172.21.15.102:0/3834753254 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f61ec003040 con 0x7f61fc0af030 2024-08-17T02:25:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.169+0000 7f61f8ff9700 1 --2- 172.21.15.102:0/3834753254 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f61e8060860 0x7f61e8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.169+0000 7f6200e34700 1 --2- 172.21.15.102:0/3834753254 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f61e8060860 0x7f61e8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.169+0000 7f61f8ff9700 1 -- 172.21.15.102:0/3834753254 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f61ec07ea00 con 0x7f61fc0af030 2024-08-17T02:25:58.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.169+0000 7f6200e34700 1 --2- 172.21.15.102:0/3834753254 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f61e8060860 0x7f61e8062d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f61fc0add80 tx=0x7f61f0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:58.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.173+0000 7f61f8ff9700 1 -- 172.21.15.102:0/3834753254 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f61ec04ef00 con 0x7f61fc0af030 2024-08-17T02:25:58.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.377+0000 7f6203098700 1 -- 172.21.15.102:0/3834753254 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61fc0645c0 con 0x7f61fc0af030 2024-08-17T02:25:58.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.377+0000 7f61f8ff9700 1 -- 172.21.15.102:0/3834753254 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f61ec021090 con 0x7f61fc0af030 2024-08-17T02:25:58.381 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:58.381 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/3384500830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3384500830},{"type":"v1","addr":"172.21.15.121:6833","nonce":3384500830}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1668690087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1668690087},{"type":"v1","addr":"172.21.15.102:6837","nonce":1668690087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/932475255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":932475255},{"type":"v1","addr":"172.21.15.102:6835","nonce":932475255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:55.340445+0000","modified":"2024-08-17T02:25:58.024448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/4026340784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4026340784},{"type":"v1","addr":"172.21.15.121:6835","nonce":4026340784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:58.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.381+0000 7f6203098700 1 -- 172.21.15.102:0/3834753254 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f61e8060860 msgr2=0x7f61e8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.381+0000 7f6203098700 1 --2- 172.21.15.102:0/3834753254 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f61e8060860 0x7f61e8062d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f61fc0add80 tx=0x7f61f0009040 comp rx=0 tx=0).stop 2024-08-17T02:25:58.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.381+0000 7f6203098700 1 -- 172.21.15.102:0/3834753254 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc0af030 msgr2=0x7f61fc098ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.381+0000 7f6203098700 1 --2- 172.21.15.102:0/3834753254 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc0af030 0x7f61fc098ae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00b6c0 tx=0x7f61ec018000 comp rx=0 tx=0).stop 2024-08-17T02:25:58.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.381+0000 7f6203098700 1 -- 172.21.15.102:0/3834753254 shutdown_connections 2024-08-17T02:25:58.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.381+0000 7f6203098700 1 --2- 172.21.15.102:0/3834753254 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f61e8060860 0x7f61e8062d10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.381+0000 7f6203098700 1 --2- 172.21.15.102:0/3834753254 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc0af030 0x7f61fc098ae0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.381+0000 7f6203098700 1 --2- 172.21.15.102:0/3834753254 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f61fc1598a0 0x7f61fc099020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.381+0000 7f6203098700 1 --2- 172.21.15.102:0/3834753254 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61fc0a8f50 0x7f61fc134540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.381+0000 7f6203098700 1 -- 172.21.15.102:0/3834753254 >> 172.21.15.102:0/3834753254 conn(0x7f61fc066e00 msgr2=0x7f61fc0671d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:58.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.381+0000 7f6203098700 1 -- 172.21.15.102:0/3834753254 shutdown_connections 2024-08-17T02:25:58.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.381+0000 7f6203098700 1 -- 172.21.15.102:0/3834753254 wait complete. 2024-08-17T02:25:58.384 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 6 2024-08-17T02:25:58.398 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:58.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.493+0000 7fa4d90f4700 1 Processor -- start 2024-08-17T02:25:58.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.493+0000 7fa4d90f4700 1 -- start start 2024-08-17T02:25:58.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.493+0000 7fa4d90f4700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa4d40b4240 0x7fa4d415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.493+0000 7fa4d90f4700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d415a820 con 0x7fa4d40aac50 2024-08-17T02:25:58.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.493+0000 7fa4d90f4700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d415b010 con 0x7fa4d415aa30 2024-08-17T02:25:58.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.493+0000 7fa4d90f4700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d415bc90 con 0x7fa4d40b4240 2024-08-17T02:25:58.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.493+0000 7fa4d2d9d700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa4d40aac50 0x7fa4d41574a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49564/0 (socket says 172.21.15.102:49564) 2024-08-17T02:25:58.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.493+0000 7fa4d2d9d700 1 -- 172.21.15.102:0/3293651460 learned_addr learned my addr 172.21.15.102:0/3293651460 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:25:58.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.493+0000 7fa4d359e700 1 --2- 172.21.15.102:0/3293651460 >> v2:172.21.15.121:3300/0 conn(0x7fa4d40b4240 0x7fa4d415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 -- 172.21.15.102:0/3293651460 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365019194 0 0) 0x7fa4c4001290 con 0x7fa4d40aac50 2024-08-17T02:25:58.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 -- 172.21.15.102:0/3293651460 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4c0003570 con 0x7fa4d40aac50 2024-08-17T02:25:58.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 -- 172.21.15.102:0/3293651460 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 338616378 0 0) 0x7fa4c0003570 con 0x7fa4d40aac50 2024-08-17T02:25:58.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 -- 172.21.15.102:0/3293651460 >> v2:172.21.15.121:3300/0 conn(0x7fa4d40b4240 msgr2=0x7fa4d415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:58.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 --2- 172.21.15.102:0/3293651460 >> v2:172.21.15.121:3300/0 conn(0x7fa4d40b4240 0x7fa4d415a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 -- 172.21.15.102:0/3293651460 >> v1:172.21.15.121:6789/0 conn(0x7fa4d415aa30 legacy=0x7fa4d40b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 -- 172.21.15.102:0/3293651460 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d415b2f0 con 0x7fa4d40aac50 2024-08-17T02:25:58.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 -- 172.21.15.102:0/3293651460 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7fa4c4001780 con 0x7fa4d40aac50 2024-08-17T02:25:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 -- 172.21.15.102:0/3293651460 >> v1:172.21.15.102:6789/0 conn(0x7fa4d40aac50 legacy=0x7fa4d41574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 --2- 172.21.15.102:0/3293651460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4c0003a60 0x7fa4c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 --2- 172.21.15.102:0/3293651460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4c0004810 0x7fa4c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 --2- 172.21.15.102:0/3293651460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c00051c0 0x7fa4c000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 -- 172.21.15.102:0/3293651460 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d415bc90 con 0x7fa4c00051c0 2024-08-17T02:25:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 -- 172.21.15.102:0/3293651460 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c000c160 con 0x7fa4c0004810 2024-08-17T02:25:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 -- 172.21.15.102:0/3293651460 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c000c320 con 0x7fa4c0003a60 2024-08-17T02:25:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d359e700 1 --2- 172.21.15.102:0/3293651460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c00051c0 0x7fa4c000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4cbfff700 1 --2- 172.21.15.102:0/3293651460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4c0004810 0x7fa4c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d2d9d700 1 --2- 172.21.15.102:0/3293651460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4c0003a60 0x7fa4c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d359e700 1 -- 172.21.15.102:0/3293651460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4c0003a60 msgr2=0x7fa4c0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d359e700 1 --2- 172.21.15.102:0/3293651460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4c0003a60 0x7fa4c0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d359e700 1 -- 172.21.15.102:0/3293651460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4c0004810 msgr2=0x7fa4c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d359e700 1 --2- 172.21.15.102:0/3293651460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4c0004810 0x7fa4c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d359e700 1 -- 172.21.15.102:0/3293651460 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c0003570 con 0x7fa4c00051c0 2024-08-17T02:25:58.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d359e700 1 -- 172.21.15.102:0/3293651460 reap_dead start 2024-08-17T02:25:58.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d359e700 1 --2- 172.21.15.102:0/3293651460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c00051c0 0x7fa4c000ba60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40b4640 tx=0x7fa4cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11634e7c57deb8fa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:58.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 -- 172.21.15.102:0/3293651460 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc00ea90 con 0x7fa4c00051c0 2024-08-17T02:25:58.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 -- 172.21.15.102:0/3293651460 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc00f040 con 0x7fa4c00051c0 2024-08-17T02:25:58.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d259c700 1 -- 172.21.15.102:0/3293651460 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc00ee60 con 0x7fa4c00051c0 2024-08-17T02:25:58.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d90f4700 1 -- 172.21.15.102:0/3293651460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c00051c0 msgr2=0x7fa4c000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d90f4700 1 --2- 172.21.15.102:0/3293651460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c00051c0 0x7fa4c000ba60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40b4640 tx=0x7fa4cc00b040 comp rx=0 tx=0).stop 2024-08-17T02:25:58.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d90f4700 1 -- 172.21.15.102:0/3293651460 shutdown_connections 2024-08-17T02:25:58.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d90f4700 1 --2- 172.21.15.102:0/3293651460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c00051c0 0x7fa4c000ba60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d90f4700 1 -- 172.21.15.102:0/3293651460 >> 172.21.15.102:0/3293651460 conn(0x7fa4d40994d0 msgr2=0x7fa4d40675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:58.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d90f4700 1 -- 172.21.15.102:0/3293651460 shutdown_connections 2024-08-17T02:25:58.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.497+0000 7fa4d90f4700 1 -- 172.21.15.102:0/3293651460 wait complete. 2024-08-17T02:25:58.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d90f4700 1 Processor -- start 2024-08-17T02:25:58.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d90f4700 1 -- start start 2024-08-17T02:25:58.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d90f4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c00051c0 0x7fa4d414cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d90f4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4d4155250 0x7fa4d41568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d90f4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4d40b19f0 0x7fa4d4148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d90f4700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d4156420 con 0x7fa4c00051c0 2024-08-17T02:25:58.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d90f4700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d4155810 con 0x7fa4d4155250 2024-08-17T02:25:58.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d90f4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d4155af0 con 0x7fa4d40b19f0 2024-08-17T02:25:58.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d2d9d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c00051c0 0x7fa4d414cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d2d9d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c00051c0 0x7fa4d414cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48004/0 (socket says 172.21.15.102:48004) 2024-08-17T02:25:58.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d2d9d700 1 -- 172.21.15.102:0/686728879 learned_addr learned my addr 172.21.15.102:0/686728879 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:58.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4cbfff700 1 --2- 172.21.15.102:0/686728879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4d4155250 0x7fa4d41568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d359e700 1 --2- 172.21.15.102:0/686728879 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4d40b19f0 0x7fa4d4148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d2d9d700 1 -- 172.21.15.102:0/686728879 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4d40b19f0 msgr2=0x7fa4d4148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d2d9d700 1 --2- 172.21.15.102:0/686728879 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4d40b19f0 0x7fa4d4148210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d2d9d700 1 -- 172.21.15.102:0/686728879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4d4155250 msgr2=0x7fa4d41568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d2d9d700 1 --2- 172.21.15.102:0/686728879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4d4155250 0x7fa4d41568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.501+0000 7fa4d2d9d700 1 -- 172.21.15.102:0/686728879 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d4155dd0 con 0x7fa4c00051c0 2024-08-17T02:25:58.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.505+0000 7fa4d2d9d700 1 --2- 172.21.15.102:0/686728879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c00051c0 0x7fa4d414cf50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40073a0 tx=0x7fa4c4007a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:58.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.505+0000 7fa4caffd700 1 -- 172.21.15.102:0/686728879 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4007e10 con 0x7fa4c00051c0 2024-08-17T02:25:58.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.505+0000 7fa4caffd700 1 -- 172.21.15.102:0/686728879 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c400f8d0 con 0x7fa4c00051c0 2024-08-17T02:25:58.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.505+0000 7fa4d90f4700 1 -- 172.21.15.102:0/686728879 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d41560b0 con 0x7fa4c00051c0 2024-08-17T02:25:58.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.505+0000 7fa4caffd700 1 -- 172.21.15.102:0/686728879 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c400fc90 con 0x7fa4c00051c0 2024-08-17T02:25:58.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.505+0000 7fa4d90f4700 1 -- 172.21.15.102:0/686728879 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d4156df0 con 0x7fa4c00051c0 2024-08-17T02:25:58.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.505+0000 7fa4d90f4700 1 -- 172.21.15.102:0/686728879 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d40645c0 con 0x7fa4c00051c0 2024-08-17T02:25:58.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.505+0000 7fa4caffd700 1 -- 172.21.15.102:0/686728879 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa4c4013600 con 0x7fa4c00051c0 2024-08-17T02:25:58.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.505+0000 7fa4caffd700 1 --2- 172.21.15.102:0/686728879 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa4b4060890 0x7fa4b4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.505+0000 7fa4caffd700 1 -- 172.21.15.102:0/686728879 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4c407cc50 con 0x7fa4c00051c0 2024-08-17T02:25:58.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.505+0000 7fa4cbfff700 1 --2- 172.21.15.102:0/686728879 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa4b4060890 0x7fa4b4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.509+0000 7fa4cbfff700 1 --2- 172.21.15.102:0/686728879 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa4b4060890 0x7fa4b4062d40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa4d409e010 tx=0x7fa4bc007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:58.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.517+0000 7fa4caffd700 1 -- 172.21.15.102:0/686728879 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa4c4082020 con 0x7fa4c00051c0 2024-08-17T02:25:58.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.681+0000 7fa4d90f4700 1 -- 172.21.15.102:0/686728879 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4d415a820 con 0x7fa4c00051c0 2024-08-17T02:25:58.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.681+0000 7fa4caffd700 1 -- 172.21.15.102:0/686728879 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fa4d415a820 con 0x7fa4c00051c0 2024-08-17T02:25:58.685 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:58.685 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:57.002263+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:53.562223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:54.343618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:58.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.685+0000 7fa4d90f4700 1 -- 172.21.15.102:0/686728879 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa4b4060890 msgr2=0x7fa4b4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.685+0000 7fa4d90f4700 1 --2- 172.21.15.102:0/686728879 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa4b4060890 0x7fa4b4062d40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa4d409e010 tx=0x7fa4bc007d30 comp rx=0 tx=0).stop 2024-08-17T02:25:58.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.685+0000 7fa4d90f4700 1 -- 172.21.15.102:0/686728879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c00051c0 msgr2=0x7fa4d414cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.685+0000 7fa4d90f4700 1 --2- 172.21.15.102:0/686728879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c00051c0 0x7fa4d414cf50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40073a0 tx=0x7fa4c4007a70 comp rx=0 tx=0).stop 2024-08-17T02:25:58.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.685+0000 7fa4d90f4700 1 -- 172.21.15.102:0/686728879 shutdown_connections 2024-08-17T02:25:58.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.685+0000 7fa4d90f4700 1 --2- 172.21.15.102:0/686728879 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa4b4060890 0x7fa4b4062d40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.685+0000 7fa4d90f4700 1 --2- 172.21.15.102:0/686728879 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4d40b19f0 0x7fa4d4148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.685+0000 7fa4d90f4700 1 --2- 172.21.15.102:0/686728879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4d4155250 0x7fa4d41568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.685+0000 7fa4d90f4700 1 --2- 172.21.15.102:0/686728879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c00051c0 0x7fa4d414cf50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.685+0000 7fa4d90f4700 1 -- 172.21.15.102:0/686728879 >> 172.21.15.102:0/686728879 conn(0x7fa4d40994d0 msgr2=0x7fa4d4153470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:58.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.685+0000 7fa4d90f4700 1 -- 172.21.15.102:0/686728879 shutdown_connections 2024-08-17T02:25:58.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.685+0000 7fa4d90f4700 1 -- 172.21.15.102:0/686728879 wait complete. 2024-08-17T02:25:58.699 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:25:58.700 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:58.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b21f0e700 1 Processor -- start 2024-08-17T02:25:58.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b21f0e700 1 -- start start 2024-08-17T02:25:58.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b21f0e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7b1c0af030 0x7f7b1c0a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b21f0e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b1c0a9260 0x7f7b1c0b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b21f0e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b1c0b0270 con 0x7f7b1c15d540 2024-08-17T02:25:58.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b21f0e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c0af660 con 0x7f7b1c0af030 2024-08-17T02:25:58.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b21f0e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0af940 con 0x7f7b1c0a9260 2024-08-17T02:25:58.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b1affd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7b1c0af030 0x7f7b1c0a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b1bfff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b1c0a9260 0x7f7b1c0b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b1affd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7b1c0af030 0x7f7b1c0a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:52382/0 (socket says 172.21.15.102:52382) 2024-08-17T02:25:58.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b1affd700 1 -- 172.21.15.102:0/862751826 learned_addr learned my addr 172.21.15.102:0/862751826 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b1affd700 1 -- 172.21.15.102:0/862751826 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b1c0a9260 msgr2=0x7f7b1c0b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b1affd700 1 --2- 172.21.15.102:0/862751826 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b1c0a9260 0x7f7b1c0b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b1affd700 1 -- 172.21.15.102:0/862751826 >> v1:172.21.15.121:6789/0 conn(0x7f7b1c15d540 legacy=0x7f7b1c06e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b1affd700 1 -- 172.21.15.102:0/862751826 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c0afc20 con 0x7f7b1c0af030 2024-08-17T02:25:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b1affd700 1 --2- 172.21.15.102:0/862751826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b1c0af030 0x7f7b1c0a8d20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009f20 tx=0x7f7b14009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efce37bd5825dd65 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b1a7fc700 1 -- 172.21.15.102:0/862751826 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400e070 con 0x7f7b1c0af030 2024-08-17T02:25:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b1a7fc700 1 -- 172.21.15.102:0/862751826 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1400b9d0 con 0x7f7b1c0af030 2024-08-17T02:25:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b1a7fc700 1 -- 172.21.15.102:0/862751826 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b140092e0 con 0x7f7b1c0af030 2024-08-17T02:25:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b21f0e700 1 -- 172.21.15.102:0/862751826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b1c0af030 msgr2=0x7f7b1c0a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b21f0e700 1 --2- 172.21.15.102:0/862751826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b1c0af030 0x7f7b1c0a8d20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009f20 tx=0x7f7b14009840 comp rx=0 tx=0).stop 2024-08-17T02:25:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b21f0e700 1 -- 172.21.15.102:0/862751826 shutdown_connections 2024-08-17T02:25:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b21f0e700 1 --2- 172.21.15.102:0/862751826 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b1c0a9260 0x7f7b1c0b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.805+0000 7f7b21f0e700 1 --2- 172.21.15.102:0/862751826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b1c0af030 0x7f7b1c0a8d20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b21f0e700 1 -- 172.21.15.102:0/862751826 >> 172.21.15.102:0/862751826 conn(0x7f7b1c066e00 msgr2=0x7f7b1c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b21f0e700 1 -- 172.21.15.102:0/862751826 shutdown_connections 2024-08-17T02:25:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b21f0e700 1 -- 172.21.15.102:0/862751826 wait complete. 2024-08-17T02:25:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b21f0e700 1 Processor -- start 2024-08-17T02:25:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b21f0e700 1 -- start start 2024-08-17T02:25:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b21f0e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b1c0a9260 0x7f7b1c0ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b21f0e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b1c0af030 0x7f7b1c16a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b21f0e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b1c15d540 0x7f7b1c15c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b21f0e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c16e470 con 0x7f7b1c0a9260 2024-08-17T02:25:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b21f0e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0ad420 con 0x7f7b1c15d540 2024-08-17T02:25:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b21f0e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0acb30 con 0x7f7b1c0af030 2024-08-17T02:25:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b1b7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b1c0a9260 0x7f7b1c0ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b1b7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b1c0a9260 0x7f7b1c0ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48012/0 (socket says 172.21.15.102:48012) 2024-08-17T02:25:58.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b1b7fe700 1 -- 172.21.15.102:0/1366259284 learned_addr learned my addr 172.21.15.102:0/1366259284 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:58.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b1bfff700 1 --2- 172.21.15.102:0/1366259284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b1c15d540 0x7f7b1c15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b1affd700 1 --2- 172.21.15.102:0/1366259284 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b1c0af030 0x7f7b1c16a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b1b7fe700 1 -- 172.21.15.102:0/1366259284 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b1c0af030 msgr2=0x7f7b1c16a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b1b7fe700 1 --2- 172.21.15.102:0/1366259284 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b1c0af030 0x7f7b1c16a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b1b7fe700 1 -- 172.21.15.102:0/1366259284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b1c15d540 msgr2=0x7f7b1c15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b1b7fe700 1 --2- 172.21.15.102:0/1366259284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b1c15d540 0x7f7b1c15c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b1b7fe700 1 -- 172.21.15.102:0/1366259284 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14009ae0 con 0x7f7b1c0a9260 2024-08-17T02:25:58.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b1bfff700 1 --2- 172.21.15.102:0/1366259284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b1c15d540 0x7f7b1c15c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:58.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b1b7fe700 1 --2- 172.21.15.102:0/1366259284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b1c0a9260 0x7f7b1c0ad8b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000c4e0 tx=0x7f7b1000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:58.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b037fe700 1 -- 172.21.15.102:0/1366259284 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b10011590 con 0x7f7b1c0a9260 2024-08-17T02:25:58.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b037fe700 1 -- 172.21.15.102:0/1366259284 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b10011710 con 0x7f7b1c0a9260 2024-08-17T02:25:58.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b21f0e700 1 -- 172.21.15.102:0/1366259284 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1c16e190 con 0x7f7b1c0a9260 2024-08-17T02:25:58.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b037fe700 1 -- 172.21.15.102:0/1366259284 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b10011ad0 con 0x7f7b1c0a9260 2024-08-17T02:25:58.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.809+0000 7f7b21f0e700 1 -- 172.21.15.102:0/1366259284 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1c0ad130 con 0x7f7b1c0a9260 2024-08-17T02:25:58.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.813+0000 7f7b21f0e700 1 -- 172.21.15.102:0/1366259284 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1c0645c0 con 0x7f7b1c0a9260 2024-08-17T02:25:58.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.813+0000 7f7b037fe700 1 -- 172.21.15.102:0/1366259284 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7b1001b3b0 con 0x7f7b1c0a9260 2024-08-17T02:25:58.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.813+0000 7f7b037fe700 1 --2- 172.21.15.102:0/1366259284 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7b08060860 0x7f7b08062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.813+0000 7f7b037fe700 1 -- 172.21.15.102:0/1366259284 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b1007c090 con 0x7f7b1c0a9260 2024-08-17T02:25:58.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.813+0000 7f7b1affd700 1 --2- 172.21.15.102:0/1366259284 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7b08060860 0x7f7b08062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.813+0000 7f7b1affd700 1 --2- 172.21.15.102:0/1366259284 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7b08060860 0x7f7b08062d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009880 tx=0x7f7b14018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:58.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.821+0000 7f7b037fe700 1 -- 172.21.15.102:0/1366259284 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7b1004c4e0 con 0x7f7b1c0a9260 2024-08-17T02:25:58.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.985+0000 7f7b21f0e700 1 -- 172.21.15.102:0/1366259284 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b1c06f360 con 0x7f7b08060860 2024-08-17T02:25:58.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.993+0000 7f7b037fe700 1 -- 172.21.15.102:0/1366259284 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252294 (secure 0 0 0) 0x7f7b1c06f360 con 0x7f7b08060860 2024-08-17T02:25:59.000 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:59.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.997+0000 7f7b21f0e700 1 -- 172.21.15.102:0/1366259284 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7b08060860 msgr2=0x7f7b08062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.997+0000 7f7b21f0e700 1 --2- 172.21.15.102:0/1366259284 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7b08060860 0x7f7b08062d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009880 tx=0x7f7b14018000 comp rx=0 tx=0).stop 2024-08-17T02:25:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.997+0000 7f7b21f0e700 1 -- 172.21.15.102:0/1366259284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b1c0a9260 msgr2=0x7f7b1c0ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.997+0000 7f7b21f0e700 1 --2- 172.21.15.102:0/1366259284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b1c0a9260 0x7f7b1c0ad8b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000c4e0 tx=0x7f7b1000c8a0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.997+0000 7f7b21f0e700 1 -- 172.21.15.102:0/1366259284 shutdown_connections 2024-08-17T02:25:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.997+0000 7f7b21f0e700 1 --2- 172.21.15.102:0/1366259284 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7b08060860 0x7f7b08062d10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.997+0000 7f7b21f0e700 1 --2- 172.21.15.102:0/1366259284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b1c15d540 0x7f7b1c15c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.997+0000 7f7b21f0e700 1 --2- 172.21.15.102:0/1366259284 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7b1c0af030 0x7f7b1c16a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.997+0000 7f7b21f0e700 1 --2- 172.21.15.102:0/1366259284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b1c0a9260 0x7f7b1c0ad8b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.997+0000 7f7b21f0e700 1 -- 172.21.15.102:0/1366259284 >> 172.21.15.102:0/1366259284 conn(0x7f7b1c066e00 msgr2=0x7f7b1c15ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.997+0000 7f7b21f0e700 1 -- 172.21.15.102:0/1366259284 shutdown_connections 2024-08-17T02:25:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:58.997+0000 7f7b21f0e700 1 -- 172.21.15.102:0/1366259284 wait complete. 2024-08-17T02:25:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-08-17T02:25:59.018 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-08-17T02:25:57.176560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381884,"kb_used_data":2416,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592836,"statfs":{"total":773094113280,"available":770655064064,"internally_reserved":0,"allocated":2473984,"data_stored":1560014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.199567"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.981516+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990002+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.981280+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:39:25.522474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.993578+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:13.181529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.991656+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:40.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.994693+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:25.928936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.989063+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:39.955144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.989977+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984464+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.994797+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:23.175809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990239+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:14.842533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.999710+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990990+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:30.053768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.999744+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984989+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:30.053768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.999737+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-08-17T02:25:53.328162+0000","last_change":"2024-08-17T02:25:51.241912+0000","last_active":"2024-08-17T02:25:53.328162+0000","last_peered":"2024-08-17T02:25:53.328162+0000","last_clean":"2024-08-17T02:25:53.328162+0000","last_became_active":"2024-08-17T02:25:51.239655+0000","last_became_peered":"2024-08-17T02:25:51.239655+0000","last_unstale":"2024-08-17T02:25:53.328162+0000","last_undegraded":"2024-08-17T02:25:53.328162+0000","last_fullsized":"2024-08-17T02:25:53.328162+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_clean_scrub_stamp":"2024-08-17T02:25:49.863184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:53.845381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.992540+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:30.053768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.989225+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:40.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.999739+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:14.842533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.993400+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:33:55.304496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.985596+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:23.175809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.982716+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:26.856354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.985012+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:13.181529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990758+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990023+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:01.595885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.985206+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:25.928936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984988+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:33:55.304496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.983092+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:00.101762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990838+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984238+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:20.748382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.981534+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984840+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":745472,"data_stored":633623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":126976,"data_stored":32003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":14,"seq":60129542146,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297516,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":163840,"data_stored":48670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.109}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.615}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5189999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297516,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":163840,"data_stored":48670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]}]},{"osd":0,"up_from":14,"seq":60129542146,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298704,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073136,"statfs":{"total":96636764160,"available":96330891264,"internally_reserved":0,"allocated":745472,"data_stored":633623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9350000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:59.023 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:59.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49fb4f7700 1 Processor -- start 2024-08-17T02:25:59.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49fb4f7700 1 -- start start 2024-08-17T02:25:59.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49fb4f7700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f49f4155e50 0x7f49f40a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49fb4f7700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f49f406f2f0 0x7f49f40aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49fb4f7700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f40afc10 con 0x7f49f4156220 2024-08-17T02:25:59.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49fb4f7700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f40b10b0 con 0x7f49f4155e50 2024-08-17T02:25:59.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49fb4f7700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40aed20 con 0x7f49f406f2f0 2024-08-17T02:25:59.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49f9293700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f49f4155e50 0x7f49f40a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49f9293700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f49f4155e50 0x7f49f40a9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48028/0 (socket says 172.21.15.102:48028) 2024-08-17T02:25:59.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49f9293700 1 -- 172.21.15.102:0/3845120171 learned_addr learned my addr 172.21.15.102:0/3845120171 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:59.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49f9a94700 1 --2- 172.21.15.102:0/3845120171 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f49f406f2f0 0x7f49f40aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49f9293700 1 -- 172.21.15.102:0/3845120171 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f49f406f2f0 msgr2=0x7f49f40aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:59.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49f9293700 1 --2- 172.21.15.102:0/3845120171 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f49f406f2f0 0x7f49f40aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49f9293700 1 -- 172.21.15.102:0/3845120171 >> v1:172.21.15.121:6789/0 conn(0x7f49f4156220 legacy=0x7f49f406ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49f9293700 1 -- 172.21.15.102:0/3845120171 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f40af000 con 0x7f49f4155e50 2024-08-17T02:25:59.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49f9a94700 1 --2- 172.21.15.102:0/3845120171 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f49f406f2f0 0x7f49f40aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:59.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49f9293700 1 --2- 172.21.15.102:0/3845120171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49f4155e50 0x7f49f40a9ee0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f49e40099b0 tx=0x7f49e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cac48b23308ce2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:59.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49ebfff700 1 -- 172.21.15.102:0/3845120171 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e400b860 con 0x7f49f4155e50 2024-08-17T02:25:59.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49ebfff700 1 -- 172.21.15.102:0/3845120171 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e400b9c0 con 0x7f49f4155e50 2024-08-17T02:25:59.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.133+0000 7f49ebfff700 1 -- 172.21.15.102:0/3845120171 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e400bd60 con 0x7f49f4155e50 2024-08-17T02:25:59.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.137+0000 7f49fb4f7700 1 -- 172.21.15.102:0/3845120171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49f4155e50 msgr2=0x7f49f40a9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.137+0000 7f49fb4f7700 1 --2- 172.21.15.102:0/3845120171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49f4155e50 0x7f49f40a9ee0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f49e40099b0 tx=0x7f49e4009250 comp rx=0 tx=0).stop 2024-08-17T02:25:59.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.137+0000 7f49fb4f7700 1 -- 172.21.15.102:0/3845120171 shutdown_connections 2024-08-17T02:25:59.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.137+0000 7f49fb4f7700 1 --2- 172.21.15.102:0/3845120171 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f49f406f2f0 0x7f49f40aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.137+0000 7f49fb4f7700 1 --2- 172.21.15.102:0/3845120171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49f4155e50 0x7f49f40a9ee0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.137+0000 7f49fb4f7700 1 -- 172.21.15.102:0/3845120171 >> 172.21.15.102:0/3845120171 conn(0x7f49f4066e00 msgr2=0x7f49f4067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:59.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.137+0000 7f49fb4f7700 1 -- 172.21.15.102:0/3845120171 shutdown_connections 2024-08-17T02:25:59.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.137+0000 7f49fb4f7700 1 -- 172.21.15.102:0/3845120171 wait complete. 2024-08-17T02:25:59.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.137+0000 7f49fb4f7700 1 Processor -- start 2024-08-17T02:25:59.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.137+0000 7f49fb4f7700 1 -- start start 2024-08-17T02:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49fb4f7700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f49f406f2f0 0x7f49f40c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49fb4f7700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49f4155e50 0x7f49f40987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49fb4f7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49f4156220 0x7f49f414c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49fb4f7700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f4168450 con 0x7f49f4155e50 2024-08-17T02:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49fb4f7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40c92c0 con 0x7f49f4156220 2024-08-17T02:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49fb4f7700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40c95a0 con 0x7f49f406f2f0 2024-08-17T02:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49f8a92700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49f4155e50 0x7f49f40987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49f8a92700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49f4155e50 0x7f49f40987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48032/0 (socket says 172.21.15.102:48032) 2024-08-17T02:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49f8a92700 1 -- 172.21.15.102:0/902502109 learned_addr learned my addr 172.21.15.102:0/902502109 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49f9293700 1 --2- 172.21.15.102:0/902502109 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f49f406f2f0 0x7f49f40c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49f9a94700 1 --2- 172.21.15.102:0/902502109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49f4156220 0x7f49f414c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49f8a92700 1 -- 172.21.15.102:0/902502109 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f49f406f2f0 msgr2=0x7f49f40c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49f8a92700 1 --2- 172.21.15.102:0/902502109 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f49f406f2f0 0x7f49f40c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49f8a92700 1 -- 172.21.15.102:0/902502109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49f4156220 msgr2=0x7f49f414c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49f8a92700 1 --2- 172.21.15.102:0/902502109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49f4156220 0x7f49f414c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49f8a92700 1 -- 172.21.15.102:0/902502109 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e40094f0 con 0x7f49f4155e50 2024-08-17T02:25:59.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49f8a92700 1 --2- 172.21.15.102:0/902502109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49f4155e50 0x7f49f40987d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f49f000c8e0 tx=0x7f49f0001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49e97fa700 1 -- 172.21.15.102:0/902502109 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f0012630 con 0x7f49f4155e50 2024-08-17T02:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49e97fa700 1 -- 172.21.15.102:0/902502109 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f0012790 con 0x7f49f4155e50 2024-08-17T02:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49fb4f7700 1 -- 172.21.15.102:0/902502109 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f40c9880 con 0x7f49f4155e50 2024-08-17T02:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49e97fa700 1 -- 172.21.15.102:0/902502109 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f0012b50 con 0x7f49f4155e50 2024-08-17T02:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49fb4f7700 1 -- 172.21.15.102:0/902502109 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f40c8e90 con 0x7f49f4155e50 2024-08-17T02:25:59.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.141+0000 7f49fb4f7700 1 -- 172.21.15.102:0/902502109 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f4168600 con 0x7f49f4155e50 2024-08-17T02:25:59.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.145+0000 7f49e97fa700 1 -- 172.21.15.102:0/902502109 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f49f0003030 con 0x7f49f4155e50 2024-08-17T02:25:59.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.145+0000 7f49e97fa700 1 --2- 172.21.15.102:0/902502109 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f49e0060890 0x7f49e0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.145+0000 7f49e97fa700 1 -- 172.21.15.102:0/902502109 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f49f007cb10 con 0x7f49f4155e50 2024-08-17T02:25:59.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.145+0000 7f49f9293700 1 --2- 172.21.15.102:0/902502109 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f49e0060890 0x7f49e0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.145+0000 7f49f9293700 1 --2- 172.21.15.102:0/902502109 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f49e0060890 0x7f49e0062d40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f49e40099b0 tx=0x7f49e4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:59.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.153+0000 7f49e97fa700 1 -- 172.21.15.102:0/902502109 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f49f4168600 con 0x7f49f4155e50 2024-08-17T02:25:59.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.313+0000 7f49fb4f7700 1 -- 172.21.15.102:0/902502109 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f49f40645c0 con 0x7f49e0060890 2024-08-17T02:25:59.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.329+0000 7f49e97fa700 1 -- 172.21.15.102:0/902502109 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252294 (secure 0 0 0) 0x7f49f40645c0 con 0x7f49e0060890 2024-08-17T02:25:59.335 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:59.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.333+0000 7f49fb4f7700 1 -- 172.21.15.102:0/902502109 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f49e0060890 msgr2=0x7f49e0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.333+0000 7f49fb4f7700 1 --2- 172.21.15.102:0/902502109 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f49e0060890 0x7f49e0062d40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f49e40099b0 tx=0x7f49e4017000 comp rx=0 tx=0).stop 2024-08-17T02:25:59.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.333+0000 7f49fb4f7700 1 -- 172.21.15.102:0/902502109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49f4155e50 msgr2=0x7f49f40987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.333+0000 7f49fb4f7700 1 --2- 172.21.15.102:0/902502109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49f4155e50 0x7f49f40987d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f49f000c8e0 tx=0x7f49f0001690 comp rx=0 tx=0).stop 2024-08-17T02:25:59.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.333+0000 7f49fb4f7700 1 -- 172.21.15.102:0/902502109 shutdown_connections 2024-08-17T02:25:59.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.333+0000 7f49fb4f7700 1 --2- 172.21.15.102:0/902502109 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f49e0060890 0x7f49e0062d40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.333+0000 7f49fb4f7700 1 --2- 172.21.15.102:0/902502109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49f4155e50 0x7f49f40987d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.333+0000 7f49fb4f7700 1 --2- 172.21.15.102:0/902502109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49f4156220 0x7f49f414c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.333+0000 7f49fb4f7700 1 --2- 172.21.15.102:0/902502109 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f49f406f2f0 0x7f49f40c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.333+0000 7f49fb4f7700 1 -- 172.21.15.102:0/902502109 >> 172.21.15.102:0/902502109 conn(0x7f49f4066e00 msgr2=0x7f49f4151c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:59.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.333+0000 7f49fb4f7700 1 -- 172.21.15.102:0/902502109 shutdown_connections 2024-08-17T02:25:59.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.333+0000 7f49fb4f7700 1 -- 172.21.15.102:0/902502109 wait complete. 2024-08-17T02:25:59.338 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-08-17T02:25:59.350 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-08-17T02:25:59.177106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381884,"kb_used_data":2416,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592836,"statfs":{"total":773094113280,"available":770655064064,"internally_reserved":0,"allocated":2473984,"data_stored":1560014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.200113"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.981516+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990002+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.981280+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:39:25.522474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.993578+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:13.181529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.991656+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:40.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.994693+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:25.928936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.989063+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:39.955144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.989977+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984464+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.994797+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:23.175809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990239+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:14.842533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.999710+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990990+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:30.053768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.999744+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984989+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:30.053768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.999737+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-08-17T02:25:53.328162+0000","last_change":"2024-08-17T02:25:51.241912+0000","last_active":"2024-08-17T02:25:53.328162+0000","last_peered":"2024-08-17T02:25:53.328162+0000","last_clean":"2024-08-17T02:25:53.328162+0000","last_became_active":"2024-08-17T02:25:51.239655+0000","last_became_peered":"2024-08-17T02:25:51.239655+0000","last_unstale":"2024-08-17T02:25:53.328162+0000","last_undegraded":"2024-08-17T02:25:53.328162+0000","last_fullsized":"2024-08-17T02:25:53.328162+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_clean_scrub_stamp":"2024-08-17T02:25:49.863184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:53.845381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.992540+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:30.053768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.989225+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:40.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.999739+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:14.842533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.993400+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:33:55.304496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.985596+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:23.175809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.982716+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:26.856354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.985012+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:13.181529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990758+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990023+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:01.595885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.985206+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:25.928936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984988+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:33:55.304496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.983092+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:00.101762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990838+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984238+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:20.748382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.981534+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984840+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":745472,"data_stored":633623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":126976,"data_stored":32003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":14,"seq":60129542146,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297516,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":163840,"data_stored":48670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.109}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.615}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5189999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297516,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":163840,"data_stored":48670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]}]},{"osd":0,"up_from":14,"seq":60129542146,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298704,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073136,"statfs":{"total":96636764160,"available":96330891264,"internally_reserved":0,"allocated":745472,"data_stored":633623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9350000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:59.355 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:59.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.461+0000 7f09b7fff700 1 Processor -- start 2024-08-17T02:25:59.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.461+0000 7f09b7fff700 1 -- start start 2024-08-17T02:25:59.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.461+0000 7f09b7fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f09b80cd1b0 0x7f09b81536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.461+0000 7f09b7fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f09b815a190 0x7f09b815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.461+0000 7f09b7fff700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b815a610 con 0x7f09b8153320 2024-08-17T02:25:59.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.461+0000 7f09b7fff700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b80ce430 con 0x7f09b80cd1b0 2024-08-17T02:25:59.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.461+0000 7f09b7fff700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b815dbd0 con 0x7f09b815a190 2024-08-17T02:25:59.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.461+0000 7f09b67fc700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f09b80cd1b0 0x7f09b81536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.461+0000 7f09b67fc700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f09b80cd1b0 0x7f09b81536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48040/0 (socket says 172.21.15.102:48040) 2024-08-17T02:25:59.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.461+0000 7f09b67fc700 1 -- 172.21.15.102:0/1849612617 learned_addr learned my addr 172.21.15.102:0/1849612617 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:59.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.461+0000 7f09b77fe700 1 --2- 172.21.15.102:0/1849612617 >> v2:172.21.15.121:3300/0 conn(0x7f09b815a190 0x7f09b815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.461+0000 7f09b67fc700 1 -- 172.21.15.102:0/1849612617 >> v2:172.21.15.121:3300/0 conn(0x7f09b815a190 msgr2=0x7f09b815cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:59.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.461+0000 7f09b67fc700 1 --2- 172.21.15.102:0/1849612617 >> v2:172.21.15.121:3300/0 conn(0x7f09b815a190 0x7f09b815cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.461+0000 7f09b67fc700 1 -- 172.21.15.102:0/1849612617 >> v1:172.21.15.121:6789/0 conn(0x7f09b8153320 legacy=0x7f09b80ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.461+0000 7f09b67fc700 1 -- 172.21.15.102:0/1849612617 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b815d370 con 0x7f09b80cd1b0 2024-08-17T02:25:59.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.461+0000 7f09b67fc700 1 --2- 172.21.15.102:0/1849612617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09b80cd1b0 0x7f09b81536f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f09a80099b0 tx=0x7f09a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcc744cb09e1c10 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:59.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.465+0000 7f09b5ffb700 1 -- 172.21.15.102:0/1849612617 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a8009ea0 con 0x7f09b80cd1b0 2024-08-17T02:25:59.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.465+0000 7f09b5ffb700 1 -- 172.21.15.102:0/1849612617 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a800b820 con 0x7f09b80cd1b0 2024-08-17T02:25:59.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.465+0000 7f09b5ffb700 1 -- 172.21.15.102:0/1849612617 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a800bbc0 con 0x7f09b80cd1b0 2024-08-17T02:25:59.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.465+0000 7f09b7fff700 1 -- 172.21.15.102:0/1849612617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09b80cd1b0 msgr2=0x7f09b81536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.465+0000 7f09b7fff700 1 --2- 172.21.15.102:0/1849612617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09b80cd1b0 0x7f09b81536f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f09a80099b0 tx=0x7f09a8009250 comp rx=0 tx=0).stop 2024-08-17T02:25:59.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.465+0000 7f09b7fff700 1 -- 172.21.15.102:0/1849612617 shutdown_connections 2024-08-17T02:25:59.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.465+0000 7f09b7fff700 1 --2- 172.21.15.102:0/1849612617 >> v2:172.21.15.121:3300/0 conn(0x7f09b815a190 0x7f09b815cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.465+0000 7f09b7fff700 1 --2- 172.21.15.102:0/1849612617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09b80cd1b0 0x7f09b81536f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.465+0000 7f09b7fff700 1 -- 172.21.15.102:0/1849612617 >> 172.21.15.102:0/1849612617 conn(0x7f09b80d00a0 msgr2=0x7f09b80d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:59.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.465+0000 7f09b7fff700 1 -- 172.21.15.102:0/1849612617 shutdown_connections 2024-08-17T02:25:59.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.465+0000 7f09b7fff700 1 -- 172.21.15.102:0/1849612617 wait complete. 2024-08-17T02:25:59.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.465+0000 7f09b7fff700 1 Processor -- start 2024-08-17T02:25:59.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.465+0000 7f09b7fff700 1 -- start start 2024-08-17T02:25:59.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b7fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09b80cd1b0 0x7f09b80b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b7fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09b8153320 0x7f09b8150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b7fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09b815a190 0x7f09b80c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b7fff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b80c7b10 con 0x7f09b815a190 2024-08-17T02:25:59.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b7fff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b815eb20 con 0x7f09b80cd1b0 2024-08-17T02:25:59.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b7fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b80b12a0 con 0x7f09b8153320 2024-08-17T02:25:59.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b77fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09b815a190 0x7f09b80c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b77fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09b815a190 0x7f09b80c75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48044/0 (socket says 172.21.15.102:48044) 2024-08-17T02:25:59.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b77fe700 1 -- 172.21.15.102:0/2346394429 learned_addr learned my addr 172.21.15.102:0/2346394429 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:59.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b6ffd700 1 --2- 172.21.15.102:0/2346394429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09b80cd1b0 0x7f09b80b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b67fc700 1 --2- 172.21.15.102:0/2346394429 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09b8153320 0x7f09b8150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b77fe700 1 -- 172.21.15.102:0/2346394429 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09b8153320 msgr2=0x7f09b8150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b77fe700 1 --2- 172.21.15.102:0/2346394429 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09b8153320 0x7f09b8150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b77fe700 1 -- 172.21.15.102:0/2346394429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09b80cd1b0 msgr2=0x7f09b80b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b77fe700 1 --2- 172.21.15.102:0/2346394429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09b80cd1b0 0x7f09b80b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b77fe700 1 -- 172.21.15.102:0/2346394429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a80094f0 con 0x7f09b815a190 2024-08-17T02:25:59.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b67fc700 1 --2- 172.21.15.102:0/2346394429 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09b8153320 0x7f09b8150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:59.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b77fe700 1 --2- 172.21.15.102:0/2346394429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09b815a190 0x7f09b80c75d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009df0 tx=0x7f09b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:59.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f099effd700 1 -- 172.21.15.102:0/2346394429 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b000cb50 con 0x7f09b815a190 2024-08-17T02:25:59.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b7fff700 1 -- 172.21.15.102:0/2346394429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b815e4d0 con 0x7f09b815a190 2024-08-17T02:25:59.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f099effd700 1 -- 172.21.15.102:0/2346394429 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b000f040 con 0x7f09b815a190 2024-08-17T02:25:59.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f099effd700 1 -- 172.21.15.102:0/2346394429 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0014480 con 0x7f09b815a190 2024-08-17T02:25:59.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b7fff700 1 -- 172.21.15.102:0/2346394429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b80b39e0 con 0x7f09b815a190 2024-08-17T02:25:59.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.469+0000 7f09b7fff700 1 -- 172.21.15.102:0/2346394429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b815ec90 con 0x7f09b815a190 2024-08-17T02:25:59.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.473+0000 7f099effd700 1 -- 172.21.15.102:0/2346394429 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f09b00147f0 con 0x7f09b815a190 2024-08-17T02:25:59.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.473+0000 7f099effd700 1 --2- 172.21.15.102:0/2346394429 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f09a4060890 0x7f09a4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.473+0000 7f099effd700 1 -- 172.21.15.102:0/2346394429 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f09b007d4c0 con 0x7f09b815a190 2024-08-17T02:25:59.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.473+0000 7f09b6ffd700 1 --2- 172.21.15.102:0/2346394429 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f09a4060890 0x7f09a4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.473+0000 7f09b6ffd700 1 --2- 172.21.15.102:0/2346394429 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f09a4060890 0x7f09a4062d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f09ac003a80 tx=0x7f09ac007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:59.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.481+0000 7f099effd700 1 -- 172.21.15.102:0/2346394429 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f09b004d910 con 0x7f09b815a190 2024-08-17T02:25:59.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.641+0000 7f09b7fff700 1 -- 172.21.15.102:0/2346394429 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09b815e350 con 0x7f09a4060890 2024-08-17T02:25:59.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.653+0000 7f099effd700 1 -- 172.21.15.102:0/2346394429 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252294 (secure 0 0 0) 0x7f09ac002480 con 0x7f09a4060890 2024-08-17T02:25:59.658 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:25:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.657+0000 7f09b7fff700 1 -- 172.21.15.102:0/2346394429 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f09a4060890 msgr2=0x7f09a4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.657+0000 7f09b7fff700 1 --2- 172.21.15.102:0/2346394429 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f09a4060890 0x7f09a4062d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f09ac003a80 tx=0x7f09ac007ec0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.657+0000 7f09b7fff700 1 -- 172.21.15.102:0/2346394429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09b815a190 msgr2=0x7f09b80c75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.657+0000 7f09b7fff700 1 --2- 172.21.15.102:0/2346394429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09b815a190 0x7f09b80c75d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009df0 tx=0x7f09b000b040 comp rx=0 tx=0).stop 2024-08-17T02:25:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.657+0000 7f09b7fff700 1 -- 172.21.15.102:0/2346394429 shutdown_connections 2024-08-17T02:25:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.657+0000 7f09b7fff700 1 --2- 172.21.15.102:0/2346394429 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f09a4060890 0x7f09a4062d40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.657+0000 7f09b7fff700 1 --2- 172.21.15.102:0/2346394429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09b815a190 0x7f09b80c75d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.657+0000 7f09b7fff700 1 --2- 172.21.15.102:0/2346394429 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09b8153320 0x7f09b8150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.657+0000 7f09b7fff700 1 --2- 172.21.15.102:0/2346394429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09b80cd1b0 0x7f09b80b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.657+0000 7f09b7fff700 1 -- 172.21.15.102:0/2346394429 >> 172.21.15.102:0/2346394429 conn(0x7f09b80d00a0 msgr2=0x7f09b815acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:59.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.657+0000 7f09b7fff700 1 -- 172.21.15.102:0/2346394429 shutdown_connections 2024-08-17T02:25:59.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.657+0000 7f09b7fff700 1 -- 172.21.15.102:0/2346394429 wait complete. 2024-08-17T02:25:59.661 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-08-17T02:25:59.672 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-08-17T02:25:59.177106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381884,"kb_used_data":2416,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592836,"statfs":{"total":773094113280,"available":770655064064,"internally_reserved":0,"allocated":2473984,"data_stored":1560014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.200113"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.981516+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990002+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.981280+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:39:25.522474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.993578+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:13.181529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.991656+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:40.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.994693+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:25.928936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.989063+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:39.955144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.989977+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984464+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.994797+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:23.175809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990239+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:14.842533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.999710+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990990+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:30.053768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.999744+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984989+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:30.053768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.999737+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-08-17T02:25:53.328162+0000","last_change":"2024-08-17T02:25:51.241912+0000","last_active":"2024-08-17T02:25:53.328162+0000","last_peered":"2024-08-17T02:25:53.328162+0000","last_clean":"2024-08-17T02:25:53.328162+0000","last_became_active":"2024-08-17T02:25:51.239655+0000","last_became_peered":"2024-08-17T02:25:51.239655+0000","last_unstale":"2024-08-17T02:25:53.328162+0000","last_undegraded":"2024-08-17T02:25:53.328162+0000","last_fullsized":"2024-08-17T02:25:53.328162+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_clean_scrub_stamp":"2024-08-17T02:25:49.863184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:53.845381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.992540+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:30.053768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.989225+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:40.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.999739+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:14.842533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.993400+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:33:55.304496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.985596+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:23.175809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.982716+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:26.856354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.985012+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:13.181529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990758+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990023+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:01.595885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.985206+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:25.928936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984988+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:33:55.304496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.983092+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:00.101762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990838+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984238+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:20.748382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.981534+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984840+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":745472,"data_stored":633623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":126976,"data_stored":32003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":14,"seq":60129542146,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297516,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":163840,"data_stored":48670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.109}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.615}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5189999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297516,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":163840,"data_stored":48670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]}]},{"osd":0,"up_from":14,"seq":60129542146,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298704,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073136,"statfs":{"total":96636764160,"available":96330891264,"internally_reserved":0,"allocated":745472,"data_stored":633623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9350000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:59.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2024-08-17T02:25:59.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2024-08-17T02:25:59.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-08-17T02:25:59.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2024-08-17T02:25:59.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2024-08-17T02:25:59.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-08-17T02:25:59.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2024-08-17T02:25:59.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-08-17T02:25:59.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2024-08-17T02:25:59.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-08-17T02:25:59.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2024-08-17T02:25:59.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-08-17T02:25:59.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-08-17T02:25:59.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-08-17T02:25:59.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-08-17T02:25:59.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2024-08-17T02:25:59.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2024-08-17T02:25:59.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2024-08-17T02:25:59.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2024-08-17T02:25:59.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2024-08-17T02:25:59.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-08-17T02:25:59.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2024-08-17T02:25:59.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-08-17T02:25:59.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2024-08-17T02:25:59.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-08-17T02:25:59.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2024-08-17T02:25:59.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2024-08-17T02:25:59.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-08-17T02:25:59.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-08-17T02:25:59.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2024-08-17T02:25:59.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2024-08-17T02:25:59.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2024-08-17T02:25:59.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-08-17T02:25:59.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2024-08-17T02:25:59.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.981516+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:25:59.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-08-17T02:25:59.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2024-08-17T02:25:59.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.990002+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-17T02:25:59.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2024-08-17T02:25:59.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.981280+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T06:39:25.522474+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:25:59.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-08-17T02:25:59.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2024-08-17T02:25:59.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.993578+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T06:09:13.181529+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:25:59.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-08-17T02:25:59.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2024-08-17T02:25:59.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.991656+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T05:09:40.548099+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-17T02:25:59.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-08-17T02:25:59.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2024-08-17T02:25:59.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.994693+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:00:25.928936+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:25:59.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-08-17T02:25:59.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2024-08-17T02:25:59.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.989063+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T06:17:39.955144+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-17T02:25:59.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-08-17T02:25:59.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2024-08-17T02:25:59.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.989977+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-17T02:25:59.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-08-17T02:25:59.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2024-08-17T02:25:59.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.984464+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-17T02:25:59.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-08-17T02:25:59.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2024-08-17T02:25:59.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.994797+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T14:09:23.175809+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:25:59.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-08-17T02:25:59.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2024-08-17T02:25:59.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.990239+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T02:51:14.842533+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-17T02:25:59.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-08-17T02:25:59.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2024-08-17T02:25:59.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.999710+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-17T02:25:59.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-08-17T02:25:59.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2024-08-17T02:25:59.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.990990+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T08:39:30.053768+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-17T02:25:59.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-08-17T02:25:59.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2024-08-17T02:25:59.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.999744+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-17T02:25:59.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-08-17T02:25:59.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2024-08-17T02:25:59.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.984989+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T08:39:30.053768+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-17T02:25:59.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-08-17T02:25:59.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2024-08-17T02:25:59.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.999737+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-17T02:25:59.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-08-17T02:25:59.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2024-08-17T02:25:59.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.992540+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T08:39:30.053768+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:25:59.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-08-17T02:25:59.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2024-08-17T02:25:59.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.989225+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T05:09:40.548099+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-17T02:25:59.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-08-17T02:25:59.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2024-08-17T02:25:59.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.999739+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T02:51:14.842533+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-17T02:25:59.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-08-17T02:25:59.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2024-08-17T02:25:59.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.993400+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T09:33:55.304496+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:25:59.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-08-17T02:25:59.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2024-08-17T02:25:59.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.985596+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T14:09:23.175809+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-17T02:25:59.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-08-17T02:25:59.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2024-08-17T02:25:59.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.982716+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T04:03:26.856354+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-17T02:25:59.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-08-17T02:25:59.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2024-08-17T02:25:59.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.985012+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T06:09:13.181529+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-17T02:25:59.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-08-17T02:25:59.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2024-08-17T02:25:59.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.990758+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-17T02:25:59.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-08-17T02:25:59.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2024-08-17T02:25:59.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.990023+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T12:09:01.595885+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-17T02:25:59.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-08-17T02:25:59.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2024-08-17T02:25:59.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.985206+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:00:25.928936+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-17T02:25:59.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-08-17T02:25:59.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2024-08-17T02:25:59.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.984988+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T09:33:55.304496+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-17T02:25:59.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-08-17T02:25:59.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2024-08-17T02:25:59.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.983092+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T10:00:00.101762+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-17T02:25:59.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-08-17T02:25:59.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-08-17T02:25:59.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2024-08-17T02:25:59.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.990838+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-17T02:25:59.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-08-17T02:25:59.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2024-08-17T02:25:59.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.984238+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T04:14:20.748382+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-17T02:25:59.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-08-17T02:25:59.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2024-08-17T02:25:59.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.981534+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:25:59.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-08-17T02:25:59.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:25:54.970742+0000', 'last_change': '2024-08-17T02:25:54.970742+0000', 'last_active': '2024-08-17T02:25:54.970742+0000', 'last_peered': '2024-08-17T02:25:54.970742+0000', 'last_clean': '2024-08-17T02:25:54.970742+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:54.970742+0000', 'last_undegraded': '2024-08-17T02:25:54.970742+0000', 'last_fullsized': '2024-08-17T02:25:54.970742+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:54.970742+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:25:59.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2024-08-17T02:25:59.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:53.961121+0000', 'last_change': '2024-08-17T02:25:53.984840+0000', 'last_active': '2024-08-17T02:25:53.961121+0000', 'last_peered': '2024-08-17T02:25:53.961121+0000', 'last_clean': '2024-08-17T02:25:53.961121+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:53.961121+0000', 'last_undegraded': '2024-08-17T02:25:53.961121+0000', 'last_fullsized': '2024-08-17T02:25:53.961121+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:53.961121+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-17T02:25:59.694 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-17T02:25:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36f198b700 1 Processor -- start 2024-08-17T02:25:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36f198b700 1 -- start start 2024-08-17T02:25:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36f198b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f36ec0b26d0 0x7f36ec0caf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36f198b700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36ec0ccd30 0x7f36ec0ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36f198b700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ec0cef30 con 0x7f36ec0ceb00 2024-08-17T02:25:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36f198b700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ec0cb8d0 con 0x7f36ec0b26d0 2024-08-17T02:25:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36f198b700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0cbbb0 con 0x7f36ec0ccd30 2024-08-17T02:25:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36eaffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f36ec0b26d0 0x7f36ec0caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36eaffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f36ec0b26d0 0x7f36ec0caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:52438/0 (socket says 172.21.15.102:52438) 2024-08-17T02:25:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36eb7fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f36ec0ceb00 0x7f36ec15cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:47600/0 (socket says 172.21.15.102:47600) 2024-08-17T02:25:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36eaffd700 1 -- 172.21.15.102:0/3058822241 learned_addr learned my addr 172.21.15.102:0/3058822241 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36e3fff700 1 --2- 172.21.15.102:0/3058822241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36ec0ccd30 0x7f36ec0ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36eaffd700 1 -- 172.21.15.102:0/3058822241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36ec0ccd30 msgr2=0x7f36ec0ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36eaffd700 1 --2- 172.21.15.102:0/3058822241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36ec0ccd30 0x7f36ec0ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36eaffd700 1 -- 172.21.15.102:0/3058822241 >> v1:172.21.15.121:6789/0 conn(0x7f36ec0ceb00 legacy=0x7f36ec15cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36eaffd700 1 -- 172.21.15.102:0/3058822241 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec0cbe90 con 0x7f36ec0b26d0 2024-08-17T02:25:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36eaffd700 1 --2- 172.21.15.102:0/3058822241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36ec0b26d0 0x7f36ec0caf60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0099b0 tx=0x7f36dc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d319ddbf41fe740 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36ea7fc700 1 -- 172.21.15.102:0/3058822241 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc009ea0 con 0x7f36ec0b26d0 2024-08-17T02:25:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36ea7fc700 1 -- 172.21.15.102:0/3058822241 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc00b8f0 con 0x7f36ec0b26d0 2024-08-17T02:25:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36ea7fc700 1 -- 172.21.15.102:0/3058822241 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc00bc90 con 0x7f36ec0b26d0 2024-08-17T02:25:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36f198b700 1 -- 172.21.15.102:0/3058822241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36ec0b26d0 msgr2=0x7f36ec0caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.797+0000 7f36f198b700 1 --2- 172.21.15.102:0/3058822241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36ec0b26d0 0x7f36ec0caf60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0099b0 tx=0x7f36dc009250 comp rx=0 tx=0).stop 2024-08-17T02:25:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36f198b700 1 -- 172.21.15.102:0/3058822241 shutdown_connections 2024-08-17T02:25:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36f198b700 1 --2- 172.21.15.102:0/3058822241 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36ec0ccd30 0x7f36ec0ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36f198b700 1 --2- 172.21.15.102:0/3058822241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36ec0b26d0 0x7f36ec0caf60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36f198b700 1 -- 172.21.15.102:0/3058822241 >> 172.21.15.102:0/3058822241 conn(0x7f36ec0994f0 msgr2=0x7f36ec067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36f198b700 1 -- 172.21.15.102:0/3058822241 shutdown_connections 2024-08-17T02:25:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36f198b700 1 -- 172.21.15.102:0/3058822241 wait complete. 2024-08-17T02:25:59.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36f198b700 1 Processor -- start 2024-08-17T02:25:59.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36f198b700 1 -- start start 2024-08-17T02:25:59.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36f198b700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36ec0b26d0 0x7f36ec156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36f198b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36ec0ccd30 0x7f36ec0c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36f198b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36ec0ceb00 0x7f36ec0b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36f198b700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0b42a0 con 0x7f36ec0ccd30 2024-08-17T02:25:59.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36f198b700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0b4580 con 0x7f36ec0ceb00 2024-08-17T02:25:59.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36f198b700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0b4860 con 0x7f36ec0b26d0 2024-08-17T02:25:59.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36e3fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36ec0ccd30 0x7f36ec0c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36e3fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36ec0ccd30 0x7f36ec0c7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48054/0 (socket says 172.21.15.102:48054) 2024-08-17T02:25:59.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36e3fff700 1 -- 172.21.15.102:0/793847547 learned_addr learned my addr 172.21.15.102:0/793847547 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:25:59.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36eb7fe700 1 --2- 172.21.15.102:0/793847547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36ec0ceb00 0x7f36ec0b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36eaffd700 1 --2- 172.21.15.102:0/793847547 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36ec0b26d0 0x7f36ec156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36e3fff700 1 -- 172.21.15.102:0/793847547 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36ec0b26d0 msgr2=0x7f36ec156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36e3fff700 1 --2- 172.21.15.102:0/793847547 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36ec0b26d0 0x7f36ec156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36e3fff700 1 -- 172.21.15.102:0/793847547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36ec0ceb00 msgr2=0x7f36ec0b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36e3fff700 1 --2- 172.21.15.102:0/793847547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36ec0ceb00 0x7f36ec0b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36e3fff700 1 -- 172.21.15.102:0/793847547 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36dc0094f0 con 0x7f36ec0ccd30 2024-08-17T02:25:59.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.801+0000 7f36e3fff700 1 --2- 172.21.15.102:0/793847547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36ec0ccd30 0x7f36ec0c7330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f36d400ec80 tx=0x7f36d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:59.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.805+0000 7f36e2ffd700 1 -- 172.21.15.102:0/793847547 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d400c850 con 0x7f36ec0ccd30 2024-08-17T02:25:59.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.805+0000 7f36f198b700 1 -- 172.21.15.102:0/793847547 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ec0b4b40 con 0x7f36ec0ccd30 2024-08-17T02:25:59.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.805+0000 7f36e2ffd700 1 -- 172.21.15.102:0/793847547 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d400c9b0 con 0x7f36ec0ccd30 2024-08-17T02:25:59.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.805+0000 7f36e2ffd700 1 -- 172.21.15.102:0/793847547 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d400cd50 con 0x7f36ec0ccd30 2024-08-17T02:25:59.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.805+0000 7f36f198b700 1 -- 172.21.15.102:0/793847547 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ec156740 con 0x7f36ec0ccd30 2024-08-17T02:25:59.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.805+0000 7f36e2ffd700 1 -- 172.21.15.102:0/793847547 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f36d4013680 con 0x7f36ec0ccd30 2024-08-17T02:25:59.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.805+0000 7f36f198b700 1 -- 172.21.15.102:0/793847547 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ec0645c0 con 0x7f36ec0ccd30 2024-08-17T02:25:59.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.805+0000 7f36e2ffd700 1 --2- 172.21.15.102:0/793847547 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f36cc060860 0x7f36cc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.805+0000 7f36e2ffd700 1 -- 172.21.15.102:0/793847547 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f36d407ce70 con 0x7f36ec0ccd30 2024-08-17T02:25:59.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.805+0000 7f36eaffd700 1 --2- 172.21.15.102:0/793847547 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f36cc060860 0x7f36cc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.805+0000 7f36eaffd700 1 --2- 172.21.15.102:0/793847547 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f36cc060860 0x7f36cc062d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0099b0 tx=0x7f36dc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:59.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:25:59.813+0000 7f36e2ffd700 1 -- 172.21.15.102:0/793847547 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f36d404d2c0 con 0x7f36ec0ccd30 2024-08-17T02:26:00.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.033+0000 7f36f198b700 1 -- 172.21.15.102:0/793847547 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f36ec0cb1c0 con 0x7f36ec0ccd30 2024-08-17T02:26:00.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.037+0000 7f36e2ffd700 1 -- 172.21.15.102:0/793847547 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1109 (secure 0 0 0) 0x7f36d40508e0 con 0x7f36ec0ccd30 2024-08-17T02:26:00.038 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:00.038 INFO:teuthology.orchestra.run.smithi102.stdout:{"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":21,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1723861548,"num_in_osds":8,"osd_in_since":1723861540,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2439049216,"bytes_avail":770655064064,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4282}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-08-17T02:25:38.802583+0000","services":{}},"progress_events":{}} 2024-08-17T02:26:00.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.037+0000 7f36f198b700 1 -- 172.21.15.102:0/793847547 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f36cc060860 msgr2=0x7f36cc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.037+0000 7f36f198b700 1 --2- 172.21.15.102:0/793847547 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f36cc060860 0x7f36cc062d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0099b0 tx=0x7f36dc017000 comp rx=0 tx=0).stop 2024-08-17T02:26:00.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.037+0000 7f36f198b700 1 -- 172.21.15.102:0/793847547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36ec0ccd30 msgr2=0x7f36ec0c7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.037+0000 7f36f198b700 1 --2- 172.21.15.102:0/793847547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36ec0ccd30 0x7f36ec0c7330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f36d400ec80 tx=0x7f36d40091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.037+0000 7f36f198b700 1 -- 172.21.15.102:0/793847547 shutdown_connections 2024-08-17T02:26:00.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.037+0000 7f36f198b700 1 --2- 172.21.15.102:0/793847547 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f36cc060860 0x7f36cc062d10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.037+0000 7f36f198b700 1 --2- 172.21.15.102:0/793847547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36ec0ccd30 0x7f36ec0c7330 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.037+0000 7f36f198b700 1 --2- 172.21.15.102:0/793847547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36ec0ceb00 0x7f36ec0b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.037+0000 7f36f198b700 1 --2- 172.21.15.102:0/793847547 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36ec0b26d0 0x7f36ec156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.037+0000 7f36f198b700 1 -- 172.21.15.102:0/793847547 >> 172.21.15.102:0/793847547 conn(0x7f36ec0994f0 msgr2=0x7f36ec158880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:00.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.037+0000 7f36f198b700 1 -- 172.21.15.102:0/793847547 shutdown_connections 2024-08-17T02:26:00.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.037+0000 7f36f198b700 1 -- 172.21.15.102:0/793847547 wait complete. 2024-08-17T02:26:00.055 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-08-17T02:26:00.056 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:00.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f077d47b700 1 Processor -- start 2024-08-17T02:26:00.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f077d47b700 1 -- start start 2024-08-17T02:26:00.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f077d47b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0778157060 0x7f077806e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f077d47b700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0778068db0 0x7f0778160c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f077d47b700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07780c36f0 con 0x7f077806a310 2024-08-17T02:26:00.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f077d47b700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07780caec0 con 0x7f0778157060 2024-08-17T02:26:00.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f077d47b700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780ca2b0 con 0x7f0778068db0 2024-08-17T02:26:00.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f0776ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0778157060 0x7f077806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f076e7fc700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f077806a310 0x7f07780686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:47608/0 (socket says 172.21.15.102:47608) 2024-08-17T02:26:00.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f076e7fc700 1 -- 172.21.15.102:0/2968040910 learned_addr learned my addr 172.21.15.102:0/2968040910 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:00.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f07777fe700 1 --2- 172.21.15.102:0/2968040910 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0778068db0 0x7f0778160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f0776ffd700 1 -- 172.21.15.102:0/2968040910 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0778068db0 msgr2=0x7f0778160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:00.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f0776ffd700 1 --2- 172.21.15.102:0/2968040910 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0778068db0 0x7f0778160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f0776ffd700 1 -- 172.21.15.102:0/2968040910 >> v1:172.21.15.121:6789/0 conn(0x7f077806a310 legacy=0x7f07780686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f07767fc700 1 -- 172.21.15.102:0/2968040910 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172298916 0 0) 0x7f07780c36f0 con 0x7f077806a310 2024-08-17T02:26:00.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f0776ffd700 1 -- 172.21.15.102:0/2968040910 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07780ca590 con 0x7f0778157060 2024-08-17T02:26:00.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f07777fe700 1 --2- 172.21.15.102:0/2968040910 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0778068db0 0x7f0778160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:00.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f0776ffd700 1 --2- 172.21.15.102:0/2968040910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0778157060 0x7f077806e130 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f07680098e0 tx=0x7f07680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ee6efff1b92864d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f07767fc700 1 -- 172.21.15.102:0/2968040910 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076800b640 con 0x7f0778157060 2024-08-17T02:26:00.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f07767fc700 1 -- 172.21.15.102:0/2968040910 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076800b7a0 con 0x7f0778157060 2024-08-17T02:26:00.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f07767fc700 1 -- 172.21.15.102:0/2968040910 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076800bb40 con 0x7f0778157060 2024-08-17T02:26:00.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f077d47b700 1 -- 172.21.15.102:0/2968040910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0778157060 msgr2=0x7f077806e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f077d47b700 1 --2- 172.21.15.102:0/2968040910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0778157060 0x7f077806e130 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f07680098e0 tx=0x7f07680091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f077d47b700 1 -- 172.21.15.102:0/2968040910 shutdown_connections 2024-08-17T02:26:00.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f077d47b700 1 --2- 172.21.15.102:0/2968040910 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0778068db0 0x7f0778160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f077d47b700 1 --2- 172.21.15.102:0/2968040910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0778157060 0x7f077806e130 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f077d47b700 1 -- 172.21.15.102:0/2968040910 >> 172.21.15.102:0/2968040910 conn(0x7f07780c9c20 msgr2=0x7f077806d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:00.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f077d47b700 1 -- 172.21.15.102:0/2968040910 shutdown_connections 2024-08-17T02:26:00.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.153+0000 7f077d47b700 1 -- 172.21.15.102:0/2968040910 wait complete. 2024-08-17T02:26:00.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f077d47b700 1 Processor -- start 2024-08-17T02:26:00.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f077d47b700 1 -- start start 2024-08-17T02:26:00.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f077d47b700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0778068db0 0x7f07780c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f077d47b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f077806a310 0x7f07780c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f077d47b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0778157060 0x7f07780c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f077d47b700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07780c8650 con 0x7f0778157060 2024-08-17T02:26:00.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f077d47b700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07780b2460 con 0x7f077806a310 2024-08-17T02:26:00.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f077d47b700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780af890 con 0x7f0778068db0 2024-08-17T02:26:00.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f07777fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0778157060 0x7f07780c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f07777fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0778157060 0x7f07780c7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48058/0 (socket says 172.21.15.102:48058) 2024-08-17T02:26:00.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f07777fe700 1 -- 172.21.15.102:0/1668446776 learned_addr learned my addr 172.21.15.102:0/1668446776 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:00.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f0776ffd700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0778068db0 0x7f07780c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f076e7fc700 1 --2- 172.21.15.102:0/1668446776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f077806a310 0x7f07780c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f07777fe700 1 -- 172.21.15.102:0/1668446776 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0778068db0 msgr2=0x7f07780c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f07777fe700 1 --2- 172.21.15.102:0/1668446776 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0778068db0 0x7f07780c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f07777fe700 1 -- 172.21.15.102:0/1668446776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f077806a310 msgr2=0x7f07780c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f07777fe700 1 --2- 172.21.15.102:0/1668446776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f077806a310 0x7f07780c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f07777fe700 1 -- 172.21.15.102:0/1668446776 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0770009a20 con 0x7f0778157060 2024-08-17T02:26:00.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f07777fe700 1 --2- 172.21.15.102:0/1668446776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0778157060 0x7f07780c7930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f077000ef90 tx=0x7f077000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f076f7fe700 1 -- 172.21.15.102:0/1668446776 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077000cbd0 con 0x7f0778157060 2024-08-17T02:26:00.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.157+0000 7f076f7fe700 1 -- 172.21.15.102:0/1668446776 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077000f040 con 0x7f0778157060 2024-08-17T02:26:00.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.161+0000 7f077d47b700 1 -- 172.21.15.102:0/1668446776 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0768009420 con 0x7f0778157060 2024-08-17T02:26:00.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.161+0000 7f076f7fe700 1 -- 172.21.15.102:0/1668446776 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770014480 con 0x7f0778157060 2024-08-17T02:26:00.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.161+0000 7f077d47b700 1 -- 172.21.15.102:0/1668446776 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07780afb30 con 0x7f0778157060 2024-08-17T02:26:00.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.161+0000 7f077d47b700 1 -- 172.21.15.102:0/1668446776 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0778071320 con 0x7f0778157060 2024-08-17T02:26:00.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.161+0000 7f076f7fe700 1 -- 172.21.15.102:0/1668446776 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0770014870 con 0x7f0778157060 2024-08-17T02:26:00.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.161+0000 7f076f7fe700 1 --2- 172.21.15.102:0/1668446776 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0758060860 0x7f0758062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.161+0000 7f076f7fe700 1 -- 172.21.15.102:0/1668446776 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f077007d850 con 0x7f0778157060 2024-08-17T02:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.161+0000 7f0776ffd700 1 --2- 172.21.15.102:0/1668446776 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0758060860 0x7f0758062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.161+0000 7f0776ffd700 1 --2- 172.21.15.102:0/1668446776 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0758060860 0x7f0758062d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f07680093f0 tx=0x7f0768017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.169+0000 7f076f7fe700 1 -- 172.21.15.102:0/1668446776 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f077004dca0 con 0x7f0778157060 2024-08-17T02:26:00.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.325+0000 7f077d47b700 1 -- 172.21.15.102:0/1668446776 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f077806e560 con 0x7f0758060860 2024-08-17T02:26:00.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.341+0000 7f076f7fe700 1 -- 172.21.15.102:0/1668446776 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252294 (secure 0 0 0) 0x7f077806e560 con 0x7f0758060860 2024-08-17T02:26:00.347 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:00.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.345+0000 7f077d47b700 1 -- 172.21.15.102:0/1668446776 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0758060860 msgr2=0x7f0758062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.345+0000 7f077d47b700 1 --2- 172.21.15.102:0/1668446776 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0758060860 0x7f0758062d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f07680093f0 tx=0x7f0768017000 comp rx=0 tx=0).stop 2024-08-17T02:26:00.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.345+0000 7f077d47b700 1 -- 172.21.15.102:0/1668446776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0778157060 msgr2=0x7f07780c7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.345+0000 7f077d47b700 1 --2- 172.21.15.102:0/1668446776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0778157060 0x7f07780c7930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f077000ef90 tx=0x7f077000b040 comp rx=0 tx=0).stop 2024-08-17T02:26:00.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.345+0000 7f077d47b700 1 -- 172.21.15.102:0/1668446776 shutdown_connections 2024-08-17T02:26:00.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.345+0000 7f077d47b700 1 --2- 172.21.15.102:0/1668446776 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0758060860 0x7f0758062d10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.345+0000 7f077d47b700 1 --2- 172.21.15.102:0/1668446776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0778157060 0x7f07780c7930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.345+0000 7f077d47b700 1 --2- 172.21.15.102:0/1668446776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f077806a310 0x7f07780c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.345+0000 7f077d47b700 1 --2- 172.21.15.102:0/1668446776 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0778068db0 0x7f07780c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.345+0000 7f077d47b700 1 -- 172.21.15.102:0/1668446776 >> 172.21.15.102:0/1668446776 conn(0x7f07780c9c20 msgr2=0x7f07780c2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:00.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.345+0000 7f077d47b700 1 -- 172.21.15.102:0/1668446776 shutdown_connections 2024-08-17T02:26:00.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:00.345+0000 7f077d47b700 1 -- 172.21.15.102:0/1668446776 wait complete. 2024-08-17T02:26:00.350 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-08-17T02:26:00.352 INFO:tasks.ceph.mds.b.smithi121.stderr:2024-08-17T02:26:00.348+0000 7fd531fb2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:00.362 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-08-17T02:25:59.177106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381884,"kb_used_data":2416,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592836,"statfs":{"total":773094113280,"available":770655064064,"internally_reserved":0,"allocated":2473984,"data_stored":1560014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.200113"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.981516+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990002+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.981280+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:39:25.522474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.993578+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:13.181529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.991656+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:40.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.994693+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:25.928936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.989063+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:39.955144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.989977+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984464+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.994797+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:23.175809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990239+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:14.842533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.999710+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:10.390875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990990+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:30.053768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.999744+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984989+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:30.053768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.999737+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-08-17T02:25:53.328162+0000","last_change":"2024-08-17T02:25:51.241912+0000","last_active":"2024-08-17T02:25:53.328162+0000","last_peered":"2024-08-17T02:25:53.328162+0000","last_clean":"2024-08-17T02:25:53.328162+0000","last_became_active":"2024-08-17T02:25:51.239655+0000","last_became_peered":"2024-08-17T02:25:51.239655+0000","last_unstale":"2024-08-17T02:25:53.328162+0000","last_undegraded":"2024-08-17T02:25:53.328162+0000","last_fullsized":"2024-08-17T02:25:53.328162+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_clean_scrub_stamp":"2024-08-17T02:25:49.863184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:53.845381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.992540+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:30.053768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.989225+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:40.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.999739+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:14.842533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.993400+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:33:55.304496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.985596+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:23.175809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.982716+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:26.856354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.985012+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:13.181529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990758+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990023+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:01.595885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.985206+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:25.928936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984988+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:33:55.304496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.983092+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:00.101762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.990838+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984238+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:20.748382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.981534+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:54.970742+0000","last_change":"2024-08-17T02:25:54.970742+0000","last_active":"2024-08-17T02:25:54.970742+0000","last_peered":"2024-08-17T02:25:54.970742+0000","last_clean":"2024-08-17T02:25:54.970742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:54.970742+0000","last_undegraded":"2024-08-17T02:25:54.970742+0000","last_fullsized":"2024-08-17T02:25:54.970742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:53.961121+0000","last_change":"2024-08-17T02:25:53.984840+0000","last_active":"2024-08-17T02:25:53.961121+0000","last_peered":"2024-08-17T02:25:53.961121+0000","last_clean":"2024-08-17T02:25:53.961121+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:53.961121+0000","last_undegraded":"2024-08-17T02:25:53.961121+0000","last_fullsized":"2024-08-17T02:25:53.961121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:28:21.593756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298080,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073760,"statfs":{"total":96636764160,"available":96331530240,"internally_reserved":0,"allocated":745472,"data_stored":633623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":126976,"data_stored":32003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":14,"seq":60129542146,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297516,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":163840,"data_stored":48670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.109}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":176128,"data_stored":54475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.615}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5189999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297516,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074324,"statfs":{"total":96636764160,"available":96332107776,"internally_reserved":0,"allocated":163840,"data_stored":48670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]}]},{"osd":0,"up_from":14,"seq":60129542146,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298704,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073136,"statfs":{"total":96636764160,"available":96330891264,"internally_reserved":0,"allocated":745472,"data_stored":633623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9350000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:00.403 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:00.405 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:03.366 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:03.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.481+0000 7f2b3b59e700 1 Processor -- start 2024-08-17T02:26:03.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.481+0000 7f2b3b59e700 1 -- start start 2024-08-17T02:26:03.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.481+0000 7f2b3b59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b3c0cccd0 0x7f2b3c0cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.481+0000 7f2b3b59e700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3c1611f0 con 0x7f2b3c146d30 2024-08-17T02:26:03.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.481+0000 7f2b3b59e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3c1614b0 con 0x7f2b3c0ca6e0 2024-08-17T02:26:03.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.481+0000 7f2b3b59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c161790 con 0x7f2b3c0cccd0 2024-08-17T02:26:03.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3ad9d700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2b3c146d30 0x7f2b3c0cdf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57480/0 (socket says 172.21.15.102:57480) 2024-08-17T02:26:03.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3ad9d700 1 -- 172.21.15.102:0/2923881189 learned_addr learned my addr 172.21.15.102:0/2923881189 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:03.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3a59c700 1 --2- 172.21.15.102:0/2923881189 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b3c0cccd0 0x7f2b3c0cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 -- 172.21.15.102:0/2923881189 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303539188 0 0) 0x7f2b3c1611f0 con 0x7f2b3c146d30 2024-08-17T02:26:03.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 -- 172.21.15.102:0/2923881189 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b24003570 con 0x7f2b3c146d30 2024-08-17T02:26:03.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 -- 172.21.15.102:0/2923881189 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490296940 0 0) 0x7f2b3c1614b0 con 0x7f2b3c0ca6e0 2024-08-17T02:26:03.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 -- 172.21.15.102:0/2923881189 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b3c1611f0 con 0x7f2b3c0ca6e0 2024-08-17T02:26:03.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 -- 172.21.15.102:0/2923881189 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1469602553 0 0) 0x7f2b24003570 con 0x7f2b3c146d30 2024-08-17T02:26:03.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 -- 172.21.15.102:0/2923881189 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b3c0cccd0 msgr2=0x7f2b3c0cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:03.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 --2- 172.21.15.102:0/2923881189 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b3c0cccd0 0x7f2b3c0cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 -- 172.21.15.102:0/2923881189 >> v1:172.21.15.121:6789/0 conn(0x7f2b3c0ca6e0 legacy=0x7f2b3c146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 -- 172.21.15.102:0/2923881189 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c161a70 con 0x7f2b3c146d30 2024-08-17T02:26:03.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 -- 172.21.15.102:0/2923881189 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7f2b340017f0 con 0x7f2b3c146d30 2024-08-17T02:26:03.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 -- 172.21.15.102:0/2923881189 >> v1:172.21.15.102:6789/0 conn(0x7f2b3c146d30 legacy=0x7f2b3c0cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 --2- 172.21.15.102:0/2923881189 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b3c0cccd0 0x7f2b24003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 --2- 172.21.15.102:0/2923881189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b240041a0 0x7f2b24004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 --2- 172.21.15.102:0/2923881189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b24004d50 0x7f2b240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 -- 172.21.15.102:0/2923881189 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c161790 con 0x7f2b24004d50 2024-08-17T02:26:03.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 -- 172.21.15.102:0/2923881189 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2400bbf0 con 0x7f2b240041a0 2024-08-17T02:26:03.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 -- 172.21.15.102:0/2923881189 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2400bdb0 con 0x7f2b3c0cccd0 2024-08-17T02:26:03.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3ad9d700 1 --2- 172.21.15.102:0/2923881189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b24004d50 0x7f2b240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3a59c700 1 --2- 172.21.15.102:0/2923881189 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b3c0cccd0 0x7f2b24003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b39d9b700 1 --2- 172.21.15.102:0/2923881189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b240041a0 0x7f2b24004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3ad9d700 1 -- 172.21.15.102:0/2923881189 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b3c0cccd0 msgr2=0x7f2b24003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:03.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3ad9d700 1 --2- 172.21.15.102:0/2923881189 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b3c0cccd0 0x7f2b24003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3ad9d700 1 -- 172.21.15.102:0/2923881189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b240041a0 msgr2=0x7f2b24004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:03.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3ad9d700 1 --2- 172.21.15.102:0/2923881189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b240041a0 0x7f2b24004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3ad9d700 1 -- 172.21.15.102:0/2923881189 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b24003570 con 0x7f2b24004d50 2024-08-17T02:26:03.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3ad9d700 1 --2- 172.21.15.102:0/2923881189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b24004d50 0x7f2b240051c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400a8c0 tx=0x7f2b34002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c87f16cefd84814 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:03.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 -- 172.21.15.102:0/2923881189 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b340070d0 con 0x7f2b24004d50 2024-08-17T02:26:03.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 -- 172.21.15.102:0/2923881189 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b34007230 con 0x7f2b24004d50 2024-08-17T02:26:03.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3959a700 1 -- 172.21.15.102:0/2923881189 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b340075d0 con 0x7f2b24004d50 2024-08-17T02:26:03.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3b59e700 1 -- 172.21.15.102:0/2923881189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b24004d50 msgr2=0x7f2b240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3b59e700 1 --2- 172.21.15.102:0/2923881189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b24004d50 0x7f2b240051c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400a8c0 tx=0x7f2b34002190 comp rx=0 tx=0).stop 2024-08-17T02:26:03.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3ad9d700 1 -- 172.21.15.102:0/2923881189 reap_dead start 2024-08-17T02:26:03.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3b59e700 1 -- 172.21.15.102:0/2923881189 shutdown_connections 2024-08-17T02:26:03.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3b59e700 1 -- 172.21.15.102:0/2923881189 >> 172.21.15.102:0/2923881189 conn(0x7f2b3c0d00a0 msgr2=0x7f2b3c0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:03.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3b59e700 1 -- 172.21.15.102:0/2923881189 shutdown_connections 2024-08-17T02:26:03.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.485+0000 7f2b3b59e700 1 -- 172.21.15.102:0/2923881189 wait complete. 2024-08-17T02:26:03.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b3b59e700 1 Processor -- start 2024-08-17T02:26:03.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b3b59e700 1 -- start start 2024-08-17T02:26:03.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b3b59e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b24004d50 0x7f2b3c16d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b3b59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b3c0b2e40 0x7f2b3c0b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b3b59e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b3c160090 0x7f2b3c06dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b3b59e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c0b3be0 con 0x7f2b3c160090 2024-08-17T02:26:03.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b3b59e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c0c7150 con 0x7f2b24004d50 2024-08-17T02:26:03.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b3b59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c0c7430 con 0x7f2b3c0b2e40 2024-08-17T02:26:03.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b3ad9d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b3c160090 0x7f2b3c06dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b3ad9d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b3c160090 0x7f2b3c06dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44090/0 (socket says 172.21.15.102:44090) 2024-08-17T02:26:03.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b3ad9d700 1 -- 172.21.15.102:0/1685037414 learned_addr learned my addr 172.21.15.102:0/1685037414 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:03.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b3a59c700 1 --2- 172.21.15.102:0/1685037414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b24004d50 0x7f2b3c16d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b39d9b700 1 --2- 172.21.15.102:0/1685037414 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b3c0b2e40 0x7f2b3c0b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b3ad9d700 1 -- 172.21.15.102:0/1685037414 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b3c0b2e40 msgr2=0x7f2b3c0b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b3ad9d700 1 --2- 172.21.15.102:0/1685037414 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b3c0b2e40 0x7f2b3c0b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b3ad9d700 1 -- 172.21.15.102:0/1685037414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b24004d50 msgr2=0x7f2b3c16d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.489+0000 7f2b3ad9d700 1 --2- 172.21.15.102:0/1685037414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b24004d50 0x7f2b3c16d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.493+0000 7f2b3ad9d700 1 -- 172.21.15.102:0/1685037414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c0b3340 con 0x7f2b3c160090 2024-08-17T02:26:03.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.493+0000 7f2b3ad9d700 1 --2- 172.21.15.102:0/1685037414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b3c160090 0x7f2b3c06dbf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2b240057d0 tx=0x7f2b34016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:03.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.493+0000 7f2b2a7fc700 1 -- 172.21.15.102:0/1685037414 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34023070 con 0x7f2b3c160090 2024-08-17T02:26:03.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.493+0000 7f2b2a7fc700 1 -- 172.21.15.102:0/1685037414 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b34007b50 con 0x7f2b3c160090 2024-08-17T02:26:03.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.493+0000 7f2b3b59e700 1 -- 172.21.15.102:0/1685037414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3c0b3620 con 0x7f2b3c160090 2024-08-17T02:26:03.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.493+0000 7f2b2a7fc700 1 -- 172.21.15.102:0/1685037414 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3401e430 con 0x7f2b3c160090 2024-08-17T02:26:03.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.493+0000 7f2b3b59e700 1 -- 172.21.15.102:0/1685037414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3c16de20 con 0x7f2b3c160090 2024-08-17T02:26:03.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.493+0000 7f2b3b59e700 1 -- 172.21.15.102:0/1685037414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3c0638f0 con 0x7f2b3c160090 2024-08-17T02:26:03.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.493+0000 7f2b2a7fc700 1 -- 172.21.15.102:0/1685037414 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2b3401e7a0 con 0x7f2b3c160090 2024-08-17T02:26:03.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.493+0000 7f2b2a7fc700 1 --2- 172.21.15.102:0/1685037414 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2b1c060860 0x7f2b1c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.493+0000 7f2b2a7fc700 1 -- 172.21.15.102:0/1685037414 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2b3407eb50 con 0x7f2b3c160090 2024-08-17T02:26:03.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.497+0000 7f2b3a59c700 1 --2- 172.21.15.102:0/1685037414 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2b1c060860 0x7f2b1c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.497+0000 7f2b3a59c700 1 --2- 172.21.15.102:0/1685037414 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2b1c060860 0x7f2b1c062d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009d90 tx=0x7f2b30008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:03.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.505+0000 7f2b2a7fc700 1 -- 172.21.15.102:0/1685037414 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2b3404efa0 con 0x7f2b3c160090 2024-08-17T02:26:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.665+0000 7f2b3b59e700 1 -- 172.21.15.102:0/1685037414 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2b3c0b2a10 con 0x7f2b1c060860 2024-08-17T02:26:03.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.681+0000 7f2b2a7fc700 1 -- 172.21.15.102:0/1685037414 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264532 (secure 0 0 0) 0x7f2b3c0b2a10 con 0x7f2b1c060860 2024-08-17T02:26:03.689 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.685+0000 7f2b3b59e700 1 -- 172.21.15.102:0/1685037414 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2b1c060860 msgr2=0x7f2b1c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.685+0000 7f2b3b59e700 1 --2- 172.21.15.102:0/1685037414 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2b1c060860 0x7f2b1c062d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009d90 tx=0x7f2b30008040 comp rx=0 tx=0).stop 2024-08-17T02:26:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.685+0000 7f2b3b59e700 1 -- 172.21.15.102:0/1685037414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b3c160090 msgr2=0x7f2b3c06dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.685+0000 7f2b3b59e700 1 --2- 172.21.15.102:0/1685037414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b3c160090 0x7f2b3c06dbf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2b240057d0 tx=0x7f2b34016000 comp rx=0 tx=0).stop 2024-08-17T02:26:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.685+0000 7f2b3b59e700 1 -- 172.21.15.102:0/1685037414 shutdown_connections 2024-08-17T02:26:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.685+0000 7f2b3b59e700 1 --2- 172.21.15.102:0/1685037414 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2b1c060860 0x7f2b1c062d10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.685+0000 7f2b3b59e700 1 --2- 172.21.15.102:0/1685037414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b3c160090 0x7f2b3c06dbf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.685+0000 7f2b3b59e700 1 --2- 172.21.15.102:0/1685037414 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2b3c0b2e40 0x7f2b3c0b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.685+0000 7f2b3b59e700 1 --2- 172.21.15.102:0/1685037414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b24004d50 0x7f2b3c16d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.689+0000 7f2b3b59e700 1 -- 172.21.15.102:0/1685037414 >> 172.21.15.102:0/1685037414 conn(0x7f2b3c0d00a0 msgr2=0x7f2b3c145ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.689+0000 7f2b3b59e700 1 -- 172.21.15.102:0/1685037414 shutdown_connections 2024-08-17T02:26:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.689+0000 7f2b3b59e700 1 -- 172.21.15.102:0/1685037414 wait complete. 2024-08-17T02:26:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-08-17T02:26:03.705 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-08-17T02:26:03.178766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381768,"kb_used_data":2888,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592952,"statfs":{"total":773094113280,"available":770655182848,"internally_reserved":0,"allocated":2957312,"data_stored":1775724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002772"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047525+0000","last_change":"2024-08-17T02:25:56.041834+0000","last_active":"2024-08-17T02:25:56.047525+0000","last_peered":"2024-08-17T02:25:56.047525+0000","last_clean":"2024-08-17T02:25:56.047525+0000","last_became_active":"2024-08-17T02:25:56.041161+0000","last_became_peered":"2024-08-17T02:25:56.041161+0000","last_unstale":"2024-08-17T02:25:56.047525+0000","last_undegraded":"2024-08-17T02:25:56.047525+0000","last_fullsized":"2024-08-17T02:25:56.047525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:31.069744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.037667+0000","last_change":"2024-08-17T02:25:56.031048+0000","last_active":"2024-08-17T02:25:56.037667+0000","last_peered":"2024-08-17T02:25:56.037667+0000","last_clean":"2024-08-17T02:25:56.037667+0000","last_became_active":"2024-08-17T02:25:56.030544+0000","last_became_peered":"2024-08-17T02:25:56.030544+0000","last_unstale":"2024-08-17T02:25:56.037667+0000","last_undegraded":"2024-08-17T02:25:56.037667+0000","last_fullsized":"2024-08-17T02:25:56.037667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:36.323034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.027320+0000","last_change":"2024-08-17T02:25:56.018521+0000","last_active":"2024-08-17T02:25:56.027320+0000","last_peered":"2024-08-17T02:25:56.027320+0000","last_clean":"2024-08-17T02:25:56.027320+0000","last_became_active":"2024-08-17T02:25:56.018150+0000","last_became_peered":"2024-08-17T02:25:56.018150+0000","last_unstale":"2024-08-17T02:25:56.027320+0000","last_undegraded":"2024-08-17T02:25:56.027320+0000","last_fullsized":"2024-08-17T02:25:56.027320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:15.442494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.037757+0000","last_change":"2024-08-17T02:25:56.028099+0000","last_active":"2024-08-17T02:25:56.037757+0000","last_peered":"2024-08-17T02:25:56.037757+0000","last_clean":"2024-08-17T02:25:56.037757+0000","last_became_active":"2024-08-17T02:25:56.027809+0000","last_became_peered":"2024-08-17T02:25:56.027809+0000","last_unstale":"2024-08-17T02:25:56.037757+0000","last_undegraded":"2024-08-17T02:25:56.037757+0000","last_fullsized":"2024-08-17T02:25:56.037757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:29.722508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047567+0000","last_change":"2024-08-17T02:25:56.041835+0000","last_active":"2024-08-17T02:25:56.047567+0000","last_peered":"2024-08-17T02:25:56.047567+0000","last_clean":"2024-08-17T02:25:56.047567+0000","last_became_active":"2024-08-17T02:25:56.040175+0000","last_became_peered":"2024-08-17T02:25:56.040175+0000","last_unstale":"2024-08-17T02:25:56.047567+0000","last_undegraded":"2024-08-17T02:25:56.047567+0000","last_fullsized":"2024-08-17T02:25:56.047567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:52.232984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041089+0000","last_change":"2024-08-17T02:25:56.036640+0000","last_active":"2024-08-17T02:25:56.041089+0000","last_peered":"2024-08-17T02:25:56.041089+0000","last_clean":"2024-08-17T02:25:56.041089+0000","last_became_active":"2024-08-17T02:25:56.035988+0000","last_became_peered":"2024-08-17T02:25:56.035988+0000","last_unstale":"2024-08-17T02:25:56.041089+0000","last_undegraded":"2024-08-17T02:25:56.041089+0000","last_fullsized":"2024-08-17T02:25:56.041089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:51.489903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.040700+0000","last_change":"2024-08-17T02:25:56.018767+0000","last_active":"2024-08-17T02:25:56.040700+0000","last_peered":"2024-08-17T02:25:56.040700+0000","last_clean":"2024-08-17T02:25:56.040700+0000","last_became_active":"2024-08-17T02:25:56.018454+0000","last_became_peered":"2024-08-17T02:25:56.018454+0000","last_unstale":"2024-08-17T02:25:56.040700+0000","last_undegraded":"2024-08-17T02:25:56.040700+0000","last_fullsized":"2024-08-17T02:25:56.040700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:24.040734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041569+0000","last_change":"2024-08-17T02:25:56.036004+0000","last_active":"2024-08-17T02:25:56.041569+0000","last_peered":"2024-08-17T02:25:56.041569+0000","last_clean":"2024-08-17T02:25:56.041569+0000","last_became_active":"2024-08-17T02:25:56.035748+0000","last_became_peered":"2024-08-17T02:25:56.035748+0000","last_unstale":"2024-08-17T02:25:56.041569+0000","last_undegraded":"2024-08-17T02:25:56.041569+0000","last_fullsized":"2024-08-17T02:25:56.041569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:24.560363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047491+0000","last_change":"2024-08-17T02:25:56.041696+0000","last_active":"2024-08-17T02:25:56.047491+0000","last_peered":"2024-08-17T02:25:56.047491+0000","last_clean":"2024-08-17T02:25:56.047491+0000","last_became_active":"2024-08-17T02:25:56.040480+0000","last_became_peered":"2024-08-17T02:25:56.040480+0000","last_unstale":"2024-08-17T02:25:56.047491+0000","last_undegraded":"2024-08-17T02:25:56.047491+0000","last_fullsized":"2024-08-17T02:25:56.047491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:17.900093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044205+0000","last_change":"2024-08-17T02:25:56.036179+0000","last_active":"2024-08-17T02:25:56.044205+0000","last_peered":"2024-08-17T02:25:56.044205+0000","last_clean":"2024-08-17T02:25:56.044205+0000","last_became_active":"2024-08-17T02:25:56.035909+0000","last_became_peered":"2024-08-17T02:25:56.035909+0000","last_unstale":"2024-08-17T02:25:56.044205+0000","last_undegraded":"2024-08-17T02:25:56.044205+0000","last_fullsized":"2024-08-17T02:25:56.044205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:32.738921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.034210+0000","last_change":"2024-08-17T02:25:56.027962+0000","last_active":"2024-08-17T02:25:56.034210+0000","last_peered":"2024-08-17T02:25:56.034210+0000","last_clean":"2024-08-17T02:25:56.034210+0000","last_became_active":"2024-08-17T02:25:56.027599+0000","last_became_peered":"2024-08-17T02:25:56.027599+0000","last_unstale":"2024-08-17T02:25:56.034210+0000","last_undegraded":"2024-08-17T02:25:56.034210+0000","last_fullsized":"2024-08-17T02:25:56.034210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:40.638494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.031526+0000","last_change":"2024-08-17T02:25:56.022137+0000","last_active":"2024-08-17T02:25:56.031526+0000","last_peered":"2024-08-17T02:25:56.031526+0000","last_clean":"2024-08-17T02:25:56.031526+0000","last_became_active":"2024-08-17T02:25:56.018606+0000","last_became_peered":"2024-08-17T02:25:56.018606+0000","last_unstale":"2024-08-17T02:25:56.031526+0000","last_undegraded":"2024-08-17T02:25:56.031526+0000","last_fullsized":"2024-08-17T02:25:56.031526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:24.083566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.029816+0000","last_change":"2024-08-17T02:25:56.026153+0000","last_active":"2024-08-17T02:25:56.029816+0000","last_peered":"2024-08-17T02:25:56.029816+0000","last_clean":"2024-08-17T02:25:56.029816+0000","last_became_active":"2024-08-17T02:25:56.025787+0000","last_became_peered":"2024-08-17T02:25:56.025787+0000","last_unstale":"2024-08-17T02:25:56.029816+0000","last_undegraded":"2024-08-17T02:25:56.029816+0000","last_fullsized":"2024-08-17T02:25:56.029816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:25.457349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.032456+0000","last_change":"2024-08-17T02:25:56.028794+0000","last_active":"2024-08-17T02:25:56.032456+0000","last_peered":"2024-08-17T02:25:56.032456+0000","last_clean":"2024-08-17T02:25:56.032456+0000","last_became_active":"2024-08-17T02:25:56.028458+0000","last_became_peered":"2024-08-17T02:25:56.028458+0000","last_unstale":"2024-08-17T02:25:56.032456+0000","last_undegraded":"2024-08-17T02:25:56.032456+0000","last_fullsized":"2024-08-17T02:25:56.032456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:55.320971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041117+0000","last_change":"2024-08-17T02:25:56.036545+0000","last_active":"2024-08-17T02:25:56.041117+0000","last_peered":"2024-08-17T02:25:56.041117+0000","last_clean":"2024-08-17T02:25:56.041117+0000","last_became_active":"2024-08-17T02:25:56.036266+0000","last_became_peered":"2024-08-17T02:25:56.036266+0000","last_unstale":"2024-08-17T02:25:56.041117+0000","last_undegraded":"2024-08-17T02:25:56.041117+0000","last_fullsized":"2024-08-17T02:25:56.041117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:58.197912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.034417+0000","last_change":"2024-08-17T02:25:56.024271+0000","last_active":"2024-08-17T02:25:56.034417+0000","last_peered":"2024-08-17T02:25:56.034417+0000","last_clean":"2024-08-17T02:25:56.034417+0000","last_became_active":"2024-08-17T02:25:56.023779+0000","last_became_peered":"2024-08-17T02:25:56.023779+0000","last_unstale":"2024-08-17T02:25:56.034417+0000","last_undegraded":"2024-08-17T02:25:56.034417+0000","last_fullsized":"2024-08-17T02:25:56.034417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:08:39.924999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.050174+0000","last_change":"2024-08-17T02:25:56.045776+0000","last_active":"2024-08-17T02:25:56.050174+0000","last_peered":"2024-08-17T02:25:56.050174+0000","last_clean":"2024-08-17T02:25:56.050174+0000","last_became_active":"2024-08-17T02:25:56.045509+0000","last_became_peered":"2024-08-17T02:25:56.045509+0000","last_unstale":"2024-08-17T02:25:56.050174+0000","last_undegraded":"2024-08-17T02:25:56.050174+0000","last_fullsized":"2024-08-17T02:25:56.050174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:59.671251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.031740+0000","last_change":"2024-08-17T02:25:56.024593+0000","last_active":"2024-08-17T02:25:56.031740+0000","last_peered":"2024-08-17T02:25:56.031740+0000","last_clean":"2024-08-17T02:25:56.031740+0000","last_became_active":"2024-08-17T02:25:56.024239+0000","last_became_peered":"2024-08-17T02:25:56.024239+0000","last_unstale":"2024-08-17T02:25:56.031740+0000","last_undegraded":"2024-08-17T02:25:56.031740+0000","last_fullsized":"2024-08-17T02:25:56.031740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:15.239096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047506+0000","last_change":"2024-08-17T02:25:56.041808+0000","last_active":"2024-08-17T02:25:56.047506+0000","last_peered":"2024-08-17T02:25:56.047506+0000","last_clean":"2024-08-17T02:25:56.047506+0000","last_became_active":"2024-08-17T02:25:56.040916+0000","last_became_peered":"2024-08-17T02:25:56.040916+0000","last_unstale":"2024-08-17T02:25:56.047506+0000","last_undegraded":"2024-08-17T02:25:56.047506+0000","last_fullsized":"2024-08-17T02:25:56.047506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:57.018682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.027498+0000","last_change":"2024-08-17T02:25:56.023215+0000","last_active":"2024-08-17T02:25:56.027498+0000","last_peered":"2024-08-17T02:25:56.027498+0000","last_clean":"2024-08-17T02:25:56.027498+0000","last_became_active":"2024-08-17T02:25:56.022935+0000","last_became_peered":"2024-08-17T02:25:56.022935+0000","last_unstale":"2024-08-17T02:25:56.027498+0000","last_undegraded":"2024-08-17T02:25:56.027498+0000","last_fullsized":"2024-08-17T02:25:56.027498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:24.560363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041377+0000","last_change":"2024-08-17T02:25:56.036032+0000","last_active":"2024-08-17T02:25:56.041377+0000","last_peered":"2024-08-17T02:25:56.041377+0000","last_clean":"2024-08-17T02:25:56.041377+0000","last_became_active":"2024-08-17T02:25:56.035200+0000","last_became_peered":"2024-08-17T02:25:56.035200+0000","last_unstale":"2024-08-17T02:25:56.041377+0000","last_undegraded":"2024-08-17T02:25:56.041377+0000","last_fullsized":"2024-08-17T02:25:56.041377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:40.638494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047292+0000","last_change":"2024-08-17T02:25:56.043121+0000","last_active":"2024-08-17T02:25:56.047292+0000","last_peered":"2024-08-17T02:25:56.047292+0000","last_clean":"2024-08-17T02:25:56.047292+0000","last_became_active":"2024-08-17T02:25:56.042862+0000","last_became_peered":"2024-08-17T02:25:56.042862+0000","last_unstale":"2024-08-17T02:25:56.047292+0000","last_undegraded":"2024-08-17T02:25:56.047292+0000","last_fullsized":"2024-08-17T02:25:56.047292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:10.710311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.024108+0000","last_change":"2024-08-17T02:25:56.021487+0000","last_active":"2024-08-17T02:25:56.024108+0000","last_peered":"2024-08-17T02:25:56.024108+0000","last_clean":"2024-08-17T02:25:56.024108+0000","last_became_active":"2024-08-17T02:25:56.020379+0000","last_became_peered":"2024-08-17T02:25:56.020379+0000","last_unstale":"2024-08-17T02:25:56.024108+0000","last_undegraded":"2024-08-17T02:25:56.024108+0000","last_fullsized":"2024-08-17T02:25:56.024108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:55.237015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.035235+0000","last_change":"2024-08-17T02:25:56.025828+0000","last_active":"2024-08-17T02:25:56.035235+0000","last_peered":"2024-08-17T02:25:56.035235+0000","last_clean":"2024-08-17T02:25:56.035235+0000","last_became_active":"2024-08-17T02:25:56.025558+0000","last_became_peered":"2024-08-17T02:25:56.025558+0000","last_unstale":"2024-08-17T02:25:56.035235+0000","last_undegraded":"2024-08-17T02:25:56.035235+0000","last_fullsized":"2024-08-17T02:25:56.035235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:33:14.351722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041414+0000","last_change":"2024-08-17T02:25:56.032974+0000","last_active":"2024-08-17T02:25:56.041414+0000","last_peered":"2024-08-17T02:25:56.041414+0000","last_clean":"2024-08-17T02:25:56.041414+0000","last_became_active":"2024-08-17T02:25:56.032693+0000","last_became_peered":"2024-08-17T02:25:56.032693+0000","last_unstale":"2024-08-17T02:25:56.041414+0000","last_undegraded":"2024-08-17T02:25:56.041414+0000","last_fullsized":"2024-08-17T02:25:56.041414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:39.511023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047076+0000","last_change":"2024-08-17T02:25:56.042862+0000","last_active":"2024-08-17T02:25:56.047076+0000","last_peered":"2024-08-17T02:25:56.047076+0000","last_clean":"2024-08-17T02:25:56.047076+0000","last_became_active":"2024-08-17T02:25:56.042507+0000","last_became_peered":"2024-08-17T02:25:56.042507+0000","last_unstale":"2024-08-17T02:25:56.047076+0000","last_undegraded":"2024-08-17T02:25:56.047076+0000","last_fullsized":"2024-08-17T02:25:56.047076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:09.506321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.037837+0000","last_change":"2024-08-17T02:25:56.031020+0000","last_active":"2024-08-17T02:25:56.037837+0000","last_peered":"2024-08-17T02:25:56.037837+0000","last_clean":"2024-08-17T02:25:56.037837+0000","last_became_active":"2024-08-17T02:25:56.030750+0000","last_became_peered":"2024-08-17T02:25:56.030750+0000","last_unstale":"2024-08-17T02:25:56.037837+0000","last_undegraded":"2024-08-17T02:25:56.037837+0000","last_fullsized":"2024-08-17T02:25:56.037837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:57.681709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041753+0000","last_change":"2024-08-17T02:25:56.034831+0000","last_active":"2024-08-17T02:25:56.041753+0000","last_peered":"2024-08-17T02:25:56.041753+0000","last_clean":"2024-08-17T02:25:56.041753+0000","last_became_active":"2024-08-17T02:25:56.034550+0000","last_became_peered":"2024-08-17T02:25:56.034550+0000","last_unstale":"2024-08-17T02:25:56.041753+0000","last_undegraded":"2024-08-17T02:25:56.041753+0000","last_fullsized":"2024-08-17T02:25:56.041753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:55.320971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.030341+0000","last_change":"2024-08-17T02:25:56.025278+0000","last_active":"2024-08-17T02:25:56.030341+0000","last_peered":"2024-08-17T02:25:56.030341+0000","last_clean":"2024-08-17T02:25:56.030341+0000","last_became_active":"2024-08-17T02:25:56.023690+0000","last_became_peered":"2024-08-17T02:25:56.023690+0000","last_unstale":"2024-08-17T02:25:56.030341+0000","last_undegraded":"2024-08-17T02:25:56.030341+0000","last_fullsized":"2024-08-17T02:25:56.030341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:09.506321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.035834+0000","last_change":"2024-08-17T02:25:56.025247+0000","last_active":"2024-08-17T02:25:56.035834+0000","last_peered":"2024-08-17T02:25:56.035834+0000","last_clean":"2024-08-17T02:25:56.035834+0000","last_became_active":"2024-08-17T02:25:56.024908+0000","last_became_peered":"2024-08-17T02:25:56.024908+0000","last_unstale":"2024-08-17T02:25:56.035834+0000","last_undegraded":"2024-08-17T02:25:56.035834+0000","last_fullsized":"2024-08-17T02:25:56.035834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:42.383928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.031806+0000","last_change":"2024-08-17T02:25:56.025374+0000","last_active":"2024-08-17T02:25:56.031806+0000","last_peered":"2024-08-17T02:25:56.031806+0000","last_clean":"2024-08-17T02:25:56.031806+0000","last_became_active":"2024-08-17T02:25:56.025085+0000","last_became_peered":"2024-08-17T02:25:56.025085+0000","last_unstale":"2024-08-17T02:25:56.031806+0000","last_undegraded":"2024-08-17T02:25:56.031806+0000","last_fullsized":"2024-08-17T02:25:56.031806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:50:31.109301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.024776+0000","last_change":"2024-08-17T02:25:56.019936+0000","last_active":"2024-08-17T02:25:56.024776+0000","last_peered":"2024-08-17T02:25:56.024776+0000","last_clean":"2024-08-17T02:25:56.024776+0000","last_became_active":"2024-08-17T02:25:56.019534+0000","last_became_peered":"2024-08-17T02:25:56.019534+0000","last_unstale":"2024-08-17T02:25:56.024776+0000","last_undegraded":"2024-08-17T02:25:56.024776+0000","last_fullsized":"2024-08-17T02:25:56.024776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:55.320971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.034322+0000","last_change":"2024-08-17T02:25:56.027794+0000","last_active":"2024-08-17T02:25:56.034322+0000","last_peered":"2024-08-17T02:25:56.034322+0000","last_clean":"2024-08-17T02:25:56.034322+0000","last_became_active":"2024-08-17T02:25:56.026104+0000","last_became_peered":"2024-08-17T02:25:56.026104+0000","last_unstale":"2024-08-17T02:25:56.034322+0000","last_undegraded":"2024-08-17T02:25:56.034322+0000","last_fullsized":"2024-08-17T02:25:56.034322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:38.820190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.045256+0000","last_change":"2024-08-17T02:25:54.996735+0000","last_active":"2024-08-17T02:25:56.045256+0000","last_peered":"2024-08-17T02:25:56.045256+0000","last_clean":"2024-08-17T02:25:56.045256+0000","last_became_active":"2024-08-17T02:25:54.996446+0000","last_became_peered":"2024-08-17T02:25:54.996446+0000","last_unstale":"2024-08-17T02:25:56.045256+0000","last_undegraded":"2024-08-17T02:25:56.045256+0000","last_fullsized":"2024-08-17T02:25:56.045256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.027333+0000","last_change":"2024-08-17T02:25:56.019338+0000","last_active":"2024-08-17T02:25:56.027333+0000","last_peered":"2024-08-17T02:25:56.027333+0000","last_clean":"2024-08-17T02:25:56.027333+0000","last_became_active":"2024-08-17T02:25:56.018424+0000","last_became_peered":"2024-08-17T02:25:56.018424+0000","last_unstale":"2024-08-17T02:25:56.027333+0000","last_undegraded":"2024-08-17T02:25:56.027333+0000","last_fullsized":"2024-08-17T02:25:56.027333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:36:59.886094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.042638+0000","last_change":"2024-08-17T02:25:55.002905+0000","last_active":"2024-08-17T02:25:56.042638+0000","last_peered":"2024-08-17T02:25:56.042638+0000","last_clean":"2024-08-17T02:25:56.042638+0000","last_became_active":"2024-08-17T02:25:55.002626+0000","last_became_peered":"2024-08-17T02:25:55.002626+0000","last_unstale":"2024-08-17T02:25:56.042638+0000","last_undegraded":"2024-08-17T02:25:56.042638+0000","last_fullsized":"2024-08-17T02:25:56.042638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:00.101762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.012817+0000","last_change":"2024-08-17T02:25:55.002842+0000","last_active":"2024-08-17T02:25:56.012817+0000","last_peered":"2024-08-17T02:25:56.012817+0000","last_clean":"2024-08-17T02:25:56.012817+0000","last_became_active":"2024-08-17T02:25:55.002548+0000","last_became_peered":"2024-08-17T02:25:55.002548+0000","last_unstale":"2024-08-17T02:25:56.012817+0000","last_undegraded":"2024-08-17T02:25:56.012817+0000","last_fullsized":"2024-08-17T02:25:56.012817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:26.856354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.038777+0000","last_change":"2024-08-17T02:25:56.030862+0000","last_active":"2024-08-17T02:25:56.038777+0000","last_peered":"2024-08-17T02:25:56.038777+0000","last_clean":"2024-08-17T02:25:56.038777+0000","last_became_active":"2024-08-17T02:25:56.030561+0000","last_became_peered":"2024-08-17T02:25:56.030561+0000","last_unstale":"2024-08-17T02:25:56.038777+0000","last_undegraded":"2024-08-17T02:25:56.038777+0000","last_fullsized":"2024-08-17T02:25:56.038777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:36:59.886094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.021273+0000","last_change":"2024-08-17T02:25:54.995596+0000","last_active":"2024-08-17T02:25:56.021273+0000","last_peered":"2024-08-17T02:25:56.021273+0000","last_clean":"2024-08-17T02:25:56.021273+0000","last_became_active":"2024-08-17T02:25:54.994045+0000","last_became_peered":"2024-08-17T02:25:54.994045+0000","last_unstale":"2024-08-17T02:25:56.021273+0000","last_undegraded":"2024-08-17T02:25:56.021273+0000","last_fullsized":"2024-08-17T02:25:56.021273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:25:59.640731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.037529+0000","last_change":"2024-08-17T02:25:56.030467+0000","last_active":"2024-08-17T02:25:56.037529+0000","last_peered":"2024-08-17T02:25:56.037529+0000","last_clean":"2024-08-17T02:25:56.037529+0000","last_became_active":"2024-08-17T02:25:56.030177+0000","last_became_peered":"2024-08-17T02:25:56.030177+0000","last_unstale":"2024-08-17T02:25:56.037529+0000","last_undegraded":"2024-08-17T02:25:56.037529+0000","last_fullsized":"2024-08-17T02:25:56.037529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:14:23.828783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.014529+0000","last_change":"2024-08-17T02:25:55.006457+0000","last_active":"2024-08-17T02:25:56.014529+0000","last_peered":"2024-08-17T02:25:56.014529+0000","last_clean":"2024-08-17T02:25:56.014529+0000","last_became_active":"2024-08-17T02:25:55.006225+0000","last_became_peered":"2024-08-17T02:25:55.006225+0000","last_unstale":"2024-08-17T02:25:56.014529+0000","last_undegraded":"2024-08-17T02:25:56.014529+0000","last_fullsized":"2024-08-17T02:25:56.014529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:01.595885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047268+0000","last_change":"2024-08-17T02:25:56.043053+0000","last_active":"2024-08-17T02:25:56.047268+0000","last_peered":"2024-08-17T02:25:56.047268+0000","last_clean":"2024-08-17T02:25:56.047268+0000","last_became_active":"2024-08-17T02:25:56.042765+0000","last_became_peered":"2024-08-17T02:25:56.042765+0000","last_unstale":"2024-08-17T02:25:56.047268+0000","last_undegraded":"2024-08-17T02:25:56.047268+0000","last_fullsized":"2024-08-17T02:25:56.047268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:26:12.529793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.024646+0000","last_change":"2024-08-17T02:25:55.007141+0000","last_active":"2024-08-17T02:25:56.024646+0000","last_peered":"2024-08-17T02:25:56.024646+0000","last_clean":"2024-08-17T02:25:56.024646+0000","last_became_active":"2024-08-17T02:25:55.006847+0000","last_became_peered":"2024-08-17T02:25:55.006847+0000","last_unstale":"2024-08-17T02:25:56.024646+0000","last_undegraded":"2024-08-17T02:25:56.024646+0000","last_fullsized":"2024-08-17T02:25:56.024646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:12.268531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041448+0000","last_change":"2024-08-17T02:25:56.037131+0000","last_active":"2024-08-17T02:25:56.041448+0000","last_peered":"2024-08-17T02:25:56.041448+0000","last_clean":"2024-08-17T02:25:56.041448+0000","last_became_active":"2024-08-17T02:25:56.036703+0000","last_became_peered":"2024-08-17T02:25:56.036703+0000","last_unstale":"2024-08-17T02:25:56.041448+0000","last_undegraded":"2024-08-17T02:25:56.041448+0000","last_fullsized":"2024-08-17T02:25:56.041448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:24.560363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041671+0000","last_change":"2024-08-17T02:25:54.996735+0000","last_active":"2024-08-17T02:25:56.041671+0000","last_peered":"2024-08-17T02:25:56.041671+0000","last_clean":"2024-08-17T02:25:56.041671+0000","last_became_active":"2024-08-17T02:25:54.996462+0000","last_became_peered":"2024-08-17T02:25:54.996462+0000","last_unstale":"2024-08-17T02:25:56.041671+0000","last_undegraded":"2024-08-17T02:25:56.041671+0000","last_fullsized":"2024-08-17T02:25:56.041671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:21.048415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.027476+0000","last_change":"2024-08-17T02:25:56.019935+0000","last_active":"2024-08-17T02:25:56.027476+0000","last_peered":"2024-08-17T02:25:56.027476+0000","last_clean":"2024-08-17T02:25:56.027476+0000","last_became_active":"2024-08-17T02:25:56.019608+0000","last_became_peered":"2024-08-17T02:25:56.019608+0000","last_unstale":"2024-08-17T02:25:56.027476+0000","last_undegraded":"2024-08-17T02:25:56.027476+0000","last_fullsized":"2024-08-17T02:25:56.027476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:22.058035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047300+0000","last_change":"2024-08-17T02:25:55.001788+0000","last_active":"2024-08-17T02:25:56.047300+0000","last_peered":"2024-08-17T02:25:56.047300+0000","last_clean":"2024-08-17T02:25:56.047300+0000","last_became_active":"2024-08-17T02:25:55.001430+0000","last_became_peered":"2024-08-17T02:25:55.001430+0000","last_unstale":"2024-08-17T02:25:56.047300+0000","last_undegraded":"2024-08-17T02:25:56.047300+0000","last_fullsized":"2024-08-17T02:25:56.047300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:26.856354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047546+0000","last_change":"2024-08-17T02:25:56.041922+0000","last_active":"2024-08-17T02:25:56.047546+0000","last_peered":"2024-08-17T02:25:56.047546+0000","last_clean":"2024-08-17T02:25:56.047546+0000","last_became_active":"2024-08-17T02:25:56.041213+0000","last_became_peered":"2024-08-17T02:25:56.041213+0000","last_unstale":"2024-08-17T02:25:56.047546+0000","last_undegraded":"2024-08-17T02:25:56.047546+0000","last_fullsized":"2024-08-17T02:25:56.047546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:25.128217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044849+0000","last_change":"2024-08-17T02:25:54.997271+0000","last_active":"2024-08-17T02:25:56.044849+0000","last_peered":"2024-08-17T02:25:56.044849+0000","last_clean":"2024-08-17T02:25:56.044849+0000","last_became_active":"2024-08-17T02:25:54.996996+0000","last_became_peered":"2024-08-17T02:25:54.996996+0000","last_unstale":"2024-08-17T02:25:56.044849+0000","last_undegraded":"2024-08-17T02:25:56.044849+0000","last_fullsized":"2024-08-17T02:25:56.044849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.030027+0000","last_change":"2024-08-17T02:25:56.023022+0000","last_active":"2024-08-17T02:25:56.030027+0000","last_peered":"2024-08-17T02:25:56.030027+0000","last_clean":"2024-08-17T02:25:56.030027+0000","last_became_active":"2024-08-17T02:25:56.020092+0000","last_became_peered":"2024-08-17T02:25:56.020092+0000","last_unstale":"2024-08-17T02:25:56.030027+0000","last_undegraded":"2024-08-17T02:25:56.030027+0000","last_fullsized":"2024-08-17T02:25:56.030027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:08.877931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.023336+0000","last_change":"2024-08-17T02:25:55.000169+0000","last_active":"2024-08-17T02:25:56.023336+0000","last_peered":"2024-08-17T02:25:56.023336+0000","last_clean":"2024-08-17T02:25:56.023336+0000","last_became_active":"2024-08-17T02:25:54.999922+0000","last_became_peered":"2024-08-17T02:25:54.999922+0000","last_unstale":"2024-08-17T02:25:56.023336+0000","last_undegraded":"2024-08-17T02:25:56.023336+0000","last_fullsized":"2024-08-17T02:25:56.023336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:37.810570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047588+0000","last_change":"2024-08-17T02:25:56.042130+0000","last_active":"2024-08-17T02:25:56.047588+0000","last_peered":"2024-08-17T02:25:56.047588+0000","last_clean":"2024-08-17T02:25:56.047588+0000","last_became_active":"2024-08-17T02:25:56.040537+0000","last_became_peered":"2024-08-17T02:25:56.040537+0000","last_unstale":"2024-08-17T02:25:56.047588+0000","last_undegraded":"2024-08-17T02:25:56.047588+0000","last_fullsized":"2024-08-17T02:25:56.047588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:24.600349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.013500+0000","last_change":"2024-08-17T02:25:55.007014+0000","last_active":"2024-08-17T02:25:56.013500+0000","last_peered":"2024-08-17T02:25:56.013500+0000","last_clean":"2024-08-17T02:25:56.013500+0000","last_became_active":"2024-08-17T02:25:55.006703+0000","last_became_peered":"2024-08-17T02:25:55.006703+0000","last_unstale":"2024-08-17T02:25:56.013500+0000","last_undegraded":"2024-08-17T02:25:56.013500+0000","last_fullsized":"2024-08-17T02:25:56.013500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:20.748382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.024753+0000","last_change":"2024-08-17T02:25:56.019882+0000","last_active":"2024-08-17T02:25:56.024753+0000","last_peered":"2024-08-17T02:25:56.024753+0000","last_clean":"2024-08-17T02:25:56.024753+0000","last_became_active":"2024-08-17T02:25:56.019469+0000","last_became_peered":"2024-08-17T02:25:56.019469+0000","last_unstale":"2024-08-17T02:25:56.024753+0000","last_undegraded":"2024-08-17T02:25:56.024753+0000","last_fullsized":"2024-08-17T02:25:56.024753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:36:59.886094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.045053+0000","last_change":"2024-08-17T02:25:54.993917+0000","last_active":"2024-08-17T02:25:56.045053+0000","last_peered":"2024-08-17T02:25:56.045053+0000","last_clean":"2024-08-17T02:25:56.045053+0000","last_became_active":"2024-08-17T02:25:54.993586+0000","last_became_peered":"2024-08-17T02:25:54.993586+0000","last_unstale":"2024-08-17T02:25:56.045053+0000","last_undegraded":"2024-08-17T02:25:56.045053+0000","last_fullsized":"2024-08-17T02:25:56.045053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:00.101762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044680+0000","last_change":"2024-08-17T02:25:56.034676+0000","last_active":"2024-08-17T02:25:56.044680+0000","last_peered":"2024-08-17T02:25:56.044680+0000","last_clean":"2024-08-17T02:25:56.044680+0000","last_became_active":"2024-08-17T02:25:56.032428+0000","last_became_peered":"2024-08-17T02:25:56.032428+0000","last_unstale":"2024-08-17T02:25:56.044680+0000","last_undegraded":"2024-08-17T02:25:56.044680+0000","last_fullsized":"2024-08-17T02:25:56.044680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:15.142628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041743+0000","last_change":"2024-08-17T02:25:54.997719+0000","last_active":"2024-08-17T02:25:56.041743+0000","last_peered":"2024-08-17T02:25:56.041743+0000","last_clean":"2024-08-17T02:25:56.041743+0000","last_became_active":"2024-08-17T02:25:54.997406+0000","last_became_peered":"2024-08-17T02:25:54.997406+0000","last_unstale":"2024-08-17T02:25:56.041743+0000","last_undegraded":"2024-08-17T02:25:56.041743+0000","last_fullsized":"2024-08-17T02:25:56.041743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:13.181529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047459+0000","last_change":"2024-08-17T02:25:56.041646+0000","last_active":"2024-08-17T02:25:56.047459+0000","last_peered":"2024-08-17T02:25:56.047459+0000","last_clean":"2024-08-17T02:25:56.047459+0000","last_became_active":"2024-08-17T02:25:56.040446+0000","last_became_peered":"2024-08-17T02:25:56.040446+0000","last_unstale":"2024-08-17T02:25:56.047459+0000","last_undegraded":"2024-08-17T02:25:56.047459+0000","last_fullsized":"2024-08-17T02:25:56.047459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:08.877931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041865+0000","last_change":"2024-08-17T02:25:55.000628+0000","last_active":"2024-08-17T02:25:56.041865+0000","last_peered":"2024-08-17T02:25:56.041865+0000","last_clean":"2024-08-17T02:25:56.041865+0000","last_became_active":"2024-08-17T02:25:55.000178+0000","last_became_peered":"2024-08-17T02:25:55.000178+0000","last_unstale":"2024-08-17T02:25:56.041865+0000","last_undegraded":"2024-08-17T02:25:56.041865+0000","last_fullsized":"2024-08-17T02:25:56.041865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:40.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047416+0000","last_change":"2024-08-17T02:25:56.041357+0000","last_active":"2024-08-17T02:25:56.047416+0000","last_peered":"2024-08-17T02:25:56.047416+0000","last_clean":"2024-08-17T02:25:56.047416+0000","last_became_active":"2024-08-17T02:25:56.040452+0000","last_became_peered":"2024-08-17T02:25:56.040452+0000","last_unstale":"2024-08-17T02:25:56.047416+0000","last_undegraded":"2024-08-17T02:25:56.047416+0000","last_fullsized":"2024-08-17T02:25:56.047416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:58.712854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.043576+0000","last_change":"2024-08-17T02:25:54.993030+0000","last_active":"2024-08-17T02:25:56.043576+0000","last_peered":"2024-08-17T02:25:56.043576+0000","last_clean":"2024-08-17T02:25:56.043576+0000","last_became_active":"2024-08-17T02:25:54.992489+0000","last_became_peered":"2024-08-17T02:25:54.992489+0000","last_unstale":"2024-08-17T02:25:56.043576+0000","last_undegraded":"2024-08-17T02:25:56.043576+0000","last_fullsized":"2024-08-17T02:25:56.043576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:55.678872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.034464+0000","last_change":"2024-08-17T02:25:56.024775+0000","last_active":"2024-08-17T02:25:56.034464+0000","last_peered":"2024-08-17T02:25:56.034464+0000","last_clean":"2024-08-17T02:25:56.034464+0000","last_became_active":"2024-08-17T02:25:56.024421+0000","last_became_peered":"2024-08-17T02:25:56.024421+0000","last_unstale":"2024-08-17T02:25:56.034464+0000","last_undegraded":"2024-08-17T02:25:56.034464+0000","last_fullsized":"2024-08-17T02:25:56.034464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:45:06.291261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.013596+0000","last_change":"2024-08-17T02:25:54.997149+0000","last_active":"2024-08-17T02:25:56.013596+0000","last_peered":"2024-08-17T02:25:56.013596+0000","last_clean":"2024-08-17T02:25:56.013596+0000","last_became_active":"2024-08-17T02:25:54.996821+0000","last_became_peered":"2024-08-17T02:25:54.996821+0000","last_unstale":"2024-08-17T02:25:56.013596+0000","last_undegraded":"2024-08-17T02:25:56.013596+0000","last_fullsized":"2024-08-17T02:25:56.013596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:26.856354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047478+0000","last_change":"2024-08-17T02:25:56.041666+0000","last_active":"2024-08-17T02:25:56.047478+0000","last_peered":"2024-08-17T02:25:56.047478+0000","last_clean":"2024-08-17T02:25:56.047478+0000","last_became_active":"2024-08-17T02:25:56.040381+0000","last_became_peered":"2024-08-17T02:25:56.040381+0000","last_unstale":"2024-08-17T02:25:56.047478+0000","last_undegraded":"2024-08-17T02:25:56.047478+0000","last_fullsized":"2024-08-17T02:25:56.047478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:04.282484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.014877+0000","last_change":"2024-08-17T02:25:51.241912+0000","last_active":"2024-08-17T02:25:56.014877+0000","last_peered":"2024-08-17T02:25:56.014877+0000","last_clean":"2024-08-17T02:25:56.014877+0000","last_became_active":"2024-08-17T02:25:51.239655+0000","last_became_peered":"2024-08-17T02:25:51.239655+0000","last_unstale":"2024-08-17T02:25:56.014877+0000","last_undegraded":"2024-08-17T02:25:56.014877+0000","last_fullsized":"2024-08-17T02:25:56.014877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_clean_scrub_stamp":"2024-08-17T02:25:49.863184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:53.845381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.020368+0000","last_change":"2024-08-17T02:25:54.995452+0000","last_active":"2024-08-17T02:25:56.020368+0000","last_peered":"2024-08-17T02:25:56.020368+0000","last_clean":"2024-08-17T02:25:56.020368+0000","last_became_active":"2024-08-17T02:25:54.994880+0000","last_became_peered":"2024-08-17T02:25:54.994880+0000","last_unstale":"2024-08-17T02:25:56.020368+0000","last_undegraded":"2024-08-17T02:25:56.020368+0000","last_fullsized":"2024-08-17T02:25:56.020368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:06.575204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044202+0000","last_change":"2024-08-17T02:25:56.037423+0000","last_active":"2024-08-17T02:25:56.044202+0000","last_peered":"2024-08-17T02:25:56.044202+0000","last_clean":"2024-08-17T02:25:56.044202+0000","last_became_active":"2024-08-17T02:25:56.037168+0000","last_became_peered":"2024-08-17T02:25:56.037168+0000","last_unstale":"2024-08-17T02:25:56.044202+0000","last_undegraded":"2024-08-17T02:25:56.044202+0000","last_fullsized":"2024-08-17T02:25:56.044202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:08.877931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.014785+0000","last_change":"2024-08-17T02:25:55.000498+0000","last_active":"2024-08-17T02:25:56.014785+0000","last_peered":"2024-08-17T02:25:56.014785+0000","last_clean":"2024-08-17T02:25:56.014785+0000","last_became_active":"2024-08-17T02:25:54.999897+0000","last_became_peered":"2024-08-17T02:25:54.999897+0000","last_unstale":"2024-08-17T02:25:56.014785+0000","last_undegraded":"2024-08-17T02:25:56.014785+0000","last_fullsized":"2024-08-17T02:25:56.014785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:50:30.099680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.017625+0000","last_change":"2024-08-17T02:25:56.014989+0000","last_active":"2024-08-17T02:25:56.017625+0000","last_peered":"2024-08-17T02:25:56.017625+0000","last_clean":"2024-08-17T02:25:56.017625+0000","last_became_active":"2024-08-17T02:25:56.014310+0000","last_became_peered":"2024-08-17T02:25:56.014310+0000","last_unstale":"2024-08-17T02:25:56.017625+0000","last_undegraded":"2024-08-17T02:25:56.017625+0000","last_fullsized":"2024-08-17T02:25:56.017625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:00:15.232217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.014797+0000","last_change":"2024-08-17T02:25:55.000861+0000","last_active":"2024-08-17T02:25:56.014797+0000","last_peered":"2024-08-17T02:25:56.014797+0000","last_clean":"2024-08-17T02:25:56.014797+0000","last_became_active":"2024-08-17T02:25:55.000232+0000","last_became_peered":"2024-08-17T02:25:55.000232+0000","last_unstale":"2024-08-17T02:25:56.014797+0000","last_undegraded":"2024-08-17T02:25:56.014797+0000","last_fullsized":"2024-08-17T02:25:56.014797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:20.748382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.035617+0000","last_change":"2024-08-17T02:25:56.028629+0000","last_active":"2024-08-17T02:25:56.035617+0000","last_peered":"2024-08-17T02:25:56.035617+0000","last_clean":"2024-08-17T02:25:56.035617+0000","last_became_active":"2024-08-17T02:25:56.028325+0000","last_became_peered":"2024-08-17T02:25:56.028325+0000","last_unstale":"2024-08-17T02:25:56.035617+0000","last_undegraded":"2024-08-17T02:25:56.035617+0000","last_fullsized":"2024-08-17T02:25:56.035617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:42:23.855343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.023915+0000","last_change":"2024-08-17T02:25:54.999649+0000","last_active":"2024-08-17T02:25:56.023915+0000","last_peered":"2024-08-17T02:25:56.023915+0000","last_clean":"2024-08-17T02:25:56.023915+0000","last_became_active":"2024-08-17T02:25:54.995798+0000","last_became_peered":"2024-08-17T02:25:54.995798+0000","last_unstale":"2024-08-17T02:25:56.023915+0000","last_undegraded":"2024-08-17T02:25:56.023915+0000","last_fullsized":"2024-08-17T02:25:56.023915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:39.955144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.025289+0000","last_change":"2024-08-17T02:25:56.019288+0000","last_active":"2024-08-17T02:25:56.025289+0000","last_peered":"2024-08-17T02:25:56.025289+0000","last_clean":"2024-08-17T02:25:56.025289+0000","last_became_active":"2024-08-17T02:25:56.018798+0000","last_became_peered":"2024-08-17T02:25:56.018798+0000","last_unstale":"2024-08-17T02:25:56.025289+0000","last_undegraded":"2024-08-17T02:25:56.025289+0000","last_fullsized":"2024-08-17T02:25:56.025289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:07.584824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.022945+0000","last_change":"2024-08-17T02:25:54.995600+0000","last_active":"2024-08-17T02:25:56.022945+0000","last_peered":"2024-08-17T02:25:56.022945+0000","last_clean":"2024-08-17T02:25:56.022945+0000","last_became_active":"2024-08-17T02:25:54.994117+0000","last_became_peered":"2024-08-17T02:25:54.994117+0000","last_unstale":"2024-08-17T02:25:56.022945+0000","last_undegraded":"2024-08-17T02:25:56.022945+0000","last_fullsized":"2024-08-17T02:25:56.022945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:12.268531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.037841+0000","last_change":"2024-08-17T02:25:56.029058+0000","last_active":"2024-08-17T02:25:56.037841+0000","last_peered":"2024-08-17T02:25:56.037841+0000","last_clean":"2024-08-17T02:25:56.037841+0000","last_became_active":"2024-08-17T02:25:56.028723+0000","last_became_peered":"2024-08-17T02:25:56.028723+0000","last_unstale":"2024-08-17T02:25:56.037841+0000","last_undegraded":"2024-08-17T02:25:56.037841+0000","last_fullsized":"2024-08-17T02:25:56.037841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:19:28.379133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.018098+0000","last_change":"2024-08-17T02:25:55.000605+0000","last_active":"2024-08-17T02:25:56.018098+0000","last_peered":"2024-08-17T02:25:56.018098+0000","last_clean":"2024-08-17T02:25:56.018098+0000","last_became_active":"2024-08-17T02:25:55.000291+0000","last_became_peered":"2024-08-17T02:25:55.000291+0000","last_unstale":"2024-08-17T02:25:56.018098+0000","last_undegraded":"2024-08-17T02:25:56.018098+0000","last_fullsized":"2024-08-17T02:25:56.018098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:04.186628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.032284+0000","last_change":"2024-08-17T02:25:56.027086+0000","last_active":"2024-08-17T02:25:56.032284+0000","last_peered":"2024-08-17T02:25:56.032284+0000","last_clean":"2024-08-17T02:25:56.032284+0000","last_became_active":"2024-08-17T02:25:56.026817+0000","last_became_peered":"2024-08-17T02:25:56.026817+0000","last_unstale":"2024-08-17T02:25:56.032284+0000","last_undegraded":"2024-08-17T02:25:56.032284+0000","last_fullsized":"2024-08-17T02:25:56.032284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:11.672911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.023711+0000","last_change":"2024-08-17T02:25:55.004265+0000","last_active":"2024-08-17T02:25:56.023711+0000","last_peered":"2024-08-17T02:25:56.023711+0000","last_clean":"2024-08-17T02:25:56.023711+0000","last_became_active":"2024-08-17T02:25:55.003943+0000","last_became_peered":"2024-08-17T02:25:55.003943+0000","last_unstale":"2024-08-17T02:25:56.023711+0000","last_undegraded":"2024-08-17T02:25:56.023711+0000","last_fullsized":"2024-08-17T02:25:56.023711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:37.810570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044597+0000","last_change":"2024-08-17T02:25:56.042831+0000","last_active":"2024-08-17T02:25:56.044597+0000","last_peered":"2024-08-17T02:25:56.044597+0000","last_clean":"2024-08-17T02:25:56.044597+0000","last_became_active":"2024-08-17T02:25:56.042634+0000","last_became_peered":"2024-08-17T02:25:56.042634+0000","last_unstale":"2024-08-17T02:25:56.044597+0000","last_undegraded":"2024-08-17T02:25:56.044597+0000","last_fullsized":"2024-08-17T02:25:56.044597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:32.738921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.045124+0000","last_change":"2024-08-17T02:25:55.001866+0000","last_active":"2024-08-17T02:25:56.045124+0000","last_peered":"2024-08-17T02:25:56.045124+0000","last_clean":"2024-08-17T02:25:56.045124+0000","last_became_active":"2024-08-17T02:25:55.001524+0000","last_became_peered":"2024-08-17T02:25:55.001524+0000","last_unstale":"2024-08-17T02:25:56.045124+0000","last_undegraded":"2024-08-17T02:25:56.045124+0000","last_fullsized":"2024-08-17T02:25:56.045124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:00:14.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.032472+0000","last_change":"2024-08-17T02:25:56.028887+0000","last_active":"2024-08-17T02:25:56.032472+0000","last_peered":"2024-08-17T02:25:56.032472+0000","last_clean":"2024-08-17T02:25:56.032472+0000","last_became_active":"2024-08-17T02:25:56.028557+0000","last_became_peered":"2024-08-17T02:25:56.028557+0000","last_unstale":"2024-08-17T02:25:56.032472+0000","last_undegraded":"2024-08-17T02:25:56.032472+0000","last_fullsized":"2024-08-17T02:25:56.032472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:39.367618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.014668+0000","last_change":"2024-08-17T02:25:55.000105+0000","last_active":"2024-08-17T02:25:56.014668+0000","last_peered":"2024-08-17T02:25:56.014668+0000","last_clean":"2024-08-17T02:25:56.014668+0000","last_became_active":"2024-08-17T02:25:54.999581+0000","last_became_peered":"2024-08-17T02:25:54.999581+0000","last_unstale":"2024-08-17T02:25:56.014668+0000","last_undegraded":"2024-08-17T02:25:56.014668+0000","last_fullsized":"2024-08-17T02:25:56.014668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:14.229475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.028105+0000","last_change":"2024-08-17T02:25:56.018046+0000","last_active":"2024-08-17T02:25:56.028105+0000","last_peered":"2024-08-17T02:25:56.028105+0000","last_clean":"2024-08-17T02:25:56.028105+0000","last_became_active":"2024-08-17T02:25:56.016770+0000","last_became_peered":"2024-08-17T02:25:56.016770+0000","last_unstale":"2024-08-17T02:25:56.028105+0000","last_undegraded":"2024-08-17T02:25:56.028105+0000","last_fullsized":"2024-08-17T02:25:56.028105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:56.688493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.023115+0000","last_change":"2024-08-17T02:25:54.999172+0000","last_active":"2024-08-17T02:25:56.023115+0000","last_peered":"2024-08-17T02:25:56.023115+0000","last_clean":"2024-08-17T02:25:56.023115+0000","last_became_active":"2024-08-17T02:25:54.998807+0000","last_became_peered":"2024-08-17T02:25:54.998807+0000","last_unstale":"2024-08-17T02:25:56.023115+0000","last_undegraded":"2024-08-17T02:25:56.023115+0000","last_fullsized":"2024-08-17T02:25:56.023115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:25:59.640731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.032555+0000","last_change":"2024-08-17T02:25:56.028861+0000","last_active":"2024-08-17T02:25:56.032555+0000","last_peered":"2024-08-17T02:25:56.032555+0000","last_clean":"2024-08-17T02:25:56.032555+0000","last_became_active":"2024-08-17T02:25:56.028556+0000","last_became_peered":"2024-08-17T02:25:56.028556+0000","last_unstale":"2024-08-17T02:25:56.032555+0000","last_undegraded":"2024-08-17T02:25:56.032555+0000","last_fullsized":"2024-08-17T02:25:56.032555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:15.442494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.023347+0000","last_change":"2024-08-17T02:25:54.997943+0000","last_active":"2024-08-17T02:25:56.023347+0000","last_peered":"2024-08-17T02:25:56.023347+0000","last_clean":"2024-08-17T02:25:56.023347+0000","last_became_active":"2024-08-17T02:25:54.997169+0000","last_became_peered":"2024-08-17T02:25:54.997169+0000","last_unstale":"2024-08-17T02:25:56.023347+0000","last_undegraded":"2024-08-17T02:25:56.023347+0000","last_fullsized":"2024-08-17T02:25:56.023347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:06.575204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.026482+0000","last_change":"2024-08-17T02:25:56.021687+0000","last_active":"2024-08-17T02:25:56.026482+0000","last_peered":"2024-08-17T02:25:56.026482+0000","last_clean":"2024-08-17T02:25:56.026482+0000","last_became_active":"2024-08-17T02:25:56.020957+0000","last_became_peered":"2024-08-17T02:25:56.020957+0000","last_unstale":"2024-08-17T02:25:56.026482+0000","last_undegraded":"2024-08-17T02:25:56.026482+0000","last_fullsized":"2024-08-17T02:25:56.026482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:40.638494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044872+0000","last_change":"2024-08-17T02:25:54.999914+0000","last_active":"2024-08-17T02:25:56.044872+0000","last_peered":"2024-08-17T02:25:56.044872+0000","last_clean":"2024-08-17T02:25:56.044872+0000","last_became_active":"2024-08-17T02:25:54.999660+0000","last_became_peered":"2024-08-17T02:25:54.999660+0000","last_unstale":"2024-08-17T02:25:56.044872+0000","last_undegraded":"2024-08-17T02:25:56.044872+0000","last_fullsized":"2024-08-17T02:25:56.044872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:00:14.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.027375+0000","last_change":"2024-08-17T02:25:56.023133+0000","last_active":"2024-08-17T02:25:56.027375+0000","last_peered":"2024-08-17T02:25:56.027375+0000","last_clean":"2024-08-17T02:25:56.027375+0000","last_became_active":"2024-08-17T02:25:56.022831+0000","last_became_peered":"2024-08-17T02:25:56.022831+0000","last_unstale":"2024-08-17T02:25:56.027375+0000","last_undegraded":"2024-08-17T02:25:56.027375+0000","last_fullsized":"2024-08-17T02:25:56.027375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:08.877931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041005+0000","last_change":"2024-08-17T02:25:56.037053+0000","last_active":"2024-08-17T02:25:56.041005+0000","last_peered":"2024-08-17T02:25:56.041005+0000","last_clean":"2024-08-17T02:25:56.041005+0000","last_became_active":"2024-08-17T02:25:56.034842+0000","last_became_peered":"2024-08-17T02:25:56.034842+0000","last_unstale":"2024-08-17T02:25:56.041005+0000","last_undegraded":"2024-08-17T02:25:56.041005+0000","last_fullsized":"2024-08-17T02:25:56.041005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:35.583197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044916+0000","last_change":"2024-08-17T02:25:55.001827+0000","last_active":"2024-08-17T02:25:56.044916+0000","last_peered":"2024-08-17T02:25:56.044916+0000","last_clean":"2024-08-17T02:25:56.044916+0000","last_became_active":"2024-08-17T02:25:55.001554+0000","last_became_peered":"2024-08-17T02:25:55.001554+0000","last_unstale":"2024-08-17T02:25:56.044916+0000","last_undegraded":"2024-08-17T02:25:56.044916+0000","last_fullsized":"2024-08-17T02:25:56.044916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:28.545139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.034569+0000","last_change":"2024-08-17T02:25:56.025255+0000","last_active":"2024-08-17T02:25:56.034569+0000","last_peered":"2024-08-17T02:25:56.034569+0000","last_clean":"2024-08-17T02:25:56.034569+0000","last_became_active":"2024-08-17T02:25:56.023945+0000","last_became_peered":"2024-08-17T02:25:56.023945+0000","last_unstale":"2024-08-17T02:25:56.034569+0000","last_undegraded":"2024-08-17T02:25:56.034569+0000","last_fullsized":"2024-08-17T02:25:56.034569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:57.681709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044998+0000","last_change":"2024-08-17T02:25:55.003882+0000","last_active":"2024-08-17T02:25:56.044998+0000","last_peered":"2024-08-17T02:25:56.044998+0000","last_clean":"2024-08-17T02:25:56.044998+0000","last_became_active":"2024-08-17T02:25:55.003585+0000","last_became_peered":"2024-08-17T02:25:55.003585+0000","last_unstale":"2024-08-17T02:25:56.044998+0000","last_undegraded":"2024-08-17T02:25:56.044998+0000","last_fullsized":"2024-08-17T02:25:56.044998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:10.820465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041428+0000","last_change":"2024-08-17T02:25:56.036969+0000","last_active":"2024-08-17T02:25:56.041428+0000","last_peered":"2024-08-17T02:25:56.041428+0000","last_clean":"2024-08-17T02:25:56.041428+0000","last_became_active":"2024-08-17T02:25:56.036345+0000","last_became_peered":"2024-08-17T02:25:56.036345+0000","last_unstale":"2024-08-17T02:25:56.041428+0000","last_undegraded":"2024-08-17T02:25:56.041428+0000","last_fullsized":"2024-08-17T02:25:56.041428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:32.738921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041631+0000","last_change":"2024-08-17T02:25:54.995388+0000","last_active":"2024-08-17T02:25:56.041631+0000","last_peered":"2024-08-17T02:25:56.041631+0000","last_clean":"2024-08-17T02:25:56.041631+0000","last_became_active":"2024-08-17T02:25:54.994967+0000","last_became_peered":"2024-08-17T02:25:54.994967+0000","last_unstale":"2024-08-17T02:25:56.041631+0000","last_undegraded":"2024-08-17T02:25:56.041631+0000","last_fullsized":"2024-08-17T02:25:56.041631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:14.842533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.029964+0000","last_change":"2024-08-17T02:25:56.026659+0000","last_active":"2024-08-17T02:25:56.029964+0000","last_peered":"2024-08-17T02:25:56.029964+0000","last_clean":"2024-08-17T02:25:56.029964+0000","last_became_active":"2024-08-17T02:25:56.026321+0000","last_became_peered":"2024-08-17T02:25:56.026321+0000","last_unstale":"2024-08-17T02:25:56.029964+0000","last_undegraded":"2024-08-17T02:25:56.029964+0000","last_fullsized":"2024-08-17T02:25:56.029964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:54.730677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.048379+0000","last_change":"2024-08-17T02:25:55.001847+0000","last_active":"2024-08-17T02:25:56.048379+0000","last_peered":"2024-08-17T02:25:56.048379+0000","last_clean":"2024-08-17T02:25:56.048379+0000","last_became_active":"2024-08-17T02:25:55.001518+0000","last_became_peered":"2024-08-17T02:25:55.001518+0000","last_unstale":"2024-08-17T02:25:56.048379+0000","last_undegraded":"2024-08-17T02:25:56.048379+0000","last_fullsized":"2024-08-17T02:25:56.048379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:14.842533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":811008,"data_stored":664727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":75341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":73879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]}]},{"osd":4,"up_from":14,"seq":60129542147,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":225280,"data_stored":73915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":75341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":212992,"data_stored":73789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":221184,"data_stored":73949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298164,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073676,"statfs":{"total":96636764160,"available":96331444224,"internally_reserved":0,"allocated":819200,"data_stored":664783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:03.709 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:26:03.709 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:26:03.709 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:26:03.710 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:26:03.710 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:26:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f5032727700 1 Processor -- start 2024-08-17T02:26:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f5032727700 1 -- start start 2024-08-17T02:26:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f5032727700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f502c0ccd30 0x7f502c0ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f5032727700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f502c0ceb00 0x7f502c0c5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f5032727700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502c0cef60 con 0x7f502c0b26d0 2024-08-17T02:26:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f5032727700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502c0cb670 con 0x7f502c0ccd30 2024-08-17T02:26:03.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f5032727700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502c0cb8d0 con 0x7f502c0ceb00 2024-08-17T02:26:03.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f502b7fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f502c0ccd30 0x7f502c0ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f502b7fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f502c0ccd30 0x7f502c0ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44102/0 (socket says 172.21.15.102:44102) 2024-08-17T02:26:03.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f502bfff700 1 --1- 172.21.15.102:0/762500122 >> v1:172.21.15.121:6789/0 conn(0x7f502c0b26d0 0x7f502c0caf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:37424/0 (socket says 172.21.15.102:37424) 2024-08-17T02:26:03.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f502b7fe700 1 -- 172.21.15.102:0/762500122 learned_addr learned my addr 172.21.15.102:0/762500122 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:03.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f5030cc4700 1 --2- 172.21.15.102:0/762500122 >> v2:172.21.15.121:3300/0 conn(0x7f502c0ceb00 0x7f502c0c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f502b7fe700 1 -- 172.21.15.102:0/762500122 >> v2:172.21.15.121:3300/0 conn(0x7f502c0ceb00 msgr2=0x7f502c0c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:03.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f502b7fe700 1 --2- 172.21.15.102:0/762500122 >> v2:172.21.15.121:3300/0 conn(0x7f502c0ceb00 0x7f502c0c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f502b7fe700 1 -- 172.21.15.102:0/762500122 >> v1:172.21.15.121:6789/0 conn(0x7f502c0b26d0 legacy=0x7f502c0caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f502b7fe700 1 -- 172.21.15.102:0/762500122 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c0cbbb0 con 0x7f502c0ccd30 2024-08-17T02:26:03.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f502b7fe700 1 --2- 172.21.15.102:0/762500122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f502c0ccd30 0x7f502c0ce5c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f502c089140 tx=0x7f5020009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f66f1f68194dfae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:03.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f502affd700 1 -- 172.21.15.102:0/762500122 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020009e70 con 0x7f502c0ccd30 2024-08-17T02:26:03.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f502affd700 1 -- 172.21.15.102:0/762500122 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502000b8f0 con 0x7f502c0ccd30 2024-08-17T02:26:03.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.813+0000 7f502affd700 1 -- 172.21.15.102:0/762500122 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502000bc90 con 0x7f502c0ccd30 2024-08-17T02:26:03.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5032727700 1 -- 172.21.15.102:0/762500122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f502c0ccd30 msgr2=0x7f502c0ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5032727700 1 --2- 172.21.15.102:0/762500122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f502c0ccd30 0x7f502c0ce5c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f502c089140 tx=0x7f5020009250 comp rx=0 tx=0).stop 2024-08-17T02:26:03.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5032727700 1 -- 172.21.15.102:0/762500122 shutdown_connections 2024-08-17T02:26:03.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5032727700 1 --2- 172.21.15.102:0/762500122 >> v2:172.21.15.121:3300/0 conn(0x7f502c0ceb00 0x7f502c0c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5032727700 1 --2- 172.21.15.102:0/762500122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f502c0ccd30 0x7f502c0ce5c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5032727700 1 -- 172.21.15.102:0/762500122 >> 172.21.15.102:0/762500122 conn(0x7f502c0994f0 msgr2=0x7f502c067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:03.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5032727700 1 -- 172.21.15.102:0/762500122 shutdown_connections 2024-08-17T02:26:03.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5032727700 1 -- 172.21.15.102:0/762500122 wait complete. 2024-08-17T02:26:03.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5032727700 1 Processor -- start 2024-08-17T02:26:03.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5032727700 1 -- start start 2024-08-17T02:26:03.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5032727700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f502c0b26d0 0x7f502c156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5032727700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f502c0ccd30 0x7f502c09a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5032727700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f502c0ceb00 0x7f502c09a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5032727700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502c0c8e90 con 0x7f502c0b26d0 2024-08-17T02:26:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5032727700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502c0c8560 con 0x7f502c0ccd30 2024-08-17T02:26:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5032727700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502c0c8840 con 0x7f502c0ceb00 2024-08-17T02:26:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f502bfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f502c0b26d0 0x7f502c156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f502b7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f502c0ccd30 0x7f502c09a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f5030cc4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f502c0ceb00 0x7f502c09a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f502b7fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f502c0ccd30 0x7f502c09a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:53058/0 (socket says 172.21.15.102:53058) 2024-08-17T02:26:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.817+0000 7f502b7fe700 1 -- 172.21.15.102:0/3132851197 learned_addr learned my addr 172.21.15.102:0/3132851197 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.821+0000 7f502b7fe700 1 -- 172.21.15.102:0/3132851197 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f502c0ceb00 msgr2=0x7f502c09a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.821+0000 7f502b7fe700 1 --2- 172.21.15.102:0/3132851197 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f502c0ceb00 0x7f502c09a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.821+0000 7f502b7fe700 1 -- 172.21.15.102:0/3132851197 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f502c0b26d0 msgr2=0x7f502c156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.821+0000 7f502b7fe700 1 --2- 172.21.15.102:0/3132851197 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f502c0b26d0 0x7f502c156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.821+0000 7f502b7fe700 1 -- 172.21.15.102:0/3132851197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50200094f0 con 0x7f502c0ccd30 2024-08-17T02:26:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.821+0000 7f5030cc4700 1 --2- 172.21.15.102:0/3132851197 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f502c0ceb00 0x7f502c09a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.821+0000 7f502b7fe700 1 --2- 172.21.15.102:0/3132851197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f502c0ccd30 0x7f502c09a3a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f502c088be0 tx=0x7f5020017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.821+0000 7f5013fff700 1 -- 172.21.15.102:0/3132851197 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502000bc70 con 0x7f502c0ccd30 2024-08-17T02:26:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.821+0000 7f5013fff700 1 -- 172.21.15.102:0/3132851197 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5020024440 con 0x7f502c0ccd30 2024-08-17T02:26:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.821+0000 7f5032727700 1 -- 172.21.15.102:0/3132851197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502c0c8b20 con 0x7f502c0ccd30 2024-08-17T02:26:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.821+0000 7f5013fff700 1 -- 172.21.15.102:0/3132851197 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50200247c0 con 0x7f502c0ccd30 2024-08-17T02:26:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.821+0000 7f5032727700 1 -- 172.21.15.102:0/3132851197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502c0b4b70 con 0x7f502c0ccd30 2024-08-17T02:26:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.821+0000 7f5032727700 1 -- 172.21.15.102:0/3132851197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502c0c9000 con 0x7f502c0ccd30 2024-08-17T02:26:03.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.821+0000 7f5013fff700 1 -- 172.21.15.102:0/3132851197 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f502001a420 con 0x7f502c0ccd30 2024-08-17T02:26:03.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.821+0000 7f5013fff700 1 --2- 172.21.15.102:0/3132851197 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5018060860 0x7f5018062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.825+0000 7f5013fff700 1 -- 172.21.15.102:0/3132851197 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f502007e990 con 0x7f502c0ccd30 2024-08-17T02:26:03.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.825+0000 7f502bfff700 1 --2- 172.21.15.102:0/3132851197 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5018060860 0x7f5018062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.825+0000 7f502bfff700 1 --2- 172.21.15.102:0/3132851197 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5018060860 0x7f5018062d10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f502c0c7ee0 tx=0x7f5024001ad0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:03.837+0000 7f5013fff700 1 -- 172.21.15.102:0/3132851197 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f502004ede0 con 0x7f502c0ccd30 2024-08-17T02:26:04.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.041+0000 7f5032727700 1 -- 172.21.15.102:0/3132851197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f502c0c8cb0 con 0x7f502c0ccd30 2024-08-17T02:26:04.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.049+0000 7f5013fff700 1 -- 172.21.15.102:0/3132851197 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+154540 (secure 0 0 0) 0x7f5020015020 con 0x7f502c0ccd30 2024-08-17T02:26:04.052 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:04.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.049+0000 7f5032727700 1 -- 172.21.15.102:0/3132851197 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5018060860 msgr2=0x7f5018062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.049+0000 7f5032727700 1 --2- 172.21.15.102:0/3132851197 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5018060860 0x7f5018062d10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f502c0c7ee0 tx=0x7f5024001ad0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.049+0000 7f5032727700 1 -- 172.21.15.102:0/3132851197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f502c0ccd30 msgr2=0x7f502c09a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.049+0000 7f5032727700 1 --2- 172.21.15.102:0/3132851197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f502c0ccd30 0x7f502c09a3a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f502c088be0 tx=0x7f5020017000 comp rx=0 tx=0).stop 2024-08-17T02:26:04.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.049+0000 7f5032727700 1 -- 172.21.15.102:0/3132851197 shutdown_connections 2024-08-17T02:26:04.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.049+0000 7f5032727700 1 --2- 172.21.15.102:0/3132851197 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5018060860 0x7f5018062d10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.049+0000 7f5032727700 1 --2- 172.21.15.102:0/3132851197 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f502c0ceb00 0x7f502c09a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.049+0000 7f5032727700 1 --2- 172.21.15.102:0/3132851197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f502c0ccd30 0x7f502c09a3a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.049+0000 7f5032727700 1 --2- 172.21.15.102:0/3132851197 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f502c0b26d0 0x7f502c156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.049+0000 7f5032727700 1 -- 172.21.15.102:0/3132851197 >> 172.21.15.102:0/3132851197 conn(0x7f502c0994f0 msgr2=0x7f502c0c64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.049+0000 7f5032727700 1 -- 172.21.15.102:0/3132851197 shutdown_connections 2024-08-17T02:26:04.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.049+0000 7f5032727700 1 -- 172.21.15.102:0/3132851197 wait complete. 2024-08-17T02:26:04.066 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":24139},{"type":"v1","addr":"172.21.15.102:6833","nonce":24139}]},"active_addr":"172.21.15.102:6833/24139","active_change":"2024-08-17T02:25:43.161092+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4123,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":967686898}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":637972546}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":2804494579}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":2896812033}]}]} 2024-08-17T02:26:04.070 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:26:04.070 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:26:04.070 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:04.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa563d6700 1 Processor -- start 2024-08-17T02:26:04.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa563d6700 1 -- start start 2024-08-17T02:26:04.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa563d6700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7faa50142860 0x7faa5006e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa563d6700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa500b2220 con 0x7faa50142c30 2024-08-17T02:26:04.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa563d6700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa500b2500 con 0x7faa5006f2d0 2024-08-17T02:26:04.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa563d6700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa50159790 con 0x7faa50142860 2024-08-17T02:26:04.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa54bd3700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7faa50142c30 0x7faa500b0e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57488/0 (socket says 172.21.15.102:57488) 2024-08-17T02:26:04.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa54bd3700 1 -- 172.21.15.102:0/3335492911 learned_addr learned my addr 172.21.15.102:0/3335492911 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:04.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa553d4700 1 --2- 172.21.15.102:0/3335492911 >> v2:172.21.15.121:3300/0 conn(0x7faa50142860 0x7faa5006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 -- 172.21.15.102:0/3335492911 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748623509 0 0) 0x7faa500b2220 con 0x7faa50142c30 2024-08-17T02:26:04.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 -- 172.21.15.102:0/3335492911 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa38003570 con 0x7faa50142c30 2024-08-17T02:26:04.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 -- 172.21.15.102:0/3335492911 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170564202 0 0) 0x7faa500b2500 con 0x7faa5006f2d0 2024-08-17T02:26:04.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 -- 172.21.15.102:0/3335492911 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa500b2220 con 0x7faa5006f2d0 2024-08-17T02:26:04.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 -- 172.21.15.102:0/3335492911 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1431221899 0 0) 0x7faa38003570 con 0x7faa50142c30 2024-08-17T02:26:04.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 -- 172.21.15.102:0/3335492911 >> v2:172.21.15.121:3300/0 conn(0x7faa50142860 msgr2=0x7faa5006e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 --2- 172.21.15.102:0/3335492911 >> v2:172.21.15.121:3300/0 conn(0x7faa50142860 0x7faa5006e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 -- 172.21.15.102:0/3335492911 >> v1:172.21.15.121:6789/0 conn(0x7faa5006f2d0 legacy=0x7faa500b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 -- 172.21.15.102:0/3335492911 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500b27e0 con 0x7faa50142c30 2024-08-17T02:26:04.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 -- 172.21.15.102:0/3335492911 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7faa44001470 con 0x7faa50142c30 2024-08-17T02:26:04.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa553d4700 1 --2- 172.21.15.102:0/3335492911 >> v2:172.21.15.121:3300/0 conn(0x7faa50142860 0x7faa5006e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:04.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 -- 172.21.15.102:0/3335492911 >> v1:172.21.15.102:6789/0 conn(0x7faa50142c30 legacy=0x7faa500b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 --2- 172.21.15.102:0/3335492911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa38003bf0 0x7faa38003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 --2- 172.21.15.102:0/3335492911 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa38004810 0x7faa38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 --2- 172.21.15.102:0/3335492911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa380051c0 0x7faa3800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 -- 172.21.15.102:0/3335492911 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa50159790 con 0x7faa38003bf0 2024-08-17T02:26:04.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 -- 172.21.15.102:0/3335492911 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3800c0b0 con 0x7faa380051c0 2024-08-17T02:26:04.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa553d4700 1 --2- 172.21.15.102:0/3335492911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa38003bf0 0x7faa38003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa4ffff700 1 -- 172.21.15.102:0/3335492911 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3800c270 con 0x7faa38004810 2024-08-17T02:26:04.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.169+0000 7faa54bd3700 1 --2- 172.21.15.102:0/3335492911 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa38004810 0x7faa38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa55bd5700 1 --2- 172.21.15.102:0/3335492911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa380051c0 0x7faa3800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa553d4700 1 -- 172.21.15.102:0/3335492911 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa38004810 msgr2=0x7faa38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa553d4700 1 --2- 172.21.15.102:0/3335492911 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa38004810 0x7faa38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa553d4700 1 -- 172.21.15.102:0/3335492911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa380051c0 msgr2=0x7faa3800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa553d4700 1 --2- 172.21.15.102:0/3335492911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa380051c0 0x7faa3800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa553d4700 1 -- 172.21.15.102:0/3335492911 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38003570 con 0x7faa38003bf0 2024-08-17T02:26:04.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa55bd5700 1 -- 172.21.15.102:0/3335492911 reap_dead start 2024-08-17T02:26:04.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa553d4700 1 --2- 172.21.15.102:0/3335492911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa38003bf0 0x7faa38003fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa40009df0 tx=0x7faa400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2192c5efd38395 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa4ffff700 1 -- 172.21.15.102:0/3335492911 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40009740 con 0x7faa38003bf0 2024-08-17T02:26:04.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa4ffff700 1 -- 172.21.15.102:0/3335492911 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4000e920 con 0x7faa38003bf0 2024-08-17T02:26:04.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa4ffff700 1 -- 172.21.15.102:0/3335492911 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4000ece0 con 0x7faa38003bf0 2024-08-17T02:26:04.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa563d6700 1 -- 172.21.15.102:0/3335492911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa38003bf0 msgr2=0x7faa38003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa563d6700 1 --2- 172.21.15.102:0/3335492911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa38003bf0 0x7faa38003fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa40009df0 tx=0x7faa400091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa563d6700 1 -- 172.21.15.102:0/3335492911 shutdown_connections 2024-08-17T02:26:04.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa563d6700 1 --2- 172.21.15.102:0/3335492911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa38003bf0 0x7faa38003fe0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa563d6700 1 -- 172.21.15.102:0/3335492911 >> 172.21.15.102:0/3335492911 conn(0x7faa500ca2b0 msgr2=0x7faa5006e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa563d6700 1 -- 172.21.15.102:0/3335492911 shutdown_connections 2024-08-17T02:26:04.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.173+0000 7faa563d6700 1 -- 172.21.15.102:0/3335492911 wait complete. 2024-08-17T02:26:04.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa563d6700 1 Processor -- start 2024-08-17T02:26:04.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa563d6700 1 -- start start 2024-08-17T02:26:04.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa563d6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa38003bf0 0x7faa500ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa563d6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa500ac9e0 0x7faa50169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa563d6700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa50158980 0x7faa500c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa563d6700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa500a96a0 con 0x7faa500ac9e0 2024-08-17T02:26:04.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa563d6700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa500ac550 con 0x7faa38003bf0 2024-08-17T02:26:04.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa563d6700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5016a1e0 con 0x7faa50158980 2024-08-17T02:26:04.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa54bd3700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa500ac9e0 0x7faa50169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa54bd3700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa500ac9e0 0x7faa50169ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44120/0 (socket says 172.21.15.102:44120) 2024-08-17T02:26:04.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa54bd3700 1 -- 172.21.15.102:0/3019720723 learned_addr learned my addr 172.21.15.102:0/3019720723 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:04.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa553d4700 1 --2- 172.21.15.102:0/3019720723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa38003bf0 0x7faa500ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa55bd5700 1 --2- 172.21.15.102:0/3019720723 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa50158980 0x7faa500c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa54bd3700 1 -- 172.21.15.102:0/3019720723 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa50158980 msgr2=0x7faa500c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa54bd3700 1 --2- 172.21.15.102:0/3019720723 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa50158980 0x7faa500c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa54bd3700 1 -- 172.21.15.102:0/3019720723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa38003bf0 msgr2=0x7faa500ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa54bd3700 1 --2- 172.21.15.102:0/3019720723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa38003bf0 0x7faa500ab340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa54bd3700 1 -- 172.21.15.102:0/3019720723 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500ace30 con 0x7faa500ac9e0 2024-08-17T02:26:04.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa553d4700 1 --2- 172.21.15.102:0/3019720723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa38003bf0 0x7faa500ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:04.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.177+0000 7faa55bd5700 1 --2- 172.21.15.102:0/3019720723 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa50158980 0x7faa500c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:04.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.181+0000 7faa54bd3700 1 --2- 172.21.15.102:0/3019720723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa500ac9e0 0x7faa50169ca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faa44000fd0 tx=0x7faa44001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.181+0000 7faa4d7fa700 1 -- 172.21.15.102:0/3019720723 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44018030 con 0x7faa500ac9e0 2024-08-17T02:26:04.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.181+0000 7faa4d7fa700 1 -- 172.21.15.102:0/3019720723 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa440077d0 con 0x7faa500ac9e0 2024-08-17T02:26:04.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.181+0000 7faa563d6700 1 -- 172.21.15.102:0/3019720723 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa500ab940 con 0x7faa500ac9e0 2024-08-17T02:26:04.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.181+0000 7faa4d7fa700 1 -- 172.21.15.102:0/3019720723 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4400fb00 con 0x7faa500ac9e0 2024-08-17T02:26:04.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.181+0000 7faa563d6700 1 -- 172.21.15.102:0/3019720723 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa500abf00 con 0x7faa500ac9e0 2024-08-17T02:26:04.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.181+0000 7faa563d6700 1 -- 172.21.15.102:0/3019720723 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa500ac6e0 con 0x7faa500ac9e0 2024-08-17T02:26:04.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.181+0000 7faa4d7fa700 1 -- 172.21.15.102:0/3019720723 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7faa4401b070 con 0x7faa500ac9e0 2024-08-17T02:26:04.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.185+0000 7faa4d7fa700 1 --2- 172.21.15.102:0/3019720723 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7faa3c060860 0x7faa3c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.185+0000 7faa553d4700 1 --2- 172.21.15.102:0/3019720723 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7faa3c060860 0x7faa3c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.185+0000 7faa4d7fa700 1 -- 172.21.15.102:0/3019720723 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa44019070 con 0x7faa500ac9e0 2024-08-17T02:26:04.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.185+0000 7faa553d4700 1 --2- 172.21.15.102:0/3019720723 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7faa3c060860 0x7faa3c062d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faa400091e0 tx=0x7faa4001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.189+0000 7faa4d7fa700 1 -- 172.21.15.102:0/3019720723 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7faa4404cec0 con 0x7faa500ac9e0 2024-08-17T02:26:04.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.353+0000 7faa563d6700 1 -- 172.21.15.102:0/3019720723 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa500acfc0 con 0x7faa500ac9e0 2024-08-17T02:26:04.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.357+0000 7faa4d7fa700 1 -- 172.21.15.102:0/3019720723 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7faa440504e0 con 0x7faa500ac9e0 2024-08-17T02:26:04.359 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:04.359 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:57.002263+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:53.562223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:54.343618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:04.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.361+0000 7faa563d6700 1 -- 172.21.15.102:0/3019720723 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7faa3c060860 msgr2=0x7faa3c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.361+0000 7faa563d6700 1 --2- 172.21.15.102:0/3019720723 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7faa3c060860 0x7faa3c062d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faa400091e0 tx=0x7faa4001a000 comp rx=0 tx=0).stop 2024-08-17T02:26:04.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.361+0000 7faa563d6700 1 -- 172.21.15.102:0/3019720723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa500ac9e0 msgr2=0x7faa50169ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.361+0000 7faa563d6700 1 --2- 172.21.15.102:0/3019720723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa500ac9e0 0x7faa50169ca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faa44000fd0 tx=0x7faa44001e10 comp rx=0 tx=0).stop 2024-08-17T02:26:04.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.361+0000 7faa563d6700 1 -- 172.21.15.102:0/3019720723 shutdown_connections 2024-08-17T02:26:04.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.361+0000 7faa563d6700 1 --2- 172.21.15.102:0/3019720723 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7faa3c060860 0x7faa3c062d10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.361+0000 7faa563d6700 1 --2- 172.21.15.102:0/3019720723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa500ac9e0 0x7faa50169ca0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.361+0000 7faa563d6700 1 --2- 172.21.15.102:0/3019720723 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa50158980 0x7faa500c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.361+0000 7faa563d6700 1 --2- 172.21.15.102:0/3019720723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa38003bf0 0x7faa500ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.361+0000 7faa563d6700 1 -- 172.21.15.102:0/3019720723 >> 172.21.15.102:0/3019720723 conn(0x7faa500ca2b0 msgr2=0x7faa50141480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.361+0000 7faa563d6700 1 -- 172.21.15.102:0/3019720723 shutdown_connections 2024-08-17T02:26:04.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.361+0000 7faa563d6700 1 -- 172.21.15.102:0/3019720723 wait complete. 2024-08-17T02:26:04.379 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:26:04.379 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:04.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae3370700 1 Processor -- start 2024-08-17T02:26:04.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae3370700 1 -- start start 2024-08-17T02:26:04.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae3370700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7adc0ace80 0x7f7adc157350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae3370700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7adc0adf50 con 0x7f7adc157890 2024-08-17T02:26:04.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae3370700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7adc0ad340 con 0x7f7adc156f80 2024-08-17T02:26:04.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae3370700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7adc0ad620 con 0x7f7adc0ace80 2024-08-17T02:26:04.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae190d700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f7adc157890 0x7f7adc0aab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57498/0 (socket says 172.21.15.102:57498) 2024-08-17T02:26:04.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae190d700 1 -- 172.21.15.102:0/1304472030 learned_addr learned my addr 172.21.15.102:0/1304472030 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:04.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae090b700 1 --2- 172.21.15.102:0/1304472030 >> v2:172.21.15.121:3300/0 conn(0x7f7adc0ace80 0x7f7adc157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ad3fff700 1 -- 172.21.15.102:0/1304472030 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266800068 0 0) 0x7f7adc0adf50 con 0x7f7adc157890 2024-08-17T02:26:04.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ad3fff700 1 -- 172.21.15.102:0/1304472030 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ac8003570 con 0x7f7adc157890 2024-08-17T02:26:04.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ad3fff700 1 -- 172.21.15.102:0/1304472030 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2650320145 0 0) 0x7f7ac8003570 con 0x7f7adc157890 2024-08-17T02:26:04.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ad3fff700 1 -- 172.21.15.102:0/1304472030 >> v2:172.21.15.121:3300/0 conn(0x7f7adc0ace80 msgr2=0x7f7adc157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ad3fff700 1 --2- 172.21.15.102:0/1304472030 >> v2:172.21.15.121:3300/0 conn(0x7f7adc0ace80 0x7f7adc157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ad3fff700 1 -- 172.21.15.102:0/1304472030 >> v1:172.21.15.121:6789/0 conn(0x7f7adc156f80 legacy=0x7f7adc0ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ad3fff700 1 -- 172.21.15.102:0/1304472030 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc0ad900 con 0x7f7adc157890 2024-08-17T02:26:04.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ad3fff700 1 -- 172.21.15.102:0/1304472030 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7f7ad40017f0 con 0x7f7adc157890 2024-08-17T02:26:04.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ad3fff700 1 -- 172.21.15.102:0/1304472030 >> v1:172.21.15.102:6789/0 conn(0x7f7adc157890 legacy=0x7f7adc0aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ad3fff700 1 --2- 172.21.15.102:0/1304472030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ac8003a90 0x7f7ac8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ad3fff700 1 --2- 172.21.15.102:0/1304472030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ac8004810 0x7f7ac8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ad3fff700 1 --2- 172.21.15.102:0/1304472030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ac80051c0 0x7f7ac800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ad3fff700 1 -- 172.21.15.102:0/1304472030 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0ad620 con 0x7f7ac8004810 2024-08-17T02:26:04.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ad3fff700 1 -- 172.21.15.102:0/1304472030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac800c0b0 con 0x7f7ac80051c0 2024-08-17T02:26:04.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ad3fff700 1 -- 172.21.15.102:0/1304472030 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac800c270 con 0x7f7ac8003a90 2024-08-17T02:26:04.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae090b700 1 --2- 172.21.15.102:0/1304472030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ac8004810 0x7f7ac8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae190d700 1 --2- 172.21.15.102:0/1304472030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ac80051c0 0x7f7ac800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae110c700 1 --2- 172.21.15.102:0/1304472030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ac8003a90 0x7f7ac8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae090b700 1 -- 172.21.15.102:0/1304472030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ac8003a90 msgr2=0x7f7ac8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae090b700 1 --2- 172.21.15.102:0/1304472030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ac8003a90 0x7f7ac8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae090b700 1 -- 172.21.15.102:0/1304472030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ac80051c0 msgr2=0x7f7ac800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae090b700 1 --2- 172.21.15.102:0/1304472030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ac80051c0 0x7f7ac800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae190d700 1 -- 172.21.15.102:0/1304472030 reap_dead start 2024-08-17T02:26:04.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae090b700 1 -- 172.21.15.102:0/1304472030 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac8003570 con 0x7f7ac8004810 2024-08-17T02:26:04.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae110c700 1 --2- 172.21.15.102:0/1304472030 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7ac8003a90 0x7f7ac8003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:04.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.485+0000 7f7ae090b700 1 --2- 172.21.15.102:0/1304472030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ac8004810 0x7f7ac8004c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0ad270 tx=0x7f7acc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97b0f0bb6489afb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.489+0000 7f7ad3fff700 1 -- 172.21.15.102:0/1304472030 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00e710 con 0x7f7ac8004810 2024-08-17T02:26:04.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.489+0000 7f7ad3fff700 1 -- 172.21.15.102:0/1304472030 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc00e870 con 0x7f7ac8004810 2024-08-17T02:26:04.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.489+0000 7f7ad3fff700 1 -- 172.21.15.102:0/1304472030 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00ec30 con 0x7f7ac8004810 2024-08-17T02:26:04.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.489+0000 7f7ae3370700 1 -- 172.21.15.102:0/1304472030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ac8004810 msgr2=0x7f7ac8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.489+0000 7f7ae3370700 1 --2- 172.21.15.102:0/1304472030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ac8004810 0x7f7ac8004c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0ad270 tx=0x7f7acc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.489+0000 7f7ae3370700 1 -- 172.21.15.102:0/1304472030 shutdown_connections 2024-08-17T02:26:04.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.489+0000 7f7ae3370700 1 --2- 172.21.15.102:0/1304472030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ac8004810 0x7f7ac8004c80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.489+0000 7f7ae3370700 1 -- 172.21.15.102:0/1304472030 >> 172.21.15.102:0/1304472030 conn(0x7f7adc066e00 msgr2=0x7f7adc067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.489+0000 7f7ae3370700 1 -- 172.21.15.102:0/1304472030 shutdown_connections 2024-08-17T02:26:04.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.489+0000 7f7ae3370700 1 -- 172.21.15.102:0/1304472030 wait complete. 2024-08-17T02:26:04.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae3370700 1 Processor -- start 2024-08-17T02:26:04.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae3370700 1 -- start start 2024-08-17T02:26:04.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae3370700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ac8004810 0x7f7adc13eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae3370700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7adc158be0 0x7f7adc06d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae3370700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7adc159050 0x7f7adc06d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae3370700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc15a100 con 0x7f7ac8004810 2024-08-17T02:26:04.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae3370700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc159580 con 0x7f7adc158be0 2024-08-17T02:26:04.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae3370700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc159860 con 0x7f7adc159050 2024-08-17T02:26:04.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae110c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ac8004810 0x7f7adc13eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae110c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ac8004810 0x7f7adc13eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44144/0 (socket says 172.21.15.102:44144) 2024-08-17T02:26:04.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae110c700 1 -- 172.21.15.102:0/4223039111 learned_addr learned my addr 172.21.15.102:0/4223039111 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:04.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae090b700 1 --2- 172.21.15.102:0/4223039111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7adc158be0 0x7f7adc06d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae190d700 1 --2- 172.21.15.102:0/4223039111 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7adc159050 0x7f7adc06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae110c700 1 -- 172.21.15.102:0/4223039111 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7adc159050 msgr2=0x7f7adc06d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae110c700 1 --2- 172.21.15.102:0/4223039111 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7adc159050 0x7f7adc06d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae110c700 1 -- 172.21.15.102:0/4223039111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7adc158be0 msgr2=0x7f7adc06d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae110c700 1 --2- 172.21.15.102:0/4223039111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7adc158be0 0x7f7adc06d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae110c700 1 -- 172.21.15.102:0/4223039111 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc159b40 con 0x7f7ac8004810 2024-08-17T02:26:04.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae110c700 1 --2- 172.21.15.102:0/4223039111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ac8004810 0x7f7adc13eff0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8007880 tx=0x7f7ad8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ad17fa700 1 -- 172.21.15.102:0/4223039111 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8010520 con 0x7f7ac8004810 2024-08-17T02:26:04.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ad17fa700 1 -- 172.21.15.102:0/4223039111 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad8010680 con 0x7f7ac8004810 2024-08-17T02:26:04.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae3370700 1 -- 172.21.15.102:0/4223039111 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7adc159e20 con 0x7f7ac8004810 2024-08-17T02:26:04.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ad17fa700 1 -- 172.21.15.102:0/4223039111 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8010a00 con 0x7f7ac8004810 2024-08-17T02:26:04.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.493+0000 7f7ae3370700 1 -- 172.21.15.102:0/4223039111 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7adc153100 con 0x7f7ac8004810 2024-08-17T02:26:04.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.497+0000 7f7ae3370700 1 -- 172.21.15.102:0/4223039111 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7adc0645c0 con 0x7f7ac8004810 2024-08-17T02:26:04.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.497+0000 7f7ad17fa700 1 -- 172.21.15.102:0/4223039111 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7ad8014480 con 0x7f7ac8004810 2024-08-17T02:26:04.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.497+0000 7f7ad17fa700 1 --2- 172.21.15.102:0/4223039111 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7ac0060890 0x7f7ac0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.497+0000 7f7ae090b700 1 --2- 172.21.15.102:0/4223039111 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7ac0060890 0x7f7ac0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.497+0000 7f7ad17fa700 1 -- 172.21.15.102:0/4223039111 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7ad807c5b0 con 0x7f7ac8004810 2024-08-17T02:26:04.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.497+0000 7f7ae090b700 1 --2- 172.21.15.102:0/4223039111 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7ac0060890 0x7f7ac0062d40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0091e0 tx=0x7f7acc01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.505+0000 7f7ad17fa700 1 -- 172.21.15.102:0/4223039111 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7ad804cab0 con 0x7f7ac8004810 2024-08-17T02:26:04.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.665+0000 7f7ae3370700 1 -- 172.21.15.102:0/4223039111 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7adc069720 con 0x7f7ac8004810 2024-08-17T02:26:04.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.669+0000 7f7ad17fa700 1 -- 172.21.15.102:0/4223039111 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f7ad8019090 con 0x7f7ac8004810 2024-08-17T02:26:04.671 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:04.671 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:57.002263+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:53.562223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:54.343618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:04.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.673+0000 7f7ae3370700 1 -- 172.21.15.102:0/4223039111 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7ac0060890 msgr2=0x7f7ac0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.673+0000 7f7ae3370700 1 --2- 172.21.15.102:0/4223039111 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7ac0060890 0x7f7ac0062d40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0091e0 tx=0x7f7acc01a000 comp rx=0 tx=0).stop 2024-08-17T02:26:04.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.673+0000 7f7ae3370700 1 -- 172.21.15.102:0/4223039111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ac8004810 msgr2=0x7f7adc13eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.673+0000 7f7ae3370700 1 --2- 172.21.15.102:0/4223039111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ac8004810 0x7f7adc13eff0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8007880 tx=0x7f7ad8009040 comp rx=0 tx=0).stop 2024-08-17T02:26:04.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.673+0000 7f7ae3370700 1 -- 172.21.15.102:0/4223039111 shutdown_connections 2024-08-17T02:26:04.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.673+0000 7f7ae3370700 1 --2- 172.21.15.102:0/4223039111 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7ac0060890 0x7f7ac0062d40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.673+0000 7f7ae3370700 1 --2- 172.21.15.102:0/4223039111 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7adc159050 0x7f7adc06d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.673+0000 7f7ae3370700 1 --2- 172.21.15.102:0/4223039111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7adc158be0 0x7f7adc06d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.673+0000 7f7ae3370700 1 --2- 172.21.15.102:0/4223039111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ac8004810 0x7f7adc13eff0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.673+0000 7f7ae3370700 1 -- 172.21.15.102:0/4223039111 >> 172.21.15.102:0/4223039111 conn(0x7f7adc066e00 msgr2=0x7f7adc0a91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.673+0000 7f7ae3370700 1 -- 172.21.15.102:0/4223039111 shutdown_connections 2024-08-17T02:26:04.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.673+0000 7f7ae3370700 1 -- 172.21.15.102:0/4223039111 wait complete. 2024-08-17T02:26:04.688 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:26:04.688 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:26:04.689 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:26:04.689 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:26:04.690 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:26:04.690 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:26:04.690 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:26:04.691 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:26:04.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f094d4c9700 1 Processor -- start 2024-08-17T02:26:04.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f094d4c9700 1 -- start start 2024-08-17T02:26:04.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f6d65f61700 1 Processor -- start 2024-08-17T02:26:04.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f6d65f61700 1 -- start start 2024-08-17T02:26:04.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7fd1f2f5a700 1 Processor -- start 2024-08-17T02:26:04.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7fd1f2f5a700 1 -- start start 2024-08-17T02:26:04.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f05d9f86700 1 Processor -- start 2024-08-17T02:26:04.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7ff63949d700 1 Processor -- start 2024-08-17T02:26:04.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7ff63949d700 1 -- start start 2024-08-17T02:26:04.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f4990bef700 1 Processor -- start 2024-08-17T02:26:04.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f4990bef700 1 -- start start 2024-08-17T02:26:04.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f094d4c9700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09480adf10 0x7f09480ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f6d65f61700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6d60154c90 0x7f6d60157490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f6d5f7fe700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f6d601548c0 0x7f6d601586a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57526/0 (socket says 172.21.15.102:57526) 2024-08-17T02:26:04.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f094d4c9700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f09480cb450 0x7f094806e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f094d4c9700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09480cb890 con 0x7f094806e470 2024-08-17T02:26:04.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f094d4c9700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0948158290 con 0x7f09480cb450 2024-08-17T02:26:04.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f094d4c9700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09481610c0 con 0x7f09480adf10 2024-08-17T02:26:04.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f09467fc700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f094806e470 0x7f09480cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57512/0 (socket says 172.21.15.102:57512) 2024-08-17T02:26:04.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f09467fc700 1 -- 172.21.15.102:0/4271549548 learned_addr learned my addr 172.21.15.102:0/4271549548 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:04.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f09477fe700 1 --2- 172.21.15.102:0/4271549548 >> v2:172.21.15.121:3300/0 conn(0x7f09480cb450 0x7f094806e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f6d65f61700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d600c96d0 con 0x7f6d601548c0 2024-08-17T02:26:04.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f6d65f61700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d60157f90 con 0x7f6d601579d0 2024-08-17T02:26:04.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f6d65f61700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d60158270 con 0x7f6d60154c90 2024-08-17T02:26:04.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f6d5effd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6d60154c90 0x7f6d60157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f6d5f7fe700 1 -- 172.21.15.102:0/943411793 learned_addr learned my addr 172.21.15.102:0/943411793 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:04.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f4990bef700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f498c15a0a0 0x7f498c15a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f4990bef700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f498c0a9860 0x7f498c0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f4990bef700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f498c0a9cd0 0x7f498c068be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f4990bef700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498c153da0 con 0x7f498c15a0a0 2024-08-17T02:26:04.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f4990bef700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498c15b260 con 0x7f498c0a9860 2024-08-17T02:26:04.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f4990bef700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498c0aa160 con 0x7f498c0a9cd0 2024-08-17T02:26:04.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f0945ffb700 1 -- 172.21.15.102:0/4271549548 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264742291 0 0) 0x7f09480cb890 con 0x7f094806e470 2024-08-17T02:26:04.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f0945ffb700 1 -- 172.21.15.102:0/4271549548 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0930003570 con 0x7f094806e470 2024-08-17T02:26:04.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f0946ffd700 1 --2- 172.21.15.102:0/4271549548 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09480adf10 0x7f09480ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7fd1f2f5a700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd1ec0b0490 0x7fd1ec164030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7fd1f2f5a700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec0b3e80 con 0x7fd1ec1534b0 2024-08-17T02:26:04.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7fd1f2f5a700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec0b2990 con 0x7fd1ec159690 2024-08-17T02:26:04.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7fd1f2f5a700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ec159b50 con 0x7fd1ec0b0490 2024-08-17T02:26:04.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f1f58700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd1ec1534b0 0x7fd1ec0b0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57540/0 (socket says 172.21.15.102:57540) 2024-08-17T02:26:04.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f1f58700 1 -- 172.21.15.102:0/3742398460 learned_addr learned my addr 172.21.15.102:0/3742398460 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:04.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f05d9f86700 1 -- start start 2024-08-17T02:26:04.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7f09477fe700 1 -- 172.21.15.102:0/4271549548 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09480adf10 msgr2=0x7f09480ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f09477fe700 1 --2- 172.21.15.102:0/4271549548 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09480adf10 0x7f09480ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f09477fe700 1 -- 172.21.15.102:0/4271549548 >> v1:172.21.15.102:6789/0 conn(0x7f094806e470 legacy=0x7f09480cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f09477fe700 1 -- 172.21.15.102:0/4271549548 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09480ae820 con 0x7f09480cb450 2024-08-17T02:26:04.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f0946ffd700 1 --2- 172.21.15.102:0/4271549548 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09480adf10 0x7f09480ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:04.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7ff63949d700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff63415a620 0x7ff6340ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7ff63949d700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6340a9160 con 0x7ff6340ae2a0 2024-08-17T02:26:04.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7ff63949d700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6340b1680 con 0x7ff6340b0f10 2024-08-17T02:26:04.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.829+0000 7ff63949d700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6340aff10 con 0x7ff63415a620 2024-08-17T02:26:04.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7ff6327fc700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff6340b0f10 0x7ff6340adb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:37460/0 (socket says 172.21.15.102:37460) 2024-08-17T02:26:04.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7ff6327fc700 1 -- 172.21.15.102:0/4093234179 learned_addr learned my addr 172.21.15.102:0/4093234179 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:04.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7ff632ffd700 1 --2- 172.21.15.102:0/4093234179 >> v2:172.21.15.102:3300/0 conn(0x7ff63415a620 0x7ff6340ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d9f86700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05d40994b0 0x7f05d40cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d9f86700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f05d4099880 0x7f05d40cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d9f86700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f05d40980f0 0x7f05d4098570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d9f86700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d40cb740 con 0x7f05d40980f0 2024-08-17T02:26:04.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d9f86700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d40cc110 con 0x7f05d4099880 2024-08-17T02:26:04.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d9f86700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d40ca850 con 0x7f05d40994b0 2024-08-17T02:26:04.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f498a59c700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f498c15a0a0 0x7f498c15a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f498a59c700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f498c15a0a0 0x7f498c15a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44166/0 (socket says 172.21.15.102:44166) 2024-08-17T02:26:04.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f498a59c700 1 -- 172.21.15.102:0/3423664078 learned_addr learned my addr 172.21.15.102:0/3423664078 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:04.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f498ad9d700 1 --2- 172.21.15.102:0/3423664078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f498c0a9cd0 0x7f498c068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f2759700 1 --2- 172.21.15.102:0/3742398460 >> v2:172.21.15.102:3300/0 conn(0x7fd1ec0b0490 0x7fd1ec164030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f6d5effd700 1 -- 172.21.15.102:0/943411793 >> v1:172.21.15.121:6789/0 conn(0x7f6d601579d0 legacy=0x7f6d600ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f6d5effd700 1 -- 172.21.15.102:0/943411793 >> v1:172.21.15.102:6789/0 conn(0x7f6d601548c0 legacy=0x7f6d601586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f6d5effd700 1 -- 172.21.15.102:0/943411793 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d600c9950 con 0x7f6d60154c90 2024-08-17T02:26:04.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 -- 172.21.15.102:0/3742398460 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111963910 0 0) 0x7fd1ec0b3e80 con 0x7fd1ec1534b0 2024-08-17T02:26:04.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 -- 172.21.15.102:0/3742398460 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1d8003570 con 0x7fd1ec1534b0 2024-08-17T02:26:04.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f09477fe700 1 --2- 172.21.15.102:0/4271549548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09480cb450 0x7f094806e8e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f09380098e0 tx=0x7f09380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e89d198da1948cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7ff632ffd700 1 -- 172.21.15.102:0/4093234179 >> v1:172.21.15.121:6789/0 conn(0x7ff6340b0f10 legacy=0x7ff6340adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7ff632ffd700 1 -- 172.21.15.102:0/4093234179 >> v1:172.21.15.102:6789/0 conn(0x7ff6340ae2a0 legacy=0x7ff6340a95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f4989d9b700 1 --2- 172.21.15.102:0/3423664078 >> v2:172.21.15.121:3300/0 conn(0x7f498c0a9860 0x7f498c0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7ff632ffd700 1 -- 172.21.15.102:0/4093234179 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6340b1960 con 0x7ff63415a620 2024-08-17T02:26:04.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d3fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f05d40980f0 0x7f05d4098570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d37fe700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05d40994b0 0x7f05d40cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d37fe700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05d40994b0 0x7f05d40cf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:49246/0 (socket says 172.21.15.102:49246) 2024-08-17T02:26:04.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d37fe700 1 -- 172.21.15.102:0/1004173621 learned_addr learned my addr 172.21.15.102:0/1004173621 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:04.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d2ffd700 1 --2- 172.21.15.102:0/1004173621 >> v2:172.21.15.121:3300/0 conn(0x7f05d4099880 0x7f05d40cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f498a59c700 1 -- 172.21.15.102:0/3423664078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f498c0a9cd0 msgr2=0x7f498c068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f498a59c700 1 --2- 172.21.15.102:0/3423664078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f498c0a9cd0 0x7f498c068be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f498a59c700 1 -- 172.21.15.102:0/3423664078 >> v2:172.21.15.121:3300/0 conn(0x7f498c0a9860 msgr2=0x7f498c0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f498a59c700 1 --2- 172.21.15.102:0/3423664078 >> v2:172.21.15.121:3300/0 conn(0x7f498c0a9860 0x7f498c0686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f0945ffb700 1 -- 172.21.15.102:0/4271549548 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938011630 con 0x7f09480cb450 2024-08-17T02:26:04.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f0945ffb700 1 -- 172.21.15.102:0/4271549548 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0938011790 con 0x7f09480cb450 2024-08-17T02:26:04.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f0945ffb700 1 -- 172.21.15.102:0/4271549548 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938011b30 con 0x7f09480cb450 2024-08-17T02:26:04.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f498a59c700 1 -- 172.21.15.102:0/3423664078 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c0aa440 con 0x7f498c15a0a0 2024-08-17T02:26:04.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 -- 172.21.15.102:0/3742398460 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3178581423 0 0) 0x7fd1d8003570 con 0x7fd1ec1534b0 2024-08-17T02:26:04.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 -- 172.21.15.102:0/3742398460 >> v2:172.21.15.102:3300/0 conn(0x7fd1ec0b0490 msgr2=0x7fd1ec164030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 --2- 172.21.15.102:0/3742398460 >> v2:172.21.15.102:3300/0 conn(0x7fd1ec0b0490 0x7fd1ec164030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 -- 172.21.15.102:0/3742398460 >> v1:172.21.15.121:6789/0 conn(0x7fd1ec159690 legacy=0x7fd1ec0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 -- 172.21.15.102:0/3742398460 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec159e30 con 0x7fd1ec1534b0 2024-08-17T02:26:04.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 -- 172.21.15.102:0/3742398460 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7fd1e40017f0 con 0x7fd1ec1534b0 2024-08-17T02:26:04.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 -- 172.21.15.102:0/3742398460 >> v1:172.21.15.102:6789/0 conn(0x7fd1ec1534b0 legacy=0x7fd1ec0b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 --2- 172.21.15.102:0/3742398460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1d8003a60 0x7fd1d8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 --2- 172.21.15.102:0/3742398460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1d8004810 0x7fd1d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f6d5effd700 1 --2- 172.21.15.102:0/943411793 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d60154c90 0x7f6d60157490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009e60 tx=0x7f6d58009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16ba7cf27fd88e90 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 --2- 172.21.15.102:0/3742398460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1d80051c0 0x7fd1d800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 -- 172.21.15.102:0/3742398460 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec159b50 con 0x7fd1d8003a60 2024-08-17T02:26:04.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 -- 172.21.15.102:0/3742398460 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d800c0b0 con 0x7fd1d8004810 2024-08-17T02:26:04.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 -- 172.21.15.102:0/3742398460 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d800c270 con 0x7fd1d80051c0 2024-08-17T02:26:04.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f498a59c700 1 --2- 172.21.15.102:0/3423664078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f498c15a0a0 0x7f498c15a470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f498c06cad0 tx=0x7f4980009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b991899f1d89a89 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f1757700 1 --2- 172.21.15.102:0/3742398460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1d8004810 0x7fd1d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f6d5e7fc700 1 -- 172.21.15.102:0/943411793 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5800e070 con 0x7f6d60154c90 2024-08-17T02:26:04.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d3fff700 1 -- 172.21.15.102:0/1004173621 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05d40994b0 msgr2=0x7f05d40cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d3fff700 1 --2- 172.21.15.102:0/1004173621 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05d40994b0 0x7f05d40cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d3fff700 1 -- 172.21.15.102:0/1004173621 >> v2:172.21.15.121:3300/0 conn(0x7f05d4099880 msgr2=0x7f05d40cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d3fff700 1 --2- 172.21.15.102:0/1004173621 >> v2:172.21.15.121:3300/0 conn(0x7f05d4099880 0x7f05d40cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d3fff700 1 -- 172.21.15.102:0/1004173621 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d40cab30 con 0x7f05d40980f0 2024-08-17T02:26:04.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7ff632ffd700 1 --2- 172.21.15.102:0/4093234179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff63415a620 0x7ff6340ab170 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff62c014520 tx=0x7ff62c00fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21d09e2f8775c38 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7ff631ffb700 1 -- 172.21.15.102:0/4093234179 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c019590 con 0x7ff63415a620 2024-08-17T02:26:04.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7ff631ffb700 1 -- 172.21.15.102:0/4093234179 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c0196f0 con 0x7ff63415a620 2024-08-17T02:26:04.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f6d5e7fc700 1 -- 172.21.15.102:0/943411793 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5800bbf0 con 0x7f6d60154c90 2024-08-17T02:26:04.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f6d5e7fc700 1 -- 172.21.15.102:0/943411793 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58012430 con 0x7f6d60154c90 2024-08-17T02:26:04.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f4f81715700 1 Processor -- start 2024-08-17T02:26:04.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f4f81715700 1 -- start start 2024-08-17T02:26:04.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f094d4c9700 1 -- 172.21.15.102:0/4271549548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09480cb450 msgr2=0x7f094806e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f094d4c9700 1 --2- 172.21.15.102:0/4271549548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09480cb450 0x7f094806e8e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f09380098e0 tx=0x7f09380091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d3fff700 1 --2- 172.21.15.102:0/1004173621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05d40980f0 0x7f05d4098570 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f05d40cdd90 tx=0x7f05cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4306f4e7ef568cc4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f094d4c9700 1 -- 172.21.15.102:0/4271549548 shutdown_connections 2024-08-17T02:26:04.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f094d4c9700 1 --2- 172.21.15.102:0/4271549548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09480cb450 0x7f094806e8e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f094d4c9700 1 --2- 172.21.15.102:0/4271549548 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f09480adf10 0x7f09480ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f094d4c9700 1 -- 172.21.15.102:0/4271549548 >> 172.21.15.102:0/4271549548 conn(0x7f0948067810 msgr2=0x7f0948067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f498959a700 1 -- 172.21.15.102:0/3423664078 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498000b640 con 0x7f498c15a0a0 2024-08-17T02:26:04.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f498959a700 1 -- 172.21.15.102:0/3423664078 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498000b7a0 con 0x7f498c15a0a0 2024-08-17T02:26:04.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f2759700 1 --2- 172.21.15.102:0/3742398460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1d80051c0 0x7fd1d800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f1757700 1 -- 172.21.15.102:0/3742398460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1d80051c0 msgr2=0x7fd1d800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f1757700 1 --2- 172.21.15.102:0/3742398460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1d80051c0 0x7fd1d800ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f1757700 1 -- 172.21.15.102:0/3742398460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1d8003a60 msgr2=0x7fd1d8003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f1757700 1 --2- 172.21.15.102:0/3742398460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1d8003a60 0x7fd1d8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f1757700 1 -- 172.21.15.102:0/3742398460 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d8003570 con 0x7fd1d8004810 2024-08-17T02:26:04.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f2759700 1 -- 172.21.15.102:0/3742398460 reap_dead start 2024-08-17T02:26:04.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f1757700 1 --2- 172.21.15.102:0/3742398460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1d8004810 0x7fd1d8004c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec157280 tx=0x7fd1dc007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b7b7098bc4e4c13 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7ff63949d700 1 -- 172.21.15.102:0/4093234179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff63415a620 msgr2=0x7ff6340ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7ff63949d700 1 --2- 172.21.15.102:0/4093234179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff63415a620 0x7ff6340ab170 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff62c014520 tx=0x7ff62c00fcb0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f094d4c9700 1 -- 172.21.15.102:0/4271549548 shutdown_connections 2024-08-17T02:26:04.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 -- 172.21.15.102:0/3742398460 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc016070 con 0x7fd1d8004810 2024-08-17T02:26:04.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 -- 172.21.15.102:0/3742398460 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc006820 con 0x7fd1d8004810 2024-08-17T02:26:04.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7fd1f0f56700 1 -- 172.21.15.102:0/3742398460 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc006be0 con 0x7fd1d8004810 2024-08-17T02:26:04.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f6d65f61700 1 -- 172.21.15.102:0/943411793 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d60154c90 msgr2=0x7f6d60157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f6d65f61700 1 --2- 172.21.15.102:0/943411793 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d60154c90 0x7f6d60157490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009e60 tx=0x7f6d58009780 comp rx=0 tx=0).stop 2024-08-17T02:26:04.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f498959a700 1 -- 172.21.15.102:0/3423664078 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498000bb60 con 0x7f498c15a0a0 2024-08-17T02:26:04.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f6d65f61700 1 -- 172.21.15.102:0/943411793 shutdown_connections 2024-08-17T02:26:04.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f6d65f61700 1 --2- 172.21.15.102:0/943411793 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d60154c90 0x7f6d60157490 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f6d65f61700 1 -- 172.21.15.102:0/943411793 >> 172.21.15.102:0/943411793 conn(0x7f6d60067890 msgr2=0x7f6d60067c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d27fc700 1 -- 172.21.15.102:0/1004173621 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc00e070 con 0x7f05d40980f0 2024-08-17T02:26:04.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d27fc700 1 -- 172.21.15.102:0/1004173621 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc00bab0 con 0x7f05d40980f0 2024-08-17T02:26:04.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f094d4c9700 1 -- 172.21.15.102:0/4271549548 wait complete. 2024-08-17T02:26:04.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f4990bef700 1 -- 172.21.15.102:0/3423664078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f498c15a0a0 msgr2=0x7f498c15a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f4990bef700 1 --2- 172.21.15.102:0/3423664078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f498c15a0a0 0x7f498c15a470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f498c06cad0 tx=0x7f4980009250 comp rx=0 tx=0).stop 2024-08-17T02:26:04.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f05d27fc700 1 -- 172.21.15.102:0/1004173621 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc00be70 con 0x7f05d40980f0 2024-08-17T02:26:04.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7ff63949d700 1 -- 172.21.15.102:0/4093234179 shutdown_connections 2024-08-17T02:26:04.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7ff63949d700 1 --2- 172.21.15.102:0/4093234179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff63415a620 0x7ff6340ab170 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7ff63949d700 1 -- 172.21.15.102:0/4093234179 >> 172.21.15.102:0/4093234179 conn(0x7ff634067810 msgr2=0x7ff634067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7ff63949d700 1 -- 172.21.15.102:0/4093234179 shutdown_connections 2024-08-17T02:26:04.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7ff63949d700 1 -- 172.21.15.102:0/4093234179 wait complete. 2024-08-17T02:26:04.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fd1f2f5a700 1 -- 172.21.15.102:0/3742398460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1d8004810 msgr2=0x7fd1d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fd1f2f5a700 1 --2- 172.21.15.102:0/3742398460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1d8004810 0x7fd1d8004c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec157280 tx=0x7fd1dc007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:04.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f05d9f86700 1 -- 172.21.15.102:0/1004173621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05d40980f0 msgr2=0x7f05d4098570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f05d9f86700 1 --2- 172.21.15.102:0/1004173621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05d40980f0 0x7f05d4098570 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f05d40cdd90 tx=0x7f05cc009780 comp rx=0 tx=0).stop 2024-08-17T02:26:04.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f4f81715700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f7c0688d0 0x7f4f7c068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f4f81715700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f7c15a980 0x7f4f7c0ab760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f4f81715700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f7c0af070 con 0x7f4f7c06e890 2024-08-17T02:26:04.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f4f81715700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7c0cac60 con 0x7f4f7c15a980 2024-08-17T02:26:04.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f4f81715700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c0abed0 con 0x7f4f7c0688d0 2024-08-17T02:26:04.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f4f7b7fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f7c15a980 0x7f4f7c0ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f4f7b7fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f7c15a980 0x7f4f7c0ab760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44208/0 (socket says 172.21.15.102:44208) 2024-08-17T02:26:04.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.833+0000 7f4f7b7fe700 1 -- 172.21.15.102:0/1940581809 learned_addr learned my addr 172.21.15.102:0/1940581809 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:04.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f7b7fe700 1 -- 172.21.15.102:0/1940581809 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f7c0688d0 msgr2=0x7f4f7c068ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f7affd700 1 --2- 172.21.15.102:0/1940581809 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f7c0688d0 0x7f4f7c068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f7b7fe700 1 --2- 172.21.15.102:0/1940581809 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f7c0688d0 0x7f4f7c068ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f7b7fe700 1 -- 172.21.15.102:0/1940581809 >> v1:172.21.15.102:6789/0 conn(0x7f4f7c06e890 legacy=0x7f4f7c15a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f79ffb700 1 -- 172.21.15.102:0/1940581809 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503635551 0 0) 0x7f4f7c0af070 con 0x7f4f7c06e890 2024-08-17T02:26:04.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f7b7fe700 1 -- 172.21.15.102:0/1940581809 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c0abca0 con 0x7f4f7c15a980 2024-08-17T02:26:04.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f7affd700 1 --2- 172.21.15.102:0/1940581809 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f7c0688d0 0x7f4f7c068ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:04.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f7b7fe700 1 --2- 172.21.15.102:0/1940581809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7c15a980 0x7f4f7c0ab760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009f20 tx=0x7f4f74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7cd32f5226b814 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f05d9f86700 1 -- 172.21.15.102:0/1004173621 shutdown_connections 2024-08-17T02:26:04.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f05d9f86700 1 --2- 172.21.15.102:0/1004173621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05d40980f0 0x7f05d4098570 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f05d9f86700 1 --2- 172.21.15.102:0/1004173621 >> v2:172.21.15.121:3300/0 conn(0x7f05d4099880 0x7f05d40cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f05d9f86700 1 --2- 172.21.15.102:0/1004173621 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05d40994b0 0x7f05d40cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f05d9f86700 1 -- 172.21.15.102:0/1004173621 >> 172.21.15.102:0/1004173621 conn(0x7f05d40d02b0 msgr2=0x7f05d40d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fb0b5995700 1 Processor -- start 2024-08-17T02:26:04.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4990bef700 1 -- 172.21.15.102:0/3423664078 shutdown_connections 2024-08-17T02:26:04.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4990bef700 1 --2- 172.21.15.102:0/3423664078 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f498c0a9cd0 0x7f498c068be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4990bef700 1 --2- 172.21.15.102:0/3423664078 >> v2:172.21.15.121:3300/0 conn(0x7f498c0a9860 0x7f498c0686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4990bef700 1 --2- 172.21.15.102:0/3423664078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f498c15a0a0 0x7f498c15a470 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4990bef700 1 -- 172.21.15.102:0/3423664078 >> 172.21.15.102:0/3423664078 conn(0x7f498c0cd160 msgr2=0x7f498c06d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fd1f2f5a700 1 -- 172.21.15.102:0/3742398460 shutdown_connections 2024-08-17T02:26:04.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fd1f2f5a700 1 --2- 172.21.15.102:0/3742398460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1d8004810 0x7fd1d8004c80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fd1f2f5a700 1 -- 172.21.15.102:0/3742398460 >> 172.21.15.102:0/3742398460 conn(0x7fd1ec0ca930 msgr2=0x7fd1ec0cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f6d65f61700 1 -- 172.21.15.102:0/943411793 shutdown_connections 2024-08-17T02:26:04.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fb0b5995700 1 -- start start 2024-08-17T02:26:04.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f79ffb700 1 -- 172.21.15.102:0/1940581809 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7400e070 con 0x7f4f7c15a980 2024-08-17T02:26:04.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f79ffb700 1 -- 172.21.15.102:0/1940581809 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7400ba80 con 0x7f4f7c15a980 2024-08-17T02:26:04.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f79ffb700 1 -- 172.21.15.102:0/1940581809 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f740092e0 con 0x7f4f7c15a980 2024-08-17T02:26:04.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f094d4c9700 1 Processor -- start 2024-08-17T02:26:04.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f6d65f61700 1 -- 172.21.15.102:0/943411793 wait complete. 2024-08-17T02:26:04.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f05d9f86700 1 -- 172.21.15.102:0/1004173621 shutdown_connections 2024-08-17T02:26:04.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f094d4c9700 1 -- start start 2024-08-17T02:26:04.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff63949d700 1 Processor -- start 2024-08-17T02:26:04.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff63949d700 1 -- start start 2024-08-17T02:26:04.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f81715700 1 -- 172.21.15.102:0/1940581809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7c15a980 msgr2=0x7f4f7c0ab760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f81715700 1 --2- 172.21.15.102:0/1940581809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7c15a980 0x7f4f7c0ab760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009f20 tx=0x7f4f74009840 comp rx=0 tx=0).stop 2024-08-17T02:26:04.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fd1f2f5a700 1 -- 172.21.15.102:0/3742398460 shutdown_connections 2024-08-17T02:26:04.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f81715700 1 -- 172.21.15.102:0/1940581809 shutdown_connections 2024-08-17T02:26:04.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f81715700 1 --2- 172.21.15.102:0/1940581809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7c15a980 0x7f4f7c0ab760 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f81715700 1 --2- 172.21.15.102:0/1940581809 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f7c0688d0 0x7f4f7c068ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f81715700 1 -- 172.21.15.102:0/1940581809 >> 172.21.15.102:0/1940581809 conn(0x7f4f7c0cd160 msgr2=0x7f4f7c06d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fb0b5995700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb0b0159570 0x7fb0b00b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fb0b5995700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b00b0fc0 con 0x7fb0b0159940 2024-08-17T02:26:04.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fb0b5995700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b00b12a0 con 0x7fb0b00b3d20 2024-08-17T02:26:04.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fb0b5995700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b00b1860 con 0x7fb0b0159570 2024-08-17T02:26:04.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff63949d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6340ae2a0 0x7ff6340caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f094d4c9700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f094806e470 0x7f0948156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f094d4c9700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09480adf10 0x7f0948143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f094d4c9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09480cb450 0x7f0948098d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f094d4c9700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948098870 con 0x7f09480adf10 2024-08-17T02:26:04.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f094d4c9700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09481439d0 con 0x7f09480cb450 2024-08-17T02:26:04.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff63949d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6340b0f10 0x7ff634152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f094d4c9700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09480979c0 con 0x7f094806e470 2024-08-17T02:26:04.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff63949d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff63415a620 0x7ff6340ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f09467fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09480adf10 0x7f0948143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff63949d700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff634097040 con 0x7ff6340b0f10 2024-08-17T02:26:04.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff63949d700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6340ca000 con 0x7ff6340ae2a0 2024-08-17T02:26:04.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff63949d700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6340ca2e0 con 0x7ff63415a620 2024-08-17T02:26:04.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff6327fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6340b0f10 0x7ff634152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff6327fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6340b0f10 0x7ff634152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44216/0 (socket says 172.21.15.102:44216) 2024-08-17T02:26:04.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff6327fc700 1 -- 172.21.15.102:0/1284570464 learned_addr learned my addr 172.21.15.102:0/1284570464 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:04.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f09467fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09480adf10 0x7f0948143490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44222/0 (socket says 172.21.15.102:44222) 2024-08-17T02:26:04.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f09467fc700 1 -- 172.21.15.102:0/3004122166 learned_addr learned my addr 172.21.15.102:0/3004122166 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:04.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff6337fe700 1 --2- 172.21.15.102:0/1284570464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff63415a620 0x7ff6340ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff632ffd700 1 --2- 172.21.15.102:0/1284570464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6340ae2a0 0x7ff6340caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fb0aeffd700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb0b0159570 0x7fb0b00b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fb0aeffd700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb0b0159570 0x7fb0b00b5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44210/0 (socket says 172.21.15.102:44210) 2024-08-17T02:26:04.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fb0aeffd700 1 -- 172.21.15.102:0/2378651283 learned_addr learned my addr 172.21.15.102:0/2378651283 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:04.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f0946ffd700 1 --2- 172.21.15.102:0/3004122166 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f094806e470 0x7f0948156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f81715700 1 -- 172.21.15.102:0/1940581809 shutdown_connections 2024-08-17T02:26:04.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f6d65f61700 1 Processor -- start 2024-08-17T02:26:04.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4990bef700 1 -- 172.21.15.102:0/3423664078 shutdown_connections 2024-08-17T02:26:04.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f09477fe700 1 --2- 172.21.15.102:0/3004122166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09480cb450 0x7f0948098d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f09467fc700 1 -- 172.21.15.102:0/3004122166 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f094806e470 msgr2=0x7f0948156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f09467fc700 1 --2- 172.21.15.102:0/3004122166 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f094806e470 0x7f0948156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f09467fc700 1 -- 172.21.15.102:0/3004122166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09480cb450 msgr2=0x7f0948098d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f09467fc700 1 --2- 172.21.15.102:0/3004122166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09480cb450 0x7f0948098d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f09467fc700 1 -- 172.21.15.102:0/3004122166 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0938009420 con 0x7f09480adf10 2024-08-17T02:26:04.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff6327fc700 1 -- 172.21.15.102:0/1284570464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff63415a620 msgr2=0x7ff6340ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff6327fc700 1 --2- 172.21.15.102:0/1284570464 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff63415a620 0x7ff6340ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff6327fc700 1 -- 172.21.15.102:0/1284570464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6340ae2a0 msgr2=0x7ff6340caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff6327fc700 1 --2- 172.21.15.102:0/1284570464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6340ae2a0 0x7ff6340caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7ff6327fc700 1 -- 172.21.15.102:0/1284570464 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c0140e0 con 0x7ff6340b0f10 2024-08-17T02:26:04.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fd1f2f5a700 1 -- 172.21.15.102:0/3742398460 wait complete. 2024-08-17T02:26:04.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f6d65f61700 1 -- start start 2024-08-17T02:26:04.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f09467fc700 1 --2- 172.21.15.102:0/3004122166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09480adf10 0x7f0948143490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f094000cbf0 tx=0x7f09400019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fb0adffb700 1 -- 172.21.15.102:0/2378651283 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636573498 0 0) 0x7fb0b00b12a0 con 0x7fb0b00b3d20 2024-08-17T02:26:04.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fb0adffb700 1 -- 172.21.15.102:0/2378651283 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb098003570 con 0x7fb0b00b3d20 2024-08-17T02:26:04.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fb0aeffd700 1 -- 172.21.15.102:0/2378651283 >> v1:172.21.15.121:6789/0 conn(0x7fb0b00b3d20 legacy=0x7fb0b00b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fb0aeffd700 1 -- 172.21.15.102:0/2378651283 >> v1:172.21.15.102:6789/0 conn(0x7fb0b0159940 legacy=0x7fb0b00b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f092effd700 1 -- 172.21.15.102:0/3004122166 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094000a9c0 con 0x7f09480adf10 2024-08-17T02:26:04.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f092effd700 1 -- 172.21.15.102:0/3004122166 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094000ab40 con 0x7f09480adf10 2024-08-17T02:26:04.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f094d4c9700 1 -- 172.21.15.102:0/3004122166 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0948097c60 con 0x7f09480adf10 2024-08-17T02:26:04.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f092effd700 1 -- 172.21.15.102:0/3004122166 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09400070f0 con 0x7f09480adf10 2024-08-17T02:26:04.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f094d4c9700 1 -- 172.21.15.102:0/3004122166 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0948098220 con 0x7f09480adf10 2024-08-17T02:26:04.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fb0aeffd700 1 -- 172.21.15.102:0/2378651283 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b00b1580 con 0x7fb0b0159570 2024-08-17T02:26:04.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7f4f81715700 1 -- 172.21.15.102:0/1940581809 wait complete. 2024-08-17T02:26:04.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.837+0000 7fb0aeffd700 1 --2- 172.21.15.102:0/2378651283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0b0159570 0x7fb0b00b5e60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00099b0 tx=0x7fb0a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111d15a1d47a7a09 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d65f61700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6d601548c0 0x7f6d601458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d65f61700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d60154c90 0x7f6d60143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d65f61700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d601579d0 0x7f6d60144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d65f61700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d60145440 con 0x7f6d60154c90 2024-08-17T02:26:04.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d65f61700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d60145e10 con 0x7f6d601579d0 2024-08-17T02:26:04.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d65f61700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d60144560 con 0x7f6d601548c0 2024-08-17T02:26:04.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f4990bef700 1 -- 172.21.15.102:0/3423664078 wait complete. 2024-08-17T02:26:04.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7fd1f2f5a700 1 Processor -- start 2024-08-17T02:26:04.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f094d4c9700 1 -- 172.21.15.102:0/3004122166 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09480645c0 con 0x7f09480adf10 2024-08-17T02:26:04.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7ff6327fc700 1 --2- 172.21.15.102:0/1284570464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6340b0f10 0x7ff634152c70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff62800c760 tx=0x7ff628007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7fb0adffb700 1 -- 172.21.15.102:0/2378651283 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0009ea0 con 0x7fb0b0159570 2024-08-17T02:26:04.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7fb0adffb700 1 -- 172.21.15.102:0/2378651283 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a000b860 con 0x7fb0b0159570 2024-08-17T02:26:04.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7fb0adffb700 1 -- 172.21.15.102:0/2378651283 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a000bc00 con 0x7fb0b0159570 2024-08-17T02:26:04.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7ff61affd700 1 -- 172.21.15.102:0/1284570464 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628005b30 con 0x7ff6340b0f10 2024-08-17T02:26:04.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7ff61affd700 1 -- 172.21.15.102:0/1284570464 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff628005cb0 con 0x7ff6340b0f10 2024-08-17T02:26:04.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7ff61affd700 1 -- 172.21.15.102:0/1284570464 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628007340 con 0x7ff6340b0f10 2024-08-17T02:26:04.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7ff63949d700 1 -- 172.21.15.102:0/1284570464 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6340969f0 con 0x7ff6340b0f10 2024-08-17T02:26:04.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7ff63949d700 1 -- 172.21.15.102:0/1284570464 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6340cb1e0 con 0x7ff6340b0f10 2024-08-17T02:26:04.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f092effd700 1 -- 172.21.15.102:0/3004122166 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f09400074e0 con 0x7f09480adf10 2024-08-17T02:26:04.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d5ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d601579d0 0x7f6d60144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d5f7fe700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6d601548c0 0x7f6d601458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d5effd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d60154c90 0x7f6d60143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d5ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d601579d0 0x7f6d60144020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:53188/0 (socket says 172.21.15.102:53188) 2024-08-17T02:26:04.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d5ffff700 1 -- 172.21.15.102:0/2697896113 learned_addr learned my addr 172.21.15.102:0/2697896113 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:04.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d5ffff700 1 -- 172.21.15.102:0/2697896113 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6d601548c0 msgr2=0x7f6d601458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d5ffff700 1 --2- 172.21.15.102:0/2697896113 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6d601548c0 0x7f6d601458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d5ffff700 1 -- 172.21.15.102:0/2697896113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d60154c90 msgr2=0x7f6d60143ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d5ffff700 1 --2- 172.21.15.102:0/2697896113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d60154c90 0x7f6d60143ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d5ffff700 1 -- 172.21.15.102:0/2697896113 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d58009a20 con 0x7f6d601579d0 2024-08-17T02:26:04.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d5ffff700 1 --2- 172.21.15.102:0/2697896113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d601579d0 0x7f6d60144020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6d540088a0 tx=0x7f6d5400d530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f092effd700 1 --2- 172.21.15.102:0/3004122166 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f09340608e0 0x7f0934062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7fb0b5995700 1 -- 172.21.15.102:0/2378651283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0b0159570 msgr2=0x7fb0b00b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7fb0b5995700 1 --2- 172.21.15.102:0/2378651283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0b0159570 0x7fb0b00b5e60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00099b0 tx=0x7fb0a0009250 comp rx=0 tx=0).stop 2024-08-17T02:26:04.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f4990bef700 1 Processor -- start 2024-08-17T02:26:04.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d477fe700 1 -- 172.21.15.102:0/2697896113 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5400d300 con 0x7f6d601579d0 2024-08-17T02:26:04.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f092effd700 1 -- 172.21.15.102:0/3004122166 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f094007d030 con 0x7f09480adf10 2024-08-17T02:26:04.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d65f61700 1 -- 172.21.15.102:0/2697896113 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d60144830 con 0x7f6d601579d0 2024-08-17T02:26:04.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d65f61700 1 -- 172.21.15.102:0/2697896113 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d60144df0 con 0x7f6d601579d0 2024-08-17T02:26:04.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7fd1f2f5a700 1 -- start start 2024-08-17T02:26:04.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f05d9f86700 1 -- 172.21.15.102:0/1004173621 wait complete. 2024-08-17T02:26:04.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f4f81715700 1 Processor -- start 2024-08-17T02:26:04.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f4f81715700 1 -- start start 2024-08-17T02:26:04.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f092effd700 1 --2- 172.21.15.102:0/3004122166 >> [v2:172.21.15.102:6824/24224,v1:172.21.15.102:6825/24224] conn(0x7f0934068a70 0x7f093406ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f092effd700 1 -- 172.21.15.102:0/3004122166 --> [v2:172.21.15.102:6824/24224,v1:172.21.15.102:6825/24224] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f093406b530 con 0x7f0934068a70 2024-08-17T02:26:04.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d65f61700 1 -- 172.21.15.102:0/2697896113 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d600643a0 con 0x7f6d601579d0 2024-08-17T02:26:04.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f092effd700 1 -- 172.21.15.102:0/3004122166 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f094004d460 con 0x7f09480adf10 2024-08-17T02:26:04.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7ff61affd700 1 -- 172.21.15.102:0/1284570464 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff62801b400 con 0x7ff6340b0f10 2024-08-17T02:26:04.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f09477fe700 1 --2- 172.21.15.102:0/3004122166 >> [v2:172.21.15.102:6824/24224,v1:172.21.15.102:6825/24224] conn(0x7f0934068a70 0x7f093406ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f4990bef700 1 -- start start 2024-08-17T02:26:04.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7fd1f2f5a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1d8004810 0x7fd1ec154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7fd1f2f5a700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1ec155270 0x7fd1ec154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7fd1f2f5a700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1ec1693c0 0x7fd1ec169830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7fd1f2f5a700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec156880 con 0x7fd1ec155270 2024-08-17T02:26:04.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7fb0b5995700 1 -- 172.21.15.102:0/2378651283 shutdown_connections 2024-08-17T02:26:04.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7fb0b5995700 1 --2- 172.21.15.102:0/2378651283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0b0159570 0x7fb0b00b5e60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7fb0b5995700 1 -- 172.21.15.102:0/2378651283 >> 172.21.15.102:0/2378651283 conn(0x7fb0b00996f0 msgr2=0x7fb0b0067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7fd1f2f5a700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec154bc0 con 0x7fd1d8004810 2024-08-17T02:26:04.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7fd1f2f5a700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec1557e0 con 0x7fd1ec1693c0 2024-08-17T02:26:04.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d477fe700 1 -- 172.21.15.102:0/2697896113 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d54011070 con 0x7f6d601579d0 2024-08-17T02:26:04.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7f6d477fe700 1 -- 172.21.15.102:0/2697896113 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5400b400 con 0x7f6d601579d0 2024-08-17T02:26:04.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.841+0000 7ff61affd700 1 --2- 172.21.15.102:0/1284570464 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff620060860 0x7ff620062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fd1f2759700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1ec1693c0 0x7fd1ec169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4990bef700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f498c0a9860 0x7f498c0b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4990bef700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f498c0a9cd0 0x7f498c0ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4990bef700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f498c15a0a0 0x7f498c0676c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7ff61affd700 1 -- 172.21.15.102:0/1284570464 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff62807c700 con 0x7ff6340b0f10 2024-08-17T02:26:04.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4990bef700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c0c9d60 con 0x7f498c15a0a0 2024-08-17T02:26:04.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4990bef700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c0ad9e0 con 0x7f498c0a9cd0 2024-08-17T02:26:04.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4990bef700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498c0adc80 con 0x7f498c0a9860 2024-08-17T02:26:04.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fd1f2759700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1ec1693c0 0x7fd1ec169830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:49290/0 (socket says 172.21.15.102:49290) 2024-08-17T02:26:04.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fd1f2759700 1 -- 172.21.15.102:0/4045172435 learned_addr learned my addr 172.21.15.102:0/4045172435 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:04.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d9f86700 1 Processor -- start 2024-08-17T02:26:04.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7ff632ffd700 1 --2- 172.21.15.102:0/1284570464 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff620060860 0x7ff620062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7ff63949d700 1 --2- 172.21.15.102:0/1284570464 >> [v2:172.21.15.121:6816/24418,v1:172.21.15.121:6817/24418] conn(0x7ff6340ab070 0x7ff634069cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f81715700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f7c0688d0 0x7f4f7c151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4989d9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f498c0a9cd0 0x7f498c0ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f498ad9d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f498c15a0a0 0x7f498c0676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f498ad9d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f498c15a0a0 0x7f498c0676c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44246/0 (socket says 172.21.15.102:44246) 2024-08-17T02:26:04.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f498ad9d700 1 -- 172.21.15.102:0/3029394067 learned_addr learned my addr 172.21.15.102:0/3029394067 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:04.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f498a59c700 1 --2- 172.21.15.102:0/3029394067 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f498c0a9860 0x7f498c0b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d9f86700 1 -- start start 2024-08-17T02:26:04.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f81715700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7c06e890 0x7f4f7c1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f81715700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f7c15a980 0x7f4f7c157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f81715700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c157980 con 0x7f4f7c06e890 2024-08-17T02:26:04.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f81715700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c156d70 con 0x7f4f7c15a980 2024-08-17T02:26:04.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f81715700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c157050 con 0x7f4f7c0688d0 2024-08-17T02:26:04.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fd1f1f58700 1 --2- 172.21.15.102:0/4045172435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1d8004810 0x7fd1ec154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f0946ffd700 1 --2- 172.21.15.102:0/3004122166 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f09340608e0 0x7f0934062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f7affd700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f7c0688d0 0x7f4f7c151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f7affd700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f7c0688d0 0x7f4f7c151520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:49306/0 (socket says 172.21.15.102:49306) 2024-08-17T02:26:04.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f7affd700 1 -- 172.21.15.102:0/2748049171 learned_addr learned my addr 172.21.15.102:0/2748049171 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:04.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7ff63949d700 1 -- 172.21.15.102:0/1284570464 --> [v2:172.21.15.121:6816/24418,v1:172.21.15.121:6817/24418] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff634096e70 con 0x7ff6340ab070 2024-08-17T02:26:04.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f7a7fc700 1 --2- 172.21.15.102:0/2748049171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7c06e890 0x7f4f7c1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7ff632ffd700 1 --2- 172.21.15.102:0/1284570464 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff620060860 0x7ff620062d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00fa40 tx=0x7ff62c01e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fd1f2759700 1 -- 172.21.15.102:0/4045172435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1d8004810 msgr2=0x7fd1ec154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fd1f2759700 1 --2- 172.21.15.102:0/4045172435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1d8004810 0x7fd1ec154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fd1f2759700 1 -- 172.21.15.102:0/4045172435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1ec155270 msgr2=0x7fd1ec154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fd1f2759700 1 --2- 172.21.15.102:0/4045172435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1ec155270 0x7fd1ec154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7ff6337fe700 1 --2- 172.21.15.102:0/1284570464 >> [v2:172.21.15.121:6816/24418,v1:172.21.15.121:6817/24418] conn(0x7ff6340ab070 0x7ff634069cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fb0b5995700 1 -- 172.21.15.102:0/2378651283 shutdown_connections 2024-08-17T02:26:04.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f0946ffd700 1 --2- 172.21.15.102:0/3004122166 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f09340608e0 0x7f0934062d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f093c00ac00 tx=0x7f093c006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fd1f2759700 1 -- 172.21.15.102:0/4045172435 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec155ac0 con 0x7fd1ec1693c0 2024-08-17T02:26:04.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fd1f1f58700 1 --2- 172.21.15.102:0/4045172435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1d8004810 0x7fd1ec154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:04.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4989d9b700 1 -- 172.21.15.102:0/3029394067 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f498c0a9860 msgr2=0x7f498c0b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4989d9b700 1 --2- 172.21.15.102:0/3029394067 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f498c0a9860 0x7f498c0b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4989d9b700 1 -- 172.21.15.102:0/3029394067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f498c15a0a0 msgr2=0x7f498c0676c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4989d9b700 1 --2- 172.21.15.102:0/3029394067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f498c15a0a0 0x7f498c0676c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4989d9b700 1 -- 172.21.15.102:0/3029394067 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49800094f0 con 0x7f498c0a9cd0 2024-08-17T02:26:04.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f498ad9d700 1 --2- 172.21.15.102:0/3029394067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f498c15a0a0 0x7f498c0676c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:04.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d9f86700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05d40980f0 0x7f05d40af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fd1f2759700 1 --2- 172.21.15.102:0/4045172435 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1ec1693c0 0x7fd1ec169830 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec15a7c0 tx=0x7fd1e8008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4989d9b700 1 --2- 172.21.15.102:0/3029394067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f498c0a9cd0 0x7f498c0ad4a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f497c00e900 tx=0x7f497c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d9f86700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05d40994b0 0x7f05d415c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d9f86700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05d40c9c80 0x7f05d406eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d9f86700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d40afac0 con 0x7f05d40994b0 2024-08-17T02:26:04.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d9f86700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d40b28f0 con 0x7f05d40980f0 2024-08-17T02:26:04.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d9f86700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d40b1ce0 con 0x7f05d40c9c80 2024-08-17T02:26:04.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d2ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05d40994b0 0x7f05d415c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d2ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05d40994b0 0x7f05d415c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44272/0 (socket says 172.21.15.102:44272) 2024-08-17T02:26:04.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d2ffd700 1 -- 172.21.15.102:0/3559307210 learned_addr learned my addr 172.21.15.102:0/3559307210 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:04.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f7a7fc700 1 -- 172.21.15.102:0/2748049171 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f7c0688d0 msgr2=0x7f4f7c151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f7a7fc700 1 --2- 172.21.15.102:0/2748049171 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4f7c0688d0 0x7f4f7c151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f7a7fc700 1 -- 172.21.15.102:0/2748049171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f7c15a980 msgr2=0x7f4f7c157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f7a7fc700 1 --2- 172.21.15.102:0/2748049171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f7c15a980 0x7f4f7c157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f7a7fc700 1 -- 172.21.15.102:0/2748049171 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f74009ae0 con 0x7f4f7c06e890 2024-08-17T02:26:04.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7ff6337fe700 1 --2- 172.21.15.102:0/1284570464 >> [v2:172.21.15.121:6816/24418,v1:172.21.15.121:6817/24418] conn(0x7ff6340ab070 0x7ff634069cc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d37fe700 1 --2- 172.21.15.102:0/3559307210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05d40980f0 0x7f05d40af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d3fff700 1 --2- 172.21.15.102:0/3559307210 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05d40c9c80 0x7f05d406eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f7a7fc700 1 --2- 172.21.15.102:0/2748049171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7c06e890 0x7f4f7c1563b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000c560 tx=0x7f4f70007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f6d477fe700 1 -- 172.21.15.102:0/2697896113 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6d5400b7b0 con 0x7f6d601579d0 2024-08-17T02:26:04.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fd1e1ffb700 1 -- 172.21.15.102:0/4045172435 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8014600 con 0x7fd1ec1693c0 2024-08-17T02:26:04.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fd1e1ffb700 1 -- 172.21.15.102:0/4045172435 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e8014760 con 0x7fd1ec1693c0 2024-08-17T02:26:04.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fd1f2f5a700 1 -- 172.21.15.102:0/4045172435 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec155da0 con 0x7fd1ec1693c0 2024-08-17T02:26:04.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fd1e1ffb700 1 -- 172.21.15.102:0/4045172435 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8014b20 con 0x7fd1ec1693c0 2024-08-17T02:26:04.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fd1f2f5a700 1 -- 172.21.15.102:0/4045172435 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ec156360 con 0x7fd1ec1693c0 2024-08-17T02:26:04.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d2ffd700 1 -- 172.21.15.102:0/3559307210 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05d40c9c80 msgr2=0x7f05d406eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d2ffd700 1 --2- 172.21.15.102:0/3559307210 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f05d40c9c80 0x7f05d406eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d2ffd700 1 -- 172.21.15.102:0/3559307210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05d40980f0 msgr2=0x7f05d40af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d2ffd700 1 --2- 172.21.15.102:0/3559307210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05d40980f0 0x7f05d40af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d2ffd700 1 -- 172.21.15.102:0/3559307210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc009a20 con 0x7f05d40994b0 2024-08-17T02:26:04.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f62ffd700 1 -- 172.21.15.102:0/2748049171 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70011590 con 0x7f4f7c06e890 2024-08-17T02:26:04.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f6d477fe700 1 --2- 172.21.15.102:0/2697896113 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6d4c0608e0 0x7f6d4c062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f497a7fc700 1 -- 172.21.15.102:0/3029394067 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c013680 con 0x7f498c0a9cd0 2024-08-17T02:26:04.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f497a7fc700 1 -- 172.21.15.102:0/3029394067 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c0137e0 con 0x7f498c0a9cd0 2024-08-17T02:26:04.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f497a7fc700 1 -- 172.21.15.102:0/3029394067 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c013ba0 con 0x7f498c0a9cd0 2024-08-17T02:26:04.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4990bef700 1 -- 172.21.15.102:0/3029394067 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498c0c9f40 con 0x7f498c0a9cd0 2024-08-17T02:26:04.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4990bef700 1 -- 172.21.15.102:0/3029394067 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498c0ca500 con 0x7f498c0a9cd0 2024-08-17T02:26:04.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f09477fe700 1 --2- 172.21.15.102:0/3004122166 >> [v2:172.21.15.102:6824/24224,v1:172.21.15.102:6825/24224] conn(0x7f0934068a70 0x7f093406ae80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f6d477fe700 1 -- 172.21.15.102:0/2697896113 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6d5407c3b0 con 0x7f6d601579d0 2024-08-17T02:26:04.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f6d477fe700 1 --2- 172.21.15.102:0/2697896113 >> [v2:172.21.15.121:6824/24414,v1:172.21.15.121:6825/24414] conn(0x7f6d4c068980 0x7f6d4c06ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f6d477fe700 1 -- 172.21.15.102:0/2697896113 --> [v2:172.21.15.121:6824/24414,v1:172.21.15.121:6825/24414] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d4c06b440 con 0x7f6d4c068980 2024-08-17T02:26:04.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f6d477fe700 1 -- 172.21.15.102:0/2697896113 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d5407c6e0 con 0x7f6d601579d0 2024-08-17T02:26:04.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f6d5f7fe700 1 --2- 172.21.15.102:0/2697896113 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6d4c0608e0 0x7f6d4c062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d2ffd700 1 --2- 172.21.15.102:0/3559307210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05d40994b0 0x7f05d415c130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f05c800e950 tx=0x7f05c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05bb7fe700 1 -- 172.21.15.102:0/3559307210 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8013680 con 0x7f05d40994b0 2024-08-17T02:26:04.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d9f86700 1 -- 172.21.15.102:0/3559307210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d40b1fc0 con 0x7f05d40994b0 2024-08-17T02:26:04.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05d9f86700 1 -- 172.21.15.102:0/3559307210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d40b2580 con 0x7f05d40994b0 2024-08-17T02:26:04.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05bb7fe700 1 -- 172.21.15.102:0/3559307210 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c80137e0 con 0x7f05d40994b0 2024-08-17T02:26:04.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f05bb7fe700 1 -- 172.21.15.102:0/3559307210 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8013ba0 con 0x7f05d40994b0 2024-08-17T02:26:04.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f62ffd700 1 -- 172.21.15.102:0/2748049171 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f70011710 con 0x7f4f7c06e890 2024-08-17T02:26:04.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7f4f62ffd700 1 -- 172.21.15.102:0/2748049171 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70011ad0 con 0x7f4f7c06e890 2024-08-17T02:26:04.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f4990bef700 1 -- 172.21.15.102:0/3029394067 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f498c0645c0 con 0x7f498c0a9cd0 2024-08-17T02:26:04.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f6d5f7fe700 1 --2- 172.21.15.102:0/2697896113 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6d4c0608e0 0x7f6d4c062d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6d50000c00 tx=0x7f6d50007f10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f6d5effd700 1 --2- 172.21.15.102:0/2697896113 >> [v2:172.21.15.121:6824/24414,v1:172.21.15.121:6825/24414] conn(0x7f6d4c068980 0x7f6d4c06ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fd1f2f5a700 1 -- 172.21.15.102:0/4045172435 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1ec0638f0 con 0x7fd1ec1693c0 2024-08-17T02:26:04.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.845+0000 7fb0b5995700 1 -- 172.21.15.102:0/2378651283 wait complete. 2024-08-17T02:26:04.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f4f81715700 1 -- 172.21.15.102:0/2748049171 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7c157330 con 0x7f4f7c06e890 2024-08-17T02:26:04.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f092effd700 1 -- 172.21.15.102:0/3004122166 <== osd.1 v2:172.21.15.102:6824/24224 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f093406b530 con 0x7f0934068a70 2024-08-17T02:26:04.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f05d9f86700 1 -- 172.21.15.102:0/3559307210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f05b4000fd0 con 0x7f05d40994b0 2024-08-17T02:26:04.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f4f81715700 1 -- 172.21.15.102:0/2748049171 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7c0ab6a0 con 0x7f4f7c06e890 2024-08-17T02:26:04.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f6d5effd700 1 --2- 172.21.15.102:0/2697896113 >> [v2:172.21.15.121:6824/24414,v1:172.21.15.121:6825/24414] conn(0x7f6d4c068980 0x7f6d4c06ad90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7ff61affd700 1 -- 172.21.15.102:0/1284570464 <== osd.6 v2:172.21.15.121:6816/24418 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff6240036b0 con 0x7ff6340ab070 2024-08-17T02:26:04.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fb0b5995700 1 Processor -- start 2024-08-17T02:26:04.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fb0b5995700 1 -- start start 2024-08-17T02:26:04.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f6d477fe700 1 -- 172.21.15.102:0/2697896113 <== osd.4 v2:172.21.15.121:6824/24414 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f6d4c06b440 con 0x7f6d4c068980 2024-08-17T02:26:04.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f05bb7fe700 1 -- 172.21.15.102:0/3559307210 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f05c8025420 con 0x7f05d40994b0 2024-08-17T02:26:04.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f05bb7fe700 1 --2- 172.21.15.102:0/3559307210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f05c0060930 0x7f05c0062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f05bb7fe700 1 -- 172.21.15.102:0/3559307210 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f05c807d0b0 con 0x7f05d40994b0 2024-08-17T02:26:04.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f4f81715700 1 -- 172.21.15.102:0/2748049171 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f7c0645c0 con 0x7f4f7c06e890 2024-08-17T02:26:04.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f4f62ffd700 1 -- 172.21.15.102:0/2748049171 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4f7001b3b0 con 0x7f4f7c06e890 2024-08-17T02:26:04.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f05bb7fe700 1 --2- 172.21.15.102:0/3559307210 >> [v2:172.21.15.121:6808/24413,v1:172.21.15.121:6809/24413] conn(0x7f05c0068b40 0x7f05c006af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f497a7fc700 1 -- 172.21.15.102:0/3029394067 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f497c025420 con 0x7f498c0a9cd0 2024-08-17T02:26:04.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f497a7fc700 1 --2- 172.21.15.102:0/3029394067 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f496c060930 0x7f496c062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f05bb7fe700 1 -- 172.21.15.102:0/3559307210 --> [v2:172.21.15.121:6808/24413,v1:172.21.15.121:6809/24413] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05c006b600 con 0x7f05c0068b40 2024-08-17T02:26:04.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fb0b5995700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0b00b3d20 0x7fb0b00aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fb0b5995700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0b0159570 0x7fb0b00b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fb0b5995700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb0b0159940 0x7fb0b00b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fb0b5995700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0149050 con 0x7fb0b0159570 2024-08-17T02:26:04.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fb0b5995700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0148440 con 0x7fb0b00b3d20 2024-08-17T02:26:04.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fb0b5995700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0148720 con 0x7fb0b0159940 2024-08-17T02:26:04.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f497a7fc700 1 -- 172.21.15.102:0/3029394067 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f497c07cf40 con 0x7f498c0a9cd0 2024-08-17T02:26:04.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f498a59c700 1 --2- 172.21.15.102:0/3029394067 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f496c060930 0x7f496c062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f05bb7fe700 1 -- 172.21.15.102:0/3559307210 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05c807d480 con 0x7f05d40994b0 2024-08-17T02:26:04.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f05d3fff700 1 --2- 172.21.15.102:0/3559307210 >> [v2:172.21.15.121:6808/24413,v1:172.21.15.121:6809/24413] conn(0x7f05c0068b40 0x7f05c006af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f497a7fc700 1 --2- 172.21.15.102:0/3029394067 >> [v2:172.21.15.102:6816/24227,v1:172.21.15.102:6817/24227] conn(0x7f496c068b40 0x7f496c06af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f497a7fc700 1 -- 172.21.15.102:0/3029394067 --> [v2:172.21.15.102:6816/24227,v1:172.21.15.102:6817/24227] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f496c06b600 con 0x7f496c068b40 2024-08-17T02:26:04.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f497a7fc700 1 -- 172.21.15.102:0/3029394067 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f497c07d310 con 0x7f498c0a9cd0 2024-08-17T02:26:04.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f4f62ffd700 1 --2- 172.21.15.102:0/2748049171 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4f68060930 0x7f4f68062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f4f62ffd700 1 -- 172.21.15.102:0/2748049171 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f7007bf70 con 0x7f4f7c06e890 2024-08-17T02:26:04.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f4f62ffd700 1 --2- 172.21.15.102:0/2748049171 >> [v2:172.21.15.121:6800/24415,v1:172.21.15.121:6801/24415] conn(0x7f4f68068b40 0x7f4f6806af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f4f62ffd700 1 -- 172.21.15.102:0/2748049171 --> [v2:172.21.15.121:6800/24415,v1:172.21.15.121:6801/24415] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f6806b600 con 0x7f4f68068b40 2024-08-17T02:26:04.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f4f62ffd700 1 -- 172.21.15.102:0/2748049171 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f7007e5b0 con 0x7f4f7c06e890 2024-08-17T02:26:04.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f4f7affd700 1 --2- 172.21.15.102:0/2748049171 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4f68060930 0x7f4f68062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7f4f7b7fe700 1 --2- 172.21.15.102:0/2748049171 >> [v2:172.21.15.121:6800/24415,v1:172.21.15.121:6801/24415] conn(0x7f4f68068b40 0x7f4f6806af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7f05d37fe700 1 --2- 172.21.15.102:0/3559307210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f05c0060930 0x7f05c0062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fd1e1ffb700 1 -- 172.21.15.102:0/4045172435 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd1e803abb0 con 0x7fd1ec1693c0 2024-08-17T02:26:04.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fd1e1ffb700 1 --2- 172.21.15.102:0/4045172435 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd1d00608e0 0x7fd1d0062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fd1e1ffb700 1 -- 172.21.15.102:0/4045172435 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1e807c980 con 0x7fd1ec1693c0 2024-08-17T02:26:04.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fd1e1ffb700 1 --2- 172.21.15.102:0/4045172435 >> [v2:172.21.15.102:6800/24225,v1:172.21.15.102:6801/24225] conn(0x7fd1d0068af0 0x7fd1d006af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fd1e1ffb700 1 -- 172.21.15.102:0/4045172435 --> [v2:172.21.15.102:6800/24225,v1:172.21.15.102:6801/24225] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1d006b5b0 con 0x7fd1d0068af0 2024-08-17T02:26:04.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fd1e1ffb700 1 -- 172.21.15.102:0/4045172435 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1e807ccb0 con 0x7fd1ec1693c0 2024-08-17T02:26:04.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7fd1f1f58700 1 --2- 172.21.15.102:0/4045172435 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd1d00608e0 0x7fd1d0062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7f498ad9d700 1 --2- 172.21.15.102:0/3029394067 >> [v2:172.21.15.102:6816/24227,v1:172.21.15.102:6817/24227] conn(0x7f496c068b40 0x7f496c06af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7f05d3fff700 1 --2- 172.21.15.102:0/3559307210 >> [v2:172.21.15.121:6808/24413,v1:172.21.15.121:6809/24413] conn(0x7f05c0068b40 0x7f05c006af50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7f498ad9d700 1 --2- 172.21.15.102:0/3029394067 >> [v2:172.21.15.102:6816/24227,v1:172.21.15.102:6817/24227] conn(0x7f496c068b40 0x7f496c06af50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7f4f7affd700 1 --2- 172.21.15.102:0/2748049171 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4f68060930 0x7f4f68062de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c006fd0 tx=0x7f4f6c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7f4f7b7fe700 1 --2- 172.21.15.102:0/2748049171 >> [v2:172.21.15.121:6800/24415,v1:172.21.15.121:6801/24415] conn(0x7f4f68068b40 0x7f4f6806af50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7fd1f1f58700 1 --2- 172.21.15.102:0/4045172435 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd1d00608e0 0x7fd1d0062d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4000f80 tx=0x7fd1e4007da0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7f05d37fe700 1 --2- 172.21.15.102:0/3559307210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f05c0060930 0x7f05c0062de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f05c4006fd0 tx=0x7f05c4009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7f497a7fc700 1 -- 172.21.15.102:0/3029394067 <== osd.0 v2:172.21.15.102:6816/24227 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f496c06b600 con 0x7f496c068b40 2024-08-17T02:26:04.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7f05bb7fe700 1 -- 172.21.15.102:0/3559307210 <== osd.5 v2:172.21.15.121:6808/24413 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f05c006b600 con 0x7f05c0068b40 2024-08-17T02:26:04.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7f4f62ffd700 1 -- 172.21.15.102:0/2748049171 <== osd.7 v2:172.21.15.121:6800/24415 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f4f6806b600 con 0x7f4f68068b40 2024-08-17T02:26:04.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fb0af7fe700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb0b0159940 0x7fb0b00b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fb0af7fe700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb0b0159940 0x7fb0b00b2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:49316/0 (socket says 172.21.15.102:49316) 2024-08-17T02:26:04.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.849+0000 7fb0af7fe700 1 -- 172.21.15.102:0/3847446550 learned_addr learned my addr 172.21.15.102:0/3847446550 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:04.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7fb0af7fe700 1 -- 172.21.15.102:0/3847446550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0b00b3d20 msgr2=0x7fb0b00aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7fb0af7fe700 1 --2- 172.21.15.102:0/3847446550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0b00b3d20 0x7fb0b00aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7fb0af7fe700 1 -- 172.21.15.102:0/3847446550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0b0159570 msgr2=0x7fb0b00b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7fb0af7fe700 1 --2- 172.21.15.102:0/3847446550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0b0159570 0x7fb0b00b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7fb0af7fe700 1 -- 172.21.15.102:0/3847446550 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a00094f0 con 0x7fb0b0159940 2024-08-17T02:26:04.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7fb0af7fe700 1 --2- 172.21.15.102:0/3847446550 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb0b0159940 0x7fb0b00b2670 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800c910 tx=0x7fb0a80027a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7fb096ffd700 1 -- 172.21.15.102:0/3847446550 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8015b70 con 0x7fb0b0159940 2024-08-17T02:26:04.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7fb096ffd700 1 -- 172.21.15.102:0/3847446550 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a8015cf0 con 0x7fb0b0159940 2024-08-17T02:26:04.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7fb0b5995700 1 -- 172.21.15.102:0/3847446550 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b0148a00 con 0x7fb0b0159940 2024-08-17T02:26:04.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7fb096ffd700 1 -- 172.21.15.102:0/3847446550 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a800a8b0 con 0x7fb0b0159940 2024-08-17T02:26:04.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7fb0b5995700 1 -- 172.21.15.102:0/3847446550 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b01494e0 con 0x7fb0b0159940 2024-08-17T02:26:04.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.853+0000 7fb096ffd700 1 -- 172.21.15.102:0/3847446550 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb0a800aca0 con 0x7fb0b0159940 2024-08-17T02:26:04.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.857+0000 7fb096ffd700 1 --2- 172.21.15.102:0/3847446550 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb09c0718a0 0x7fb09c073d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.857+0000 7fb096ffd700 1 -- 172.21.15.102:0/3847446550 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb0a807cd10 con 0x7fb0b0159940 2024-08-17T02:26:04.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.857+0000 7fb0aeffd700 1 --2- 172.21.15.102:0/3847446550 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb09c0718a0 0x7fb09c073d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.857+0000 7fb0aeffd700 1 --2- 172.21.15.102:0/3847446550 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb09c0718a0 0x7fb09c073d50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00099b0 tx=0x7fb0a0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.861+0000 7f498a59c700 1 --2- 172.21.15.102:0/3029394067 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f496c060930 0x7f496c062de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f498c06cad0 tx=0x7f4980017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.865+0000 7fd1f1757700 1 --2- 172.21.15.102:0/4045172435 >> [v2:172.21.15.102:6800/24225,v1:172.21.15.102:6801/24225] conn(0x7fd1d0068af0 0x7fd1d006af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.865+0000 7fb0b5995700 1 --2- 172.21.15.102:0/3847446550 >> [v2:172.21.15.102:6808/24226,v1:172.21.15.102:6809/24226] conn(0x7fb0b0069670 0x7fb0b01476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.865+0000 7fb0b5995700 1 -- 172.21.15.102:0/3847446550 --> [v2:172.21.15.102:6808/24226,v1:172.21.15.102:6809/24226] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0b0071590 con 0x7fb0b0069670 2024-08-17T02:26:04.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.865+0000 7fd1f1757700 1 --2- 172.21.15.102:0/4045172435 >> [v2:172.21.15.102:6800/24225,v1:172.21.15.102:6801/24225] conn(0x7fd1d0068af0 0x7fd1d006af00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.865+0000 7fb0ae7fc700 1 --2- 172.21.15.102:0/3847446550 >> [v2:172.21.15.102:6808/24226,v1:172.21.15.102:6809/24226] conn(0x7fb0b0069670 0x7fb0b01476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.865+0000 7fb0ae7fc700 1 --2- 172.21.15.102:0/3847446550 >> [v2:172.21.15.102:6808/24226,v1:172.21.15.102:6809/24226] conn(0x7fb0b0069670 0x7fb0b01476d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.865+0000 7fd1e1ffb700 1 -- 172.21.15.102:0/4045172435 <== osd.3 v2:172.21.15.102:6800/24225 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd1d006b5b0 con 0x7fd1d0068af0 2024-08-17T02:26:04.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.865+0000 7fb096ffd700 1 -- 172.21.15.102:0/3847446550 <== osd.2 v2:172.21.15.102:6808/24226 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb0b0071590 con 0x7fb0b0069670 2024-08-17T02:26:04.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.873+0000 7f094d4c9700 1 -- 172.21.15.102:0/3004122166 --> [v2:172.21.15.102:6824/24224,v1:172.21.15.102:6825/24224] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f09480cb230 con 0x7f0934068a70 2024-08-17T02:26:04.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.873+0000 7f6d65f61700 1 -- 172.21.15.102:0/2697896113 --> [v2:172.21.15.121:6824/24414,v1:172.21.15.121:6825/24414] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6d6006b220 con 0x7f6d4c068980 2024-08-17T02:26:04.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.873+0000 7ff63949d700 1 -- 172.21.15.102:0/1284570464 --> [v2:172.21.15.121:6816/24418,v1:172.21.15.121:6817/24418] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff63406a200 con 0x7ff6340ab070 2024-08-17T02:26:04.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.873+0000 7f092effd700 1 -- 172.21.15.102:0/3004122166 <== osd.1 v2:172.21.15.102:6824/24224 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f09480cb230 con 0x7f0934068a70 2024-08-17T02:26:04.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.873+0000 7f6d477fe700 1 -- 172.21.15.102:0/2697896113 <== osd.4 v2:172.21.15.121:6824/24414 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6d6006b220 con 0x7f6d4c068980 2024-08-17T02:26:04.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.873+0000 7ff61affd700 1 -- 172.21.15.102:0/1284570464 <== osd.6 v2:172.21.15.121:6816/24418 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff63406a200 con 0x7ff6340ab070 2024-08-17T02:26:04.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.873+0000 7f094d4c9700 1 -- 172.21.15.102:0/3004122166 >> [v2:172.21.15.102:6824/24224,v1:172.21.15.102:6825/24224] conn(0x7f0934068a70 msgr2=0x7f093406ae80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.873+0000 7f094d4c9700 1 --2- 172.21.15.102:0/3004122166 >> [v2:172.21.15.102:6824/24224,v1:172.21.15.102:6825/24224] conn(0x7f0934068a70 0x7f093406ae80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.873+0000 7f094d4c9700 1 -- 172.21.15.102:0/3004122166 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f09340608e0 msgr2=0x7f0934062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.873+0000 7f094d4c9700 1 --2- 172.21.15.102:0/3004122166 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f09340608e0 0x7f0934062d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f093c00ac00 tx=0x7f093c006f90 comp rx=0 tx=0).stop 2024-08-17T02:26:04.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.873+0000 7f094d4c9700 1 -- 172.21.15.102:0/3004122166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09480adf10 msgr2=0x7f0948143490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.873+0000 7f094d4c9700 1 --2- 172.21.15.102:0/3004122166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09480adf10 0x7f0948143490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f094000cbf0 tx=0x7f09400019d0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.873+0000 7f09477fe700 1 -- 172.21.15.102:0/3004122166 reap_dead start 2024-08-17T02:26:04.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7f094d4c9700 1 -- 172.21.15.102:0/3004122166 shutdown_connections 2024-08-17T02:26:04.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7f094d4c9700 1 -- 172.21.15.102:0/3004122166 >> 172.21.15.102:0/3004122166 conn(0x7f0948067810 msgr2=0x7f09480aad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7f094d4c9700 1 -- 172.21.15.102:0/3004122166 shutdown_connections 2024-08-17T02:26:04.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7f094d4c9700 1 -- 172.21.15.102:0/3004122166 wait complete. 2024-08-17T02:26:04.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7f6d65f61700 1 -- 172.21.15.102:0/2697896113 >> [v2:172.21.15.121:6824/24414,v1:172.21.15.121:6825/24414] conn(0x7f6d4c068980 msgr2=0x7f6d4c06ad90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7f6d65f61700 1 --2- 172.21.15.102:0/2697896113 >> [v2:172.21.15.121:6824/24414,v1:172.21.15.121:6825/24414] conn(0x7f6d4c068980 0x7f6d4c06ad90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7ff63949d700 1 -- 172.21.15.102:0/1284570464 >> [v2:172.21.15.121:6816/24418,v1:172.21.15.121:6817/24418] conn(0x7ff6340ab070 msgr2=0x7ff634069cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7ff63949d700 1 --2- 172.21.15.102:0/1284570464 >> [v2:172.21.15.121:6816/24418,v1:172.21.15.121:6817/24418] conn(0x7ff6340ab070 0x7ff634069cc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7ff63949d700 1 -- 172.21.15.102:0/1284570464 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff620060860 msgr2=0x7ff620062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7ff63949d700 1 --2- 172.21.15.102:0/1284570464 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff620060860 0x7ff620062d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00fa40 tx=0x7ff62c01e000 comp rx=0 tx=0).stop 2024-08-17T02:26:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7ff63949d700 1 -- 172.21.15.102:0/1284570464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6340b0f10 msgr2=0x7ff634152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7ff63949d700 1 --2- 172.21.15.102:0/1284570464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6340b0f10 0x7ff634152c70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff62800c760 tx=0x7ff628007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7ff6337fe700 1 -- 172.21.15.102:0/1284570464 reap_dead start 2024-08-17T02:26:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7ff63949d700 1 -- 172.21.15.102:0/1284570464 shutdown_connections 2024-08-17T02:26:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7ff63949d700 1 -- 172.21.15.102:0/1284570464 >> 172.21.15.102:0/1284570464 conn(0x7ff634067810 msgr2=0x7ff6340cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7f6d65f61700 1 -- 172.21.15.102:0/2697896113 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6d4c0608e0 msgr2=0x7f6d4c062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7f6d65f61700 1 --2- 172.21.15.102:0/2697896113 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6d4c0608e0 0x7f6d4c062d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6d50000c00 tx=0x7f6d50007f10 comp rx=0 tx=0).stop 2024-08-17T02:26:04.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7ff63949d700 1 -- 172.21.15.102:0/1284570464 shutdown_connections 2024-08-17T02:26:04.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7f6d65f61700 1 -- 172.21.15.102:0/2697896113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d601579d0 msgr2=0x7f6d60144020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7f6d65f61700 1 --2- 172.21.15.102:0/2697896113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d601579d0 0x7f6d60144020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6d540088a0 tx=0x7f6d5400d530 comp rx=0 tx=0).stop 2024-08-17T02:26:04.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7f6d5ffff700 1 -- 172.21.15.102:0/2697896113 reap_dead start 2024-08-17T02:26:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7f6d65f61700 1 -- 172.21.15.102:0/2697896113 shutdown_connections 2024-08-17T02:26:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7f6d65f61700 1 -- 172.21.15.102:0/2697896113 >> 172.21.15.102:0/2697896113 conn(0x7f6d60067890 msgr2=0x7f6d6006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7ff63949d700 1 -- 172.21.15.102:0/1284570464 wait complete. 2024-08-17T02:26:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7f6d65f61700 1 -- 172.21.15.102:0/2697896113 shutdown_connections 2024-08-17T02:26:04.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.877+0000 7f6d65f61700 1 -- 172.21.15.102:0/2697896113 wait complete. 2024-08-17T02:26:04.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.881+0000 7f4990bef700 1 -- 172.21.15.102:0/3029394067 --> [v2:172.21.15.102:6816/24227,v1:172.21.15.102:6817/24227] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f498c0645c0 con 0x7f496c068b40 2024-08-17T02:26:04.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.881+0000 7f497a7fc700 1 -- 172.21.15.102:0/3029394067 <== osd.0 v2:172.21.15.102:6816/24227 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f498c0645c0 con 0x7f496c068b40 2024-08-17T02:26:04.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.881+0000 7f4f81715700 1 -- 172.21.15.102:0/2748049171 --> [v2:172.21.15.121:6800/24415,v1:172.21.15.121:6801/24415] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4f7c0708e0 con 0x7f4f68068b40 2024-08-17T02:26:04.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.885+0000 7f4990bef700 1 -- 172.21.15.102:0/3029394067 >> [v2:172.21.15.102:6816/24227,v1:172.21.15.102:6817/24227] conn(0x7f496c068b40 msgr2=0x7f496c06af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.885+0000 7f4990bef700 1 --2- 172.21.15.102:0/3029394067 >> [v2:172.21.15.102:6816/24227,v1:172.21.15.102:6817/24227] conn(0x7f496c068b40 0x7f496c06af50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.885+0000 7f05d9f86700 1 -- 172.21.15.102:0/3559307210 --> [v2:172.21.15.121:6808/24413,v1:172.21.15.121:6809/24413] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f05b4002d30 con 0x7f05c0068b40 2024-08-17T02:26:04.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.885+0000 7f4990bef700 1 -- 172.21.15.102:0/3029394067 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f496c060930 msgr2=0x7f496c062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.885+0000 7f4990bef700 1 --2- 172.21.15.102:0/3029394067 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f496c060930 0x7f496c062de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f498c06cad0 tx=0x7f4980017000 comp rx=0 tx=0).stop 2024-08-17T02:26:04.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.885+0000 7f4990bef700 1 -- 172.21.15.102:0/3029394067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f498c0a9cd0 msgr2=0x7f498c0ad4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.885+0000 7f4990bef700 1 --2- 172.21.15.102:0/3029394067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f498c0a9cd0 0x7f498c0ad4a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f497c00e900 tx=0x7f497c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.885+0000 7f498ad9d700 1 -- 172.21.15.102:0/3029394067 reap_dead start 2024-08-17T02:26:04.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.885+0000 7f4990bef700 1 -- 172.21.15.102:0/3029394067 shutdown_connections 2024-08-17T02:26:04.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.885+0000 7f4990bef700 1 -- 172.21.15.102:0/3029394067 >> 172.21.15.102:0/3029394067 conn(0x7f498c0cd160 msgr2=0x7f498c158e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.885+0000 7f4f62ffd700 1 -- 172.21.15.102:0/2748049171 <== osd.7 v2:172.21.15.121:6800/24415 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4f7c0708e0 con 0x7f4f68068b40 2024-08-17T02:26:04.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.885+0000 7f05bb7fe700 1 -- 172.21.15.102:0/3559307210 <== osd.5 v2:172.21.15.121:6808/24413 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f05b4002d30 con 0x7f05c0068b40 2024-08-17T02:26:04.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.889+0000 7f4f81715700 1 -- 172.21.15.102:0/2748049171 >> [v2:172.21.15.121:6800/24415,v1:172.21.15.121:6801/24415] conn(0x7f4f68068b40 msgr2=0x7f4f6806af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.889+0000 7f4f81715700 1 --2- 172.21.15.102:0/2748049171 >> [v2:172.21.15.121:6800/24415,v1:172.21.15.121:6801/24415] conn(0x7f4f68068b40 0x7f4f6806af50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.889+0000 7f4f81715700 1 -- 172.21.15.102:0/2748049171 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4f68060930 msgr2=0x7f4f68062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.889+0000 7f4f81715700 1 --2- 172.21.15.102:0/2748049171 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4f68060930 0x7f4f68062de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c006fd0 tx=0x7f4f6c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:04.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.889+0000 7f4f81715700 1 -- 172.21.15.102:0/2748049171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7c06e890 msgr2=0x7f4f7c1563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.889+0000 7f4f81715700 1 --2- 172.21.15.102:0/2748049171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7c06e890 0x7f4f7c1563b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000c560 tx=0x7f4f70007ce0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.889+0000 7f4f7b7fe700 1 -- 172.21.15.102:0/2748049171 reap_dead start 2024-08-17T02:26:04.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.889+0000 7f4f81715700 1 -- 172.21.15.102:0/2748049171 shutdown_connections 2024-08-17T02:26:04.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.889+0000 7f4f81715700 1 -- 172.21.15.102:0/2748049171 >> 172.21.15.102:0/2748049171 conn(0x7f4f7c0cd160 msgr2=0x7f4f7c0af690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.889+0000 7f4f81715700 1 -- 172.21.15.102:0/2748049171 shutdown_connections 2024-08-17T02:26:04.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.889+0000 7f4f81715700 1 -- 172.21.15.102:0/2748049171 wait complete. 2024-08-17T02:26:04.945 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-08-17T02:26:04.946 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:26:04.947 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-08-17T02:26:04.947 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:26:04.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7f4990bef700 1 -- 172.21.15.102:0/3029394067 shutdown_connections 2024-08-17T02:26:04.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7f4990bef700 1 -- 172.21.15.102:0/3029394067 wait complete. 2024-08-17T02:26:04.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fd1f2f5a700 1 -- 172.21.15.102:0/4045172435 --> [v2:172.21.15.102:6800/24225,v1:172.21.15.102:6801/24225] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd1ec0cb710 con 0x7fd1d0068af0 2024-08-17T02:26:04.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fd1e1ffb700 1 -- 172.21.15.102:0/4045172435 <== osd.3 v2:172.21.15.102:6800/24225 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd1ec0cb710 con 0x7fd1d0068af0 2024-08-17T02:26:04.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fb0b5995700 1 -- 172.21.15.102:0/3847446550 --> [v2:172.21.15.102:6808/24226,v1:172.21.15.102:6809/24226] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb0b0069a40 con 0x7fb0b0069670 2024-08-17T02:26:04.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fb096ffd700 1 -- 172.21.15.102:0/3847446550 <== osd.2 v2:172.21.15.102:6808/24226 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb0b0069a40 con 0x7fb0b0069670 2024-08-17T02:26:04.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fd1f2f5a700 1 -- 172.21.15.102:0/4045172435 >> [v2:172.21.15.102:6800/24225,v1:172.21.15.102:6801/24225] conn(0x7fd1d0068af0 msgr2=0x7fd1d006af00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fd1f2f5a700 1 --2- 172.21.15.102:0/4045172435 >> [v2:172.21.15.102:6800/24225,v1:172.21.15.102:6801/24225] conn(0x7fd1d0068af0 0x7fd1d006af00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fd1f2f5a700 1 -- 172.21.15.102:0/4045172435 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd1d00608e0 msgr2=0x7fd1d0062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fd1f2f5a700 1 --2- 172.21.15.102:0/4045172435 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd1d00608e0 0x7fd1d0062d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4000f80 tx=0x7fd1e4007da0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fd1f2f5a700 1 -- 172.21.15.102:0/4045172435 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1ec1693c0 msgr2=0x7fd1ec169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fd1f2f5a700 1 --2- 172.21.15.102:0/4045172435 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd1ec1693c0 0x7fd1ec169830 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec15a7c0 tx=0x7fd1e8008040 comp rx=0 tx=0).stop 2024-08-17T02:26:04.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fd1f2759700 1 -- 172.21.15.102:0/4045172435 reap_dead start 2024-08-17T02:26:04.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fd1f2f5a700 1 -- 172.21.15.102:0/4045172435 shutdown_connections 2024-08-17T02:26:04.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fd1f2f5a700 1 -- 172.21.15.102:0/4045172435 >> 172.21.15.102:0/4045172435 conn(0x7fd1ec0ca930 msgr2=0x7fd1ec0c73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fb0b5995700 1 -- 172.21.15.102:0/3847446550 >> [v2:172.21.15.102:6808/24226,v1:172.21.15.102:6809/24226] conn(0x7fb0b0069670 msgr2=0x7fb0b01476d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fb0b5995700 1 --2- 172.21.15.102:0/3847446550 >> [v2:172.21.15.102:6808/24226,v1:172.21.15.102:6809/24226] conn(0x7fb0b0069670 0x7fb0b01476d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7f05d9f86700 1 -- 172.21.15.102:0/3559307210 >> [v2:172.21.15.121:6808/24413,v1:172.21.15.121:6809/24413] conn(0x7f05c0068b40 msgr2=0x7f05c006af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7f05d9f86700 1 --2- 172.21.15.102:0/3559307210 >> [v2:172.21.15.121:6808/24413,v1:172.21.15.121:6809/24413] conn(0x7f05c0068b40 0x7f05c006af50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fd1f2f5a700 1 -- 172.21.15.102:0/4045172435 shutdown_connections 2024-08-17T02:26:04.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fd1f2f5a700 1 -- 172.21.15.102:0/4045172435 wait complete. 2024-08-17T02:26:04.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7f05d9f86700 1 -- 172.21.15.102:0/3559307210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f05c0060930 msgr2=0x7f05c0062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7f05d9f86700 1 --2- 172.21.15.102:0/3559307210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f05c0060930 0x7f05c0062de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f05c4006fd0 tx=0x7f05c4009250 comp rx=0 tx=0).stop 2024-08-17T02:26:04.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7f05d9f86700 1 -- 172.21.15.102:0/3559307210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05d40994b0 msgr2=0x7f05d415c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7f05d9f86700 1 --2- 172.21.15.102:0/3559307210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05d40994b0 0x7f05d415c130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f05c800e950 tx=0x7f05c80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7f05d3fff700 1 -- 172.21.15.102:0/3559307210 reap_dead start 2024-08-17T02:26:04.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7f05d9f86700 1 -- 172.21.15.102:0/3559307210 shutdown_connections 2024-08-17T02:26:04.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7f05d9f86700 1 -- 172.21.15.102:0/3559307210 >> 172.21.15.102:0/3559307210 conn(0x7f05d40d02b0 msgr2=0x7f05d415cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fb0b5995700 1 -- 172.21.15.102:0/3847446550 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb09c0718a0 msgr2=0x7fb09c073d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fb0b5995700 1 --2- 172.21.15.102:0/3847446550 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb09c0718a0 0x7fb09c073d50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00099b0 tx=0x7fb0a0017000 comp rx=0 tx=0).stop 2024-08-17T02:26:04.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7f05d9f86700 1 -- 172.21.15.102:0/3559307210 shutdown_connections 2024-08-17T02:26:04.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7f05d9f86700 1 -- 172.21.15.102:0/3559307210 wait complete. 2024-08-17T02:26:04.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fb0b5995700 1 -- 172.21.15.102:0/3847446550 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb0b0159940 msgr2=0x7fb0b00b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fb0b5995700 1 --2- 172.21.15.102:0/3847446550 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb0b0159940 0x7fb0b00b2670 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800c910 tx=0x7fb0a80027a0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fb0af7fe700 1 -- 172.21.15.102:0/3847446550 reap_dead start 2024-08-17T02:26:04.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fb0b5995700 1 -- 172.21.15.102:0/3847446550 shutdown_connections 2024-08-17T02:26:04.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fb0b5995700 1 -- 172.21.15.102:0/3847446550 >> 172.21.15.102:0/3847446550 conn(0x7fb0b00996f0 msgr2=0x7fb0b0158890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fb0b5995700 1 -- 172.21.15.102:0/3847446550 shutdown_connections 2024-08-17T02:26:04.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:04.893+0000 7fb0b5995700 1 -- 172.21.15.102:0/3847446550 wait complete. 2024-08-17T02:26:04.955 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-08-17T02:26:04.955 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:26:04.956 INFO:teuthology.orchestra.run.smithi102.stdout:60129542151 2024-08-17T02:26:04.956 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:26:04.957 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-08-17T02:26:04.958 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:26:04.959 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-08-17T02:26:04.959 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:26:04.960 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-08-17T02:26:04.960 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:26:04.961 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-08-17T02:26:04.962 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:26:05.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.097+0000 7f5a2b1dc700 1 Processor -- start 2024-08-17T02:26:05.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.097+0000 7f5a2b1dc700 1 -- start start 2024-08-17T02:26:05.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.097+0000 7f5a2b1dc700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5a2414f850 0x7f5a240691f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.097+0000 7f5a2b1dc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5a240ae5d0 0x7f5a240aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.097+0000 7f5a2b1dc700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a24156910 con 0x7f5a2414fc20 2024-08-17T02:26:05.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.097+0000 7f5a2b1dc700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a24069a40 con 0x7f5a2414f850 2024-08-17T02:26:05.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.097+0000 7f5a2b1dc700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a24069d20 con 0x7f5a240ae5d0 2024-08-17T02:26:05.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.097+0000 7f5a28f78700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5a2414f850 0x7f5a240691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a28f78700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5a2414f850 0x7f5a240691f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44290/0 (socket says 172.21.15.102:44290) 2024-08-17T02:26:05.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a28f78700 1 -- 172.21.15.102:0/894764750 learned_addr learned my addr 172.21.15.102:0/894764750 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:05.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a29779700 1 --2- 172.21.15.102:0/894764750 >> v2:172.21.15.121:3300/0 conn(0x7f5a240ae5d0 0x7f5a240aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a29779700 1 -- 172.21.15.102:0/894764750 >> v2:172.21.15.102:3300/0 conn(0x7f5a2414f850 msgr2=0x7f5a240691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:05.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a29779700 1 --2- 172.21.15.102:0/894764750 >> v2:172.21.15.102:3300/0 conn(0x7f5a2414f850 0x7f5a240691f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f766759e700 1 Processor -- start 2024-08-17T02:26:05.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a29779700 1 -- 172.21.15.102:0/894764750 >> v1:172.21.15.121:6789/0 conn(0x7f5a2414fc20 legacy=0x7f5a24156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a29779700 1 -- 172.21.15.102:0/894764750 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2406a000 con 0x7f5a240ae5d0 2024-08-17T02:26:05.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f766759e700 1 -- start start 2024-08-17T02:26:05.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7fa76d632700 1 Processor -- start 2024-08-17T02:26:05.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7fa76d632700 1 -- start start 2024-08-17T02:26:05.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a29779700 1 --2- 172.21.15.102:0/894764750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a240ae5d0 0x7f5a240aa440 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5a140098e0 tx=0x7f5a140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25a11431cde5d4b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a237fe700 1 -- 172.21.15.102:0/894764750 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1400f750 con 0x7f5a240ae5d0 2024-08-17T02:26:05.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a237fe700 1 -- 172.21.15.102:0/894764750 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1400f8b0 con 0x7f5a240ae5d0 2024-08-17T02:26:05.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a237fe700 1 -- 172.21.15.102:0/894764750 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1400fc50 con 0x7f5a240ae5d0 2024-08-17T02:26:05.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f310af83700 1 Processor -- start 2024-08-17T02:26:05.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f766759e700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f76600e19b0 0x7f76600e1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f766759e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7660054440 0x7f7660006b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f766759e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76600507b0 con 0x7f7660006740 2024-08-17T02:26:05.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f766759e700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76600070d0 con 0x7f76600e19b0 2024-08-17T02:26:05.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f766759e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7660050c40 con 0x7f7660054440 2024-08-17T02:26:05.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7fa76d632700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa7680b0350 0x7fa7680ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7fa76d632700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa76806df10 0x7fa76806e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7fa76d632700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76806e8b0 con 0x7fa768155d20 2024-08-17T02:26:05.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7fa76d632700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7680b07a0 con 0x7fa7680b0350 2024-08-17T02:26:05.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7fa76d632700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7680af2b0 con 0x7fa76806df10 2024-08-17T02:26:05.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a2b1dc700 1 -- 172.21.15.102:0/894764750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a240ae5d0 msgr2=0x7f5a240aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a2b1dc700 1 --2- 172.21.15.102:0/894764750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a240ae5d0 0x7f5a240aa440 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5a140098e0 tx=0x7f5a140091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f310af83700 1 -- start start 2024-08-17T02:26:05.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7fa767fff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa768155d20 0x7fa7680aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:37524/0 (socket says 172.21.15.102:37524) 2024-08-17T02:26:05.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7fa767fff700 1 -- 172.21.15.102:0/1243156087 learned_addr learned my addr 172.21.15.102:0/1243156087 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:05.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f7666d9d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7660054440 0x7f7660006b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f7666d9d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7660054440 0x7f7660006b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:49324/0 (socket says 172.21.15.102:49324) 2024-08-17T02:26:05.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f7666d9d700 1 -- 172.21.15.102:0/2446944579 learned_addr learned my addr 172.21.15.102:0/2446944579 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:05.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7fa7677fe700 1 --2- 172.21.15.102:0/1243156087 >> v2:172.21.15.102:3300/0 conn(0x7fa7680b0350 0x7fa7680ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7fa76ce31700 1 --2- 172.21.15.102:0/1243156087 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa76806df10 0x7fa76806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a2b1dc700 1 -- 172.21.15.102:0/894764750 shutdown_connections 2024-08-17T02:26:05.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a2b1dc700 1 --2- 172.21.15.102:0/894764750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a240ae5d0 0x7f5a240aa440 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a2b1dc700 1 --2- 172.21.15.102:0/894764750 >> v2:172.21.15.102:3300/0 conn(0x7f5a2414f850 0x7f5a240691f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a2b1dc700 1 -- 172.21.15.102:0/894764750 >> 172.21.15.102:0/894764750 conn(0x7f5a24068300 msgr2=0x7f5a240a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a2b1dc700 1 -- 172.21.15.102:0/894764750 shutdown_connections 2024-08-17T02:26:05.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f766659c700 1 --2- 172.21.15.102:0/2446944579 >> v2:172.21.15.102:3300/0 conn(0x7f76600e19b0 0x7f76600e1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f7666d9d700 1 -- 172.21.15.102:0/2446944579 >> v2:172.21.15.102:3300/0 conn(0x7f76600e19b0 msgr2=0x7f76600e1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:05.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f7666d9d700 1 --2- 172.21.15.102:0/2446944579 >> v2:172.21.15.102:3300/0 conn(0x7f76600e19b0 0x7f76600e1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f7666d9d700 1 -- 172.21.15.102:0/2446944579 >> v1:172.21.15.121:6789/0 conn(0x7f7660006740 legacy=0x7f7660053d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f7666d9d700 1 -- 172.21.15.102:0/2446944579 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766004fba0 con 0x7f7660054440 2024-08-17T02:26:05.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7fa7677fe700 1 -- 172.21.15.102:0/1243156087 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa76806df10 msgr2=0x7fa76806e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:05.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7fa7677fe700 1 --2- 172.21.15.102:0/1243156087 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa76806df10 0x7fa76806e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7fa7677fe700 1 -- 172.21.15.102:0/1243156087 >> v1:172.21.15.121:6789/0 conn(0x7fa768155d20 legacy=0x7fa7680aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7fa7677fe700 1 -- 172.21.15.102:0/1243156087 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7680af590 con 0x7fa7680b0350 2024-08-17T02:26:05.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f310af83700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f31040ae120 0x7f310406dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f5a2b1dc700 1 -- 172.21.15.102:0/894764750 wait complete. 2024-08-17T02:26:05.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f310af83700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f310406e520 0x7f31040a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7fa7677fe700 1 --2- 172.21.15.102:0/1243156087 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7680b0350 0x7fa7680ad7c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0098e0 tx=0x7fa75c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9329184492e29a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f310af83700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31040a9260 0x7f3104158f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f3109780700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f310406e520 0x7f31040a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f3109f81700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f31040ae120 0x7f310406dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f3109780700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f310406e520 0x7f31040a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44316/0 (socket says 172.21.15.102:44316) 2024-08-17T02:26:05.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f3109780700 1 -- 172.21.15.102:0/2767596162 learned_addr learned my addr 172.21.15.102:0/2767596162 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:05.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f3109f81700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f31040ae120 0x7f310406dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:53250/0 (socket says 172.21.15.102:53250) 2024-08-17T02:26:05.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.101+0000 7f310af83700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310406e9a0 con 0x7f310406e520 2024-08-17T02:26:05.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f310af83700 1 -- 172.21.15.102:0/2767596162 --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31040a96c0 con 0x7f31040ae120 2024-08-17T02:26:05.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f310af83700 1 -- 172.21.15.102:0/2767596162 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31040af620 con 0x7f31040a9260 2024-08-17T02:26:05.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7fa766ffd700 1 -- 172.21.15.102:0/1243156087 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00b640 con 0x7fa7680b0350 2024-08-17T02:26:05.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7fa766ffd700 1 -- 172.21.15.102:0/1243156087 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c00b7a0 con 0x7fa7680b0350 2024-08-17T02:26:05.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7fa766ffd700 1 -- 172.21.15.102:0/1243156087 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00bb40 con 0x7fa7680b0350 2024-08-17T02:26:05.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f310a782700 1 --2- 172.21.15.102:0/2767596162 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31040a9260 0x7f3104158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f3109780700 1 -- 172.21.15.102:0/2767596162 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31040a9260 msgr2=0x7f3104158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:05.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f3109780700 1 --2- 172.21.15.102:0/2767596162 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31040a9260 0x7f3104158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f3109780700 1 -- 172.21.15.102:0/2767596162 >> v2:172.21.15.121:3300/0 conn(0x7f31040ae120 msgr2=0x7f310406dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:05.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f3109780700 1 --2- 172.21.15.102:0/2767596162 >> v2:172.21.15.121:3300/0 conn(0x7f31040ae120 0x7f310406dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f3109780700 1 -- 172.21.15.102:0/2767596162 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310406eba0 con 0x7f310406e520 2024-08-17T02:26:05.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f310a782700 1 --2- 172.21.15.102:0/2767596162 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31040a9260 0x7f3104158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:05.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f3109780700 1 --2- 172.21.15.102:0/2767596162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f310406e520 0x7f31040a8d20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3104070580 tx=0x7f30f400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4683d540583cb36d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7fa76d632700 1 -- 172.21.15.102:0/1243156087 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7680b0350 msgr2=0x7fa7680ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7fa76d632700 1 --2- 172.21.15.102:0/1243156087 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7680b0350 0x7fa7680ad7c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0098e0 tx=0x7fa75c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f3108f7f700 1 -- 172.21.15.102:0/2767596162 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f4010070 con 0x7f310406e520 2024-08-17T02:26:05.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f3108f7f700 1 -- 172.21.15.102:0/2767596162 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f400da20 con 0x7f310406e520 2024-08-17T02:26:05.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f3108f7f700 1 -- 172.21.15.102:0/2767596162 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f400b2e0 con 0x7f310406e520 2024-08-17T02:26:05.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f5a2b1dc700 1 Processor -- start 2024-08-17T02:26:05.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f7666d9d700 1 --2- 172.21.15.102:0/2446944579 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7660054440 0x7f7660006b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f765800bc40 tx=0x7f765800b4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68bcc3085e5f6da3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7fa76d632700 1 -- 172.21.15.102:0/1243156087 shutdown_connections 2024-08-17T02:26:05.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7fa76d632700 1 --2- 172.21.15.102:0/1243156087 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa76806df10 0x7fa76806e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7fa76d632700 1 --2- 172.21.15.102:0/1243156087 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7680b0350 0x7fa7680ad7c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7fa76d632700 1 -- 172.21.15.102:0/1243156087 >> 172.21.15.102:0/1243156087 conn(0x7fa7680678d0 msgr2=0x7fa768067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f5a2b1dc700 1 -- start start 2024-08-17T02:26:05.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7fa76d632700 1 -- 172.21.15.102:0/1243156087 shutdown_connections 2024-08-17T02:26:05.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7fa76d632700 1 -- 172.21.15.102:0/1243156087 wait complete. 2024-08-17T02:26:05.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f766559a700 1 -- 172.21.15.102:0/2446944579 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765800da90 con 0x7f7660054440 2024-08-17T02:26:05.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f766559a700 1 -- 172.21.15.102:0/2446944579 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765800dbf0 con 0x7f7660054440 2024-08-17T02:26:05.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f766559a700 1 -- 172.21.15.102:0/2446944579 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658017410 con 0x7f7660054440 2024-08-17T02:26:05.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f310af83700 1 -- 172.21.15.102:0/2767596162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f310406e520 msgr2=0x7f31040a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f310af83700 1 --2- 172.21.15.102:0/2767596162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f310406e520 0x7f31040a8d20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3104070580 tx=0x7f30f400b840 comp rx=0 tx=0).stop 2024-08-17T02:26:05.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f310af83700 1 -- 172.21.15.102:0/2767596162 shutdown_connections 2024-08-17T02:26:05.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f310af83700 1 --2- 172.21.15.102:0/2767596162 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31040a9260 0x7f3104158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f310af83700 1 --2- 172.21.15.102:0/2767596162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f310406e520 0x7f31040a8d20 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3104070580 tx=0x7f30f400b840 comp rx=0 tx=0).stop 2024-08-17T02:26:05.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f310af83700 1 --2- 172.21.15.102:0/2767596162 >> v2:172.21.15.121:3300/0 conn(0x7f31040ae120 0x7f310406dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f310af83700 1 -- 172.21.15.102:0/2767596162 >> 172.21.15.102:0/2767596162 conn(0x7f3104066e00 msgr2=0x7f3104067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f5a2b1dc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a240ae5d0 0x7f5a240b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f4508e86700 1 Processor -- start 2024-08-17T02:26:05.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f4508e86700 1 -- start start 2024-08-17T02:26:05.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f310af83700 1 -- 172.21.15.102:0/2767596162 shutdown_connections 2024-08-17T02:26:05.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f310af83700 1 -- 172.21.15.102:0/2767596162 wait complete. 2024-08-17T02:26:05.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7fa76d632700 1 Processor -- start 2024-08-17T02:26:05.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f766759e700 1 -- 172.21.15.102:0/2446944579 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7660054440 msgr2=0x7f7660006b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f766759e700 1 --2- 172.21.15.102:0/2446944579 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7660054440 0x7f7660006b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f765800bc40 tx=0x7f765800b4e0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f5a2b1dc700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5a2414f850 0x7f5a240aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f5a28f78700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a240ae5d0 0x7f5a240b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f5a28f78700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a240ae5d0 0x7f5a240b0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44324/0 (socket says 172.21.15.102:44324) 2024-08-17T02:26:05.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f766759e700 1 -- 172.21.15.102:0/2446944579 shutdown_connections 2024-08-17T02:26:05.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f766759e700 1 --2- 172.21.15.102:0/2446944579 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7660054440 0x7f7660006b90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f766759e700 1 --2- 172.21.15.102:0/2446944579 >> v2:172.21.15.102:3300/0 conn(0x7f76600e19b0 0x7f76600e1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f766759e700 1 -- 172.21.15.102:0/2446944579 >> 172.21.15.102:0/2446944579 conn(0x7f766000a030 msgr2=0x7f766000a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f5a2b1dc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a2414fc20 0x7f5a2414e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f5a28f78700 1 -- 172.21.15.102:0/884893096 learned_addr learned my addr 172.21.15.102:0/884893096 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:05.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f5a2b1dc700 1 -- 172.21.15.102:0/884893096 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2416c4d0 con 0x7f5a240ae5d0 2024-08-17T02:26:05.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f5a2b1dc700 1 -- 172.21.15.102:0/884893096 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240b1840 con 0x7f5a2414fc20 2024-08-17T02:26:05.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f5a2b1dc700 1 -- 172.21.15.102:0/884893096 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240b1b20 con 0x7f5a2414f850 2024-08-17T02:26:05.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f766759e700 1 -- 172.21.15.102:0/2446944579 shutdown_connections 2024-08-17T02:26:05.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f5a23fff700 1 --2- 172.21.15.102:0/884893096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5a2414f850 0x7f5a240aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f5a28f78700 1 -- 172.21.15.102:0/884893096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5a2414f850 msgr2=0x7f5a240aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f5a28f78700 1 --2- 172.21.15.102:0/884893096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5a2414f850 0x7f5a240aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f5a28f78700 1 -- 172.21.15.102:0/884893096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a2414fc20 msgr2=0x7f5a2414e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f5a28f78700 1 --2- 172.21.15.102:0/884893096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a2414fc20 0x7f5a2414e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f5a28f78700 1 -- 172.21.15.102:0/884893096 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a14009420 con 0x7f5a240ae5d0 2024-08-17T02:26:05.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f5a23fff700 1 --2- 172.21.15.102:0/884893096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5a2414f850 0x7f5a240aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:05.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f5a28f78700 1 --2- 172.21.15.102:0/884893096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a240ae5d0 0x7f5a240b0f60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800ea50 tx=0x7f5a18009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f5a20ff9700 1 -- 172.21.15.102:0/884893096 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1800c850 con 0x7f5a240ae5d0 2024-08-17T02:26:05.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f4508e86700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4504165c50 0x7f45041660d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f4508e86700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f450406df10 0x7f450406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f4508e86700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45040af2d0 con 0x7f45040aeb80 2024-08-17T02:26:05.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f4508e86700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450406e8f0 con 0x7f4504165c50 2024-08-17T02:26:05.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.105+0000 7f4508e86700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45041669b0 con 0x7f450406df10 2024-08-17T02:26:05.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f4503fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f450406df10 0x7f450406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f4503fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f450406df10 0x7f450406e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:49374/0 (socket says 172.21.15.102:49374) 2024-08-17T02:26:05.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f4503fff700 1 -- 172.21.15.102:0/730437709 learned_addr learned my addr 172.21.15.102:0/730437709 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:05.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f4503fff700 1 -- 172.21.15.102:0/730437709 >> v2:172.21.15.121:3300/0 conn(0x7f4504165c50 msgr2=0x7f45041660d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:05.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f4503fff700 1 --2- 172.21.15.102:0/730437709 >> v2:172.21.15.121:3300/0 conn(0x7f4504165c50 0x7f45041660d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f4503fff700 1 -- 172.21.15.102:0/730437709 >> v1:172.21.15.121:6789/0 conn(0x7f45040aeb80 legacy=0x7f45040b1550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:26:05.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f5a20ff9700 1 -- 172.21.15.102:0/884893096 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1800c9b0 con 0x7f5a240ae5d0 2024-08-17T02:26:05.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f5a20ff9700 1 -- 172.21.15.102:0/884893096 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1800cd30 con 0x7f5a240ae5d0 2024-08-17T02:26:05.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f4503fff700 1 -- 172.21.15.102:0/730437709 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4504166c90 con 0x7f450406df10 2024-08-17T02:26:05.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f310af83700 1 Processor -- start 2024-08-17T02:26:05.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f310af83700 1 -- start start 2024-08-17T02:26:05.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f4503fff700 1 --2- 172.21.15.102:0/730437709 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f450406df10 0x7f450406e3b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f44f80099b0 tx=0x7f44f8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ea83edef4d0b7bf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f766759e700 1 -- 172.21.15.102:0/2446944579 wait complete. 2024-08-17T02:26:05.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f766759e700 1 Processor -- start 2024-08-17T02:26:05.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f45027fc700 1 -- 172.21.15.102:0/730437709 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800b820 con 0x7f450406df10 2024-08-17T02:26:05.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f45027fc700 1 -- 172.21.15.102:0/730437709 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f800b980 con 0x7f450406df10 2024-08-17T02:26:05.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f45027fc700 1 -- 172.21.15.102:0/730437709 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800bd20 con 0x7f450406df10 2024-08-17T02:26:05.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f5a2b1dc700 1 -- 172.21.15.102:0/884893096 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2416c6e0 con 0x7f5a240ae5d0 2024-08-17T02:26:05.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f5a2b1dc700 1 -- 172.21.15.102:0/884893096 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a240b14a0 con 0x7f5a240ae5d0 2024-08-17T02:26:05.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f310af83700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31040a9260 0x7f3104157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f310af83700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31040ae120 0x7f31040997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f310af83700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3104155950 0x7f3104154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa76d632700 1 -- start start 2024-08-17T02:26:05.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f3109f81700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31040a9260 0x7f3104157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f310a782700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3104155950 0x7f3104154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f3109f81700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31040a9260 0x7f3104157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:49386/0 (socket says 172.21.15.102:49386) 2024-08-17T02:26:05.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f310a782700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3104155950 0x7f3104154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44334/0 (socket says 172.21.15.102:44334) 2024-08-17T02:26:05.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f3109780700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31040ae120 0x7f31040997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f3109f81700 1 -- 172.21.15.102:0/91313208 learned_addr learned my addr 172.21.15.102:0/91313208 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:05.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f310af83700 1 -- 172.21.15.102:0/91313208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310413df10 con 0x7f3104155950 2024-08-17T02:26:05.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f310af83700 1 -- 172.21.15.102:0/91313208 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3104155dd0 con 0x7f31040ae120 2024-08-17T02:26:05.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f310af83700 1 -- 172.21.15.102:0/91313208 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3104155190 con 0x7f31040a9260 2024-08-17T02:26:05.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa76d632700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa76806df10 0x7fa76813e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa76d632700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7680b0350 0x7fa76814ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f4508e86700 1 -- 172.21.15.102:0/730437709 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f450406df10 msgr2=0x7f450406e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f4508e86700 1 --2- 172.21.15.102:0/730437709 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f450406df10 0x7f450406e3b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f44f80099b0 tx=0x7f44f8009250 comp rx=0 tx=0).stop 2024-08-17T02:26:05.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa76d632700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa768155d20 0x7fa76814df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa76d632700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76814d230 con 0x7fa768155d20 2024-08-17T02:26:05.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa76d632700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76814dad0 con 0x7fa76806df10 2024-08-17T02:26:05.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa76d632700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76813ed80 con 0x7fa7680b0350 2024-08-17T02:26:05.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa767fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa76806df10 0x7fa76813e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa7677fe700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7680b0350 0x7fa76814ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa7677fe700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7680b0350 0x7fa76814ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:49394/0 (socket says 172.21.15.102:49394) 2024-08-17T02:26:05.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa7677fe700 1 -- 172.21.15.102:0/788372404 learned_addr learned my addr 172.21.15.102:0/788372404 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:05.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f5a2b1dc700 1 -- 172.21.15.102:0/884893096 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a240645c0 con 0x7f5a240ae5d0 2024-08-17T02:26:05.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f310a782700 1 -- 172.21.15.102:0/91313208 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31040a9260 msgr2=0x7f3104157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f310a782700 1 --2- 172.21.15.102:0/91313208 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31040a9260 0x7f3104157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f310a782700 1 -- 172.21.15.102:0/91313208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31040ae120 msgr2=0x7f31040997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f310a782700 1 --2- 172.21.15.102:0/91313208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31040ae120 0x7f31040997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f310a782700 1 -- 172.21.15.102:0/91313208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f400bae0 con 0x7f3104155950 2024-08-17T02:26:05.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f310a782700 1 --2- 172.21.15.102:0/91313208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3104155950 0x7f3104154c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009fa0 tx=0x7f30fc009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f766759e700 1 -- start start 2024-08-17T02:26:05.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa76ce31700 1 --2- 172.21.15.102:0/788372404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa768155d20 0x7fa76814df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa7677fe700 1 -- 172.21.15.102:0/788372404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa76806df10 msgr2=0x7fa76813e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa7677fe700 1 --2- 172.21.15.102:0/788372404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa76806df10 0x7fa76813e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa7677fe700 1 -- 172.21.15.102:0/788372404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa768155d20 msgr2=0x7fa76814df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa7677fe700 1 --2- 172.21.15.102:0/788372404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa768155d20 0x7fa76814df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa7677fe700 1 -- 172.21.15.102:0/788372404 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c009420 con 0x7fa7680b0350 2024-08-17T02:26:05.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7fa767fff700 1 --2- 172.21.15.102:0/788372404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa76806df10 0x7fa76813e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:05.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f4508e86700 1 -- 172.21.15.102:0/730437709 shutdown_connections 2024-08-17T02:26:05.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f4508e86700 1 --2- 172.21.15.102:0/730437709 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f450406df10 0x7f450406e3b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f4508e86700 1 --2- 172.21.15.102:0/730437709 >> v2:172.21.15.121:3300/0 conn(0x7f4504165c50 0x7f45041660d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f4508e86700 1 -- 172.21.15.102:0/730437709 >> 172.21.15.102:0/730437709 conn(0x7f45040678d0 msgr2=0x7f4504067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44ddd5e700 1 Processor -- start 2024-08-17T02:26:05.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f5a20ff9700 1 -- 172.21.15.102:0/884893096 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5a18013680 con 0x7f5a240ae5d0 2024-08-17T02:26:05.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f30f9ffb700 1 -- 172.21.15.102:0/91313208 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc00dbb0 con 0x7f3104155950 2024-08-17T02:26:05.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f30f9ffb700 1 -- 172.21.15.102:0/91313208 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30fc00f040 con 0x7f3104155950 2024-08-17T02:26:05.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.109+0000 7f30f9ffb700 1 -- 172.21.15.102:0/91313208 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc015440 con 0x7f3104155950 2024-08-17T02:26:05.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f310af83700 1 -- 172.21.15.102:0/91313208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3104155fe0 con 0x7f3104155950 2024-08-17T02:26:05.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f310af83700 1 -- 172.21.15.102:0/91313208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31041565a0 con 0x7f3104155950 2024-08-17T02:26:05.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f4508e86700 1 -- 172.21.15.102:0/730437709 shutdown_connections 2024-08-17T02:26:05.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7fa7677fe700 1 --2- 172.21.15.102:0/788372404 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7680b0350 0x7fa76814ee90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa76806c2d0 tx=0x7fa75c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f4508e86700 1 -- 172.21.15.102:0/730437709 wait complete. 2024-08-17T02:26:05.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f766759e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7660006740 0x7f7660037a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f766759e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7660054440 0x7f7660037f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f5a20ff9700 1 --2- 172.21.15.102:0/884893096 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5a100608e0 0x7f5a10062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f5a20ff9700 1 -- 172.21.15.102:0/884893096 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5a1807cef0 con 0x7f5a240ae5d0 2024-08-17T02:26:05.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f766759e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f76600e19b0 0x7f76601021b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f766759e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7660101f90 con 0x7f7660054440 2024-08-17T02:26:05.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f766759e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600ffaf0 con 0x7f7660006740 2024-08-17T02:26:05.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f766759e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7660039370 con 0x7f76600e19b0 2024-08-17T02:26:05.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44ddd5e700 1 -- start start 2024-08-17T02:26:05.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f310af83700 1 -- 172.21.15.102:0/91313208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31040adb00 con 0x7f3104155950 2024-08-17T02:26:05.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f5a23fff700 1 --2- 172.21.15.102:0/884893096 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5a100608e0 0x7f5a10062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f766659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7660006740 0x7f7660037a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f766659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7660006740 0x7f7660037a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:53302/0 (socket says 172.21.15.102:53302) 2024-08-17T02:26:05.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f766659c700 1 -- 172.21.15.102:0/1275763895 learned_addr learned my addr 172.21.15.102:0/1275763895 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:05.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f7665d9b700 1 --2- 172.21.15.102:0/1275763895 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7660054440 0x7f7660037f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f7666d9d700 1 --2- 172.21.15.102:0/1275763895 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f76600e19b0 0x7f76601021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f5a23fff700 1 --2- 172.21.15.102:0/884893096 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5a100608e0 0x7f5a10062d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c007fd0 tx=0x7f5a1c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f7665d9b700 1 -- 172.21.15.102:0/1275763895 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f76600e19b0 msgr2=0x7f76601021b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f7665d9b700 1 --2- 172.21.15.102:0/1275763895 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f76600e19b0 0x7f76601021b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f7665d9b700 1 -- 172.21.15.102:0/1275763895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7660006740 msgr2=0x7f7660037a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f7665d9b700 1 --2- 172.21.15.102:0/1275763895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7660006740 0x7f7660037a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f7665d9b700 1 -- 172.21.15.102:0/1275763895 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765800b780 con 0x7f7660054440 2024-08-17T02:26:05.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f4508e86700 1 Processor -- start 2024-08-17T02:26:05.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44ddd5e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d813f670 0x7f44d80b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44ddd5e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f44d813fa40 0x7f44d80ade00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44ddd5e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d80ae8c0 con 0x7f44d80ae340 2024-08-17T02:26:05.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44ddd5e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d80b1820 con 0x7f44d813fa40 2024-08-17T02:26:05.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44ddd5e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d80ad710 con 0x7f44d813f670 2024-08-17T02:26:05.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44dcd5c700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d813f670 0x7f44d80b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44dcd5c700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d813f670 0x7f44d80b1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:49406/0 (socket says 172.21.15.102:49406) 2024-08-17T02:26:05.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44dcd5c700 1 -- 172.21.15.102:0/3080148016 learned_addr learned my addr 172.21.15.102:0/3080148016 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:05.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f7665d9b700 1 --2- 172.21.15.102:0/1275763895 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7660054440 0x7f7660037f70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f765c00c490 tx=0x7f765c007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7fa757fff700 1 -- 172.21.15.102:0/788372404 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c01bc80 con 0x7fa7680b0350 2024-08-17T02:26:05.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7fa757fff700 1 -- 172.21.15.102:0/788372404 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c01be00 con 0x7fa7680b0350 2024-08-17T02:26:05.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7fa757fff700 1 -- 172.21.15.102:0/788372404 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c011670 con 0x7fa7680b0350 2024-08-17T02:26:05.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7fa76d632700 1 -- 172.21.15.102:0/788372404 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76814f500 con 0x7fa7680b0350 2024-08-17T02:26:05.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7fa76d632700 1 -- 172.21.15.102:0/788372404 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76814d760 con 0x7fa7680b0350 2024-08-17T02:26:05.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7fcd262d8700 1 Processor -- start 2024-08-17T02:26:05.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44d7fff700 1 --2- 172.21.15.102:0/3080148016 >> v2:172.21.15.121:3300/0 conn(0x7f44d813fa40 0x7f44d80ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7fcd262d8700 1 -- start start 2024-08-17T02:26:05.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f4508e86700 1 -- start start 2024-08-17T02:26:05.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44dcd5c700 1 -- 172.21.15.102:0/3080148016 >> v2:172.21.15.121:3300/0 conn(0x7f44d813fa40 msgr2=0x7f44d80ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:05.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44dcd5c700 1 --2- 172.21.15.102:0/3080148016 >> v2:172.21.15.121:3300/0 conn(0x7f44d813fa40 0x7f44d80ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44dcd5c700 1 -- 172.21.15.102:0/3080148016 >> v1:172.21.15.121:6789/0 conn(0x7f44d80ae340 legacy=0x7f44d806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44dcd5c700 1 -- 172.21.15.102:0/3080148016 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d80b0ef0 con 0x7f44d813f670 2024-08-17T02:26:05.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44d7fff700 1 --2- 172.21.15.102:0/3080148016 >> v2:172.21.15.121:3300/0 conn(0x7f44d813fa40 0x7f44d80ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:05.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7f44dcd5c700 1 --2- 172.21.15.102:0/3080148016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d813f670 0x7f44d80b1cb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f44d00099b0 tx=0x7f44d0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7a82ecd86936911 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.113+0000 7fa76d632700 1 -- 172.21.15.102:0/788372404 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7440052b0 con 0x7fa7680b0350 2024-08-17T02:26:05.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f44d77fe700 1 -- 172.21.15.102:0/3080148016 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d000b860 con 0x7f44d813f670 2024-08-17T02:26:05.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f44d77fe700 1 -- 172.21.15.102:0/3080148016 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d000b9c0 con 0x7f44d813f670 2024-08-17T02:26:05.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f44d77fe700 1 -- 172.21.15.102:0/3080148016 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d000bd60 con 0x7f44d813f670 2024-08-17T02:26:05.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f4508e86700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f450406df10 0x7f45040a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f4508e86700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45040aeb80 0x7f45040ada80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f4508e86700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4504165c50 0x7f4504182af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f4508e86700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45040a6040 con 0x7f450406df10 2024-08-17T02:26:05.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f45037fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f450406df10 0x7f45040a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f45037fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f450406df10 0x7f45040a9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44362/0 (socket says 172.21.15.102:44362) 2024-08-17T02:26:05.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f45037fe700 1 -- 172.21.15.102:0/2449609640 learned_addr learned my addr 172.21.15.102:0/2449609640 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:05.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f4508e86700 1 -- 172.21.15.102:0/2449609640 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45040a5450 con 0x7f4504165c50 2024-08-17T02:26:05.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f4508e86700 1 -- 172.21.15.102:0/2449609640 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45040a5710 con 0x7f45040aeb80 2024-08-17T02:26:05.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f4503fff700 1 --2- 172.21.15.102:0/2449609640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4504165c50 0x7f4504182af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd262d8700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd20155d20 0x7fcd200b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd262d8700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcd200ad7c0 0x7fcd200aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd262d8700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcd2006df10 0x7fcd2006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd262d8700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd200adc10 con 0x7fcd2006df10 2024-08-17T02:26:05.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd262d8700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2006e8d0 con 0x7fcd200ad7c0 2024-08-17T02:26:05.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd262d8700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd200af2b0 con 0x7fcd20155d20 2024-08-17T02:26:05.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd25ad7700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcd2006df10 0x7fcd2006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd25ad7700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcd2006df10 0x7fcd2006e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44376/0 (socket says 172.21.15.102:44376) 2024-08-17T02:26:05.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd25ad7700 1 -- 172.21.15.102:0/428977743 learned_addr learned my addr 172.21.15.102:0/428977743 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:05.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f45037fe700 1 -- 172.21.15.102:0/2449609640 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45040aeb80 msgr2=0x7f45040ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f45037fe700 1 --2- 172.21.15.102:0/2449609640 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45040aeb80 0x7f45040ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f45037fe700 1 -- 172.21.15.102:0/2449609640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4504165c50 msgr2=0x7f4504182af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f44ddd5e700 1 -- 172.21.15.102:0/3080148016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d813f670 msgr2=0x7f44d80b1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f44ddd5e700 1 --2- 172.21.15.102:0/3080148016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d813f670 0x7f44d80b1cb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f44d00099b0 tx=0x7f44d0009250 comp rx=0 tx=0).stop 2024-08-17T02:26:05.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f45037fe700 1 --2- 172.21.15.102:0/2449609640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4504165c50 0x7f4504182af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f45037fe700 1 -- 172.21.15.102:0/2449609640 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f80094f0 con 0x7f450406df10 2024-08-17T02:26:05.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f4503fff700 1 --2- 172.21.15.102:0/2449609640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4504165c50 0x7f4504182af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:05.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd252d6700 1 --2- 172.21.15.102:0/428977743 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd20155d20 0x7fcd200b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f45037fe700 1 --2- 172.21.15.102:0/2449609640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f450406df10 0x7f45040a9cd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f44f400b600 tx=0x7f44f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd25ad7700 1 -- 172.21.15.102:0/428977743 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd20155d20 msgr2=0x7fcd200b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:05.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd25ad7700 1 --2- 172.21.15.102:0/428977743 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd20155d20 0x7fcd200b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd25ad7700 1 -- 172.21.15.102:0/428977743 >> v2:172.21.15.121:3300/0 conn(0x7fcd200ad7c0 msgr2=0x7fcd200aea80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:05.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd25ad7700 1 --2- 172.21.15.102:0/428977743 >> v2:172.21.15.121:3300/0 conn(0x7fcd200ad7c0 0x7fcd200aea80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd25ad7700 1 -- 172.21.15.102:0/428977743 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd200af590 con 0x7fcd2006df10 2024-08-17T02:26:05.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fa757fff700 1 -- 172.21.15.102:0/788372404 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa75c011aa0 con 0x7fa7680b0350 2024-08-17T02:26:05.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd25ad7700 1 --2- 172.21.15.102:0/428977743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2006df10 0x7fcd2006e390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcd20070d00 tx=0x7fcd1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851011a8afb0a83d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f44ddd5e700 1 -- 172.21.15.102:0/3080148016 shutdown_connections 2024-08-17T02:26:05.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f44ddd5e700 1 --2- 172.21.15.102:0/3080148016 >> v2:172.21.15.121:3300/0 conn(0x7f44d813fa40 0x7f44d80ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f44ddd5e700 1 --2- 172.21.15.102:0/3080148016 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d813f670 0x7f44d80b1cb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f44ddd5e700 1 -- 172.21.15.102:0/3080148016 >> 172.21.15.102:0/3080148016 conn(0x7f44d80ca2b0 msgr2=0x7f44d806e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fa757fff700 1 --2- 172.21.15.102:0/788372404 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa74c060960 0x7fa74c062e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f44ddd5e700 1 -- 172.21.15.102:0/3080148016 shutdown_connections 2024-08-17T02:26:05.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f44ddd5e700 1 -- 172.21.15.102:0/3080148016 wait complete. 2024-08-17T02:26:05.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fa757fff700 1 -- 172.21.15.102:0/788372404 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa75c07e780 con 0x7fa7680b0350 2024-08-17T02:26:05.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fa767fff700 1 --2- 172.21.15.102:0/788372404 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa74c060960 0x7fa74c062e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fa767fff700 1 --2- 172.21.15.102:0/788372404 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa74c060960 0x7fa74c062e10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa758007110 tx=0x7fa758007f10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f5a20ff9700 1 -- 172.21.15.102:0/884893096 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5a1804d2a0 con 0x7f5a240ae5d0 2024-08-17T02:26:05.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f44ddd5e700 1 Processor -- start 2024-08-17T02:26:05.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f44ddd5e700 1 -- start start 2024-08-17T02:26:05.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f76567fc700 1 -- 172.21.15.102:0/1275763895 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c00ce40 con 0x7f7660054440 2024-08-17T02:26:05.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f76567fc700 1 -- 172.21.15.102:0/1275763895 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c011590 con 0x7f7660054440 2024-08-17T02:26:05.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f76567fc700 1 -- 172.21.15.102:0/1275763895 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c011950 con 0x7f7660054440 2024-08-17T02:26:05.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f766759e700 1 -- 172.21.15.102:0/1275763895 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76600384b0 con 0x7f7660054440 2024-08-17T02:26:05.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44ddd5e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d80ae340 0x7f44d814fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44ddd5e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44d813f670 0x7f44d806a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44ddd5e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44d813fa40 0x7f44d813dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44ddd5e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d806b3c0 con 0x7f44d813f670 2024-08-17T02:26:05.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44ddd5e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d81526a0 con 0x7f44d813fa40 2024-08-17T02:26:05.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44ddd5e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d806ab20 con 0x7f44d80ae340 2024-08-17T02:26:05.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44d7fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44d813f670 0x7f44d806a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44d7fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44d813f670 0x7f44d806a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44382/0 (socket says 172.21.15.102:44382) 2024-08-17T02:26:05.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44d7fff700 1 -- 172.21.15.102:0/3134462528 learned_addr learned my addr 172.21.15.102:0/3134462528 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:05.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44dcd5c700 1 --2- 172.21.15.102:0/3134462528 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d80ae340 0x7f44d814fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44dd55d700 1 --2- 172.21.15.102:0/3134462528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44d813fa40 0x7f44d813dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44d7fff700 1 -- 172.21.15.102:0/3134462528 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d80ae340 msgr2=0x7f44d814fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44d7fff700 1 --2- 172.21.15.102:0/3134462528 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d80ae340 0x7f44d814fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44d7fff700 1 -- 172.21.15.102:0/3134462528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44d813fa40 msgr2=0x7f44d813dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44d7fff700 1 --2- 172.21.15.102:0/3134462528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44d813fa40 0x7f44d813dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44d7fff700 1 -- 172.21.15.102:0/3134462528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d00094f0 con 0x7f44d813f670 2024-08-17T02:26:05.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f44d7fff700 1 --2- 172.21.15.102:0/3134462528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44d813f670 0x7f44d806a420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f44c000d860 tx=0x7f44c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd17fff700 1 -- 172.21.15.102:0/428977743 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c00b820 con 0x7fcd2006df10 2024-08-17T02:26:05.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd17fff700 1 -- 172.21.15.102:0/428977743 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c00b980 con 0x7fcd2006df10 2024-08-17T02:26:05.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7fcd17fff700 1 -- 172.21.15.102:0/428977743 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c00bd20 con 0x7fcd2006df10 2024-08-17T02:26:05.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7fcd262d8700 1 -- 172.21.15.102:0/428977743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2006df10 msgr2=0x7fcd2006e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7fcd262d8700 1 --2- 172.21.15.102:0/428977743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2006df10 0x7fcd2006e390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcd20070d00 tx=0x7fcd1c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:05.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7fcd262d8700 1 -- 172.21.15.102:0/428977743 shutdown_connections 2024-08-17T02:26:05.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7fcd262d8700 1 --2- 172.21.15.102:0/428977743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2006df10 0x7fcd2006e390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7fcd262d8700 1 --2- 172.21.15.102:0/428977743 >> v2:172.21.15.121:3300/0 conn(0x7fcd200ad7c0 0x7fcd200aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7fcd262d8700 1 --2- 172.21.15.102:0/428977743 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd20155d20 0x7fcd200b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7fcd262d8700 1 -- 172.21.15.102:0/428977743 >> 172.21.15.102:0/428977743 conn(0x7fcd200678d0 msgr2=0x7fcd20067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f30f9ffb700 1 -- 172.21.15.102:0/91313208 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f30fc01f440 con 0x7f3104155950 2024-08-17T02:26:05.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f30f9ffb700 1 --2- 172.21.15.102:0/91313208 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f30e8060860 0x7f30e8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f30f9ffb700 1 -- 172.21.15.102:0/91313208 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f30fc07d3b0 con 0x7f3104155950 2024-08-17T02:26:05.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f3109f81700 1 --2- 172.21.15.102:0/91313208 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f30e8060860 0x7f30e8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.117+0000 7f766759e700 1 -- 172.21.15.102:0/1275763895 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7660038a40 con 0x7f7660054440 2024-08-17T02:26:05.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7fcd262d8700 1 -- 172.21.15.102:0/428977743 shutdown_connections 2024-08-17T02:26:05.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7fcd262d8700 1 -- 172.21.15.102:0/428977743 wait complete. 2024-08-17T02:26:05.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7f3109f81700 1 --2- 172.21.15.102:0/91313208 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f30e8060860 0x7f30e8062d10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3100009dd0 tx=0x7f31000091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7fcd262d8700 1 Processor -- start 2024-08-17T02:26:05.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7fcd262d8700 1 -- start start 2024-08-17T02:26:05.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.121+0000 7fcd262d8700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2006df10 0x7fcd200a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd262d8700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd200ad7c0 0x7fcd20158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd262d8700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd20155d20 0x7fcd2014a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd262d8700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd200aa950 con 0x7fcd2006df10 2024-08-17T02:26:05.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd262d8700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2014c7a0 con 0x7fcd20155d20 2024-08-17T02:26:05.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd262d8700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2014c470 con 0x7fcd200ad7c0 2024-08-17T02:26:05.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd252d6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2006df10 0x7fcd200a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd252d6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2006df10 0x7fcd200a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44384/0 (socket says 172.21.15.102:44384) 2024-08-17T02:26:05.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd252d6700 1 -- 172.21.15.102:0/339216397 learned_addr learned my addr 172.21.15.102:0/339216397 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:05.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd25ad7700 1 --2- 172.21.15.102:0/339216397 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd20155d20 0x7fcd2014a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd24ad5700 1 --2- 172.21.15.102:0/339216397 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd200ad7c0 0x7fcd20158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd252d6700 1 -- 172.21.15.102:0/339216397 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd200ad7c0 msgr2=0x7fcd20158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd252d6700 1 --2- 172.21.15.102:0/339216397 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd200ad7c0 0x7fcd20158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd252d6700 1 -- 172.21.15.102:0/339216397 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd20155d20 msgr2=0x7fcd2014a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd252d6700 1 --2- 172.21.15.102:0/339216397 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd20155d20 0x7fcd2014a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd252d6700 1 -- 172.21.15.102:0/339216397 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c0094f0 con 0x7fcd2006df10 2024-08-17T02:26:05.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd24ad5700 1 --2- 172.21.15.102:0/339216397 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd200ad7c0 0x7fcd20158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:05.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7fcd252d6700 1 --2- 172.21.15.102:0/339216397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2006df10 0x7fcd200a9860 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000c8b0 tx=0x7fcd10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7f30f9ffb700 1 -- 172.21.15.102:0/91313208 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f30fc04d880 con 0x7f3104155950 2024-08-17T02:26:05.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7f44d4ff9700 1 -- 172.21.15.102:0/3134462528 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c00125f0 con 0x7f44d813f670 2024-08-17T02:26:05.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7f44ddd5e700 1 -- 172.21.15.102:0/3134462528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d806ae00 con 0x7f44d813f670 2024-08-17T02:26:05.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7f44ddd5e700 1 -- 172.21.15.102:0/3134462528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d813e100 con 0x7f44d813f670 2024-08-17T02:26:05.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7f44d4ff9700 1 -- 172.21.15.102:0/3134462528 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c0012750 con 0x7f44d813f670 2024-08-17T02:26:05.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7f766759e700 1 -- 172.21.15.102:0/1275763895 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76600053b0 con 0x7f7660054440 2024-08-17T02:26:05.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7f76567fc700 1 -- 172.21.15.102:0/1275763895 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f765c011cc0 con 0x7f7660054440 2024-08-17T02:26:05.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7f44d4ff9700 1 -- 172.21.15.102:0/3134462528 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0012ad0 con 0x7f44d813f670 2024-08-17T02:26:05.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7f44ddd5e700 1 -- 172.21.15.102:0/3134462528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc0052b0 con 0x7f44d813f670 2024-08-17T02:26:05.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7f44d4ff9700 1 -- 172.21.15.102:0/3134462528 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f44c0013480 con 0x7f44d813f670 2024-08-17T02:26:05.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7f76567fc700 1 --2- 172.21.15.102:0/1275763895 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7648060860 0x7f7648062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7f76567fc700 1 -- 172.21.15.102:0/1275763895 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f765c07be40 con 0x7f7660054440 2024-08-17T02:26:05.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7f766659c700 1 --2- 172.21.15.102:0/1275763895 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7648060860 0x7f7648062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.125+0000 7f766659c700 1 --2- 172.21.15.102:0/1275763895 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7648060860 0x7f7648062d10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f766804b8d0 tx=0x7f7668089040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.129+0000 7f44d4ff9700 1 --2- 172.21.15.102:0/3134462528 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f44b8060860 0x7f44b8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.129+0000 7f44dcd5c700 1 --2- 172.21.15.102:0/3134462528 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f44b8060860 0x7f44b8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.129+0000 7fa757fff700 1 -- 172.21.15.102:0/788372404 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa75c04ed30 con 0x7fa7680b0350 2024-08-17T02:26:05.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.129+0000 7f44dcd5c700 1 --2- 172.21.15.102:0/3134462528 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f44b8060860 0x7f44b8062d10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f44d00099b0 tx=0x7f44d0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.129+0000 7f76567fc700 1 -- 172.21.15.102:0/1275763895 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f765c04c290 con 0x7f7660054440 2024-08-17T02:26:05.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.129+0000 7f44d4ff9700 1 -- 172.21.15.102:0/3134462528 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f44c00102e0 con 0x7f44d813f670 2024-08-17T02:26:05.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.129+0000 7f44eb7fe700 1 -- 172.21.15.102:0/2449609640 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400f510 con 0x7f450406df10 2024-08-17T02:26:05.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.129+0000 7f44eb7fe700 1 -- 172.21.15.102:0/2449609640 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f400f690 con 0x7f450406df10 2024-08-17T02:26:05.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.129+0000 7f44eb7fe700 1 -- 172.21.15.102:0/2449609640 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f400fa50 con 0x7f450406df10 2024-08-17T02:26:05.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.129+0000 7f4508e86700 1 -- 172.21.15.102:0/2449609640 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45040a59f0 con 0x7f450406df10 2024-08-17T02:26:05.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.129+0000 7f4508e86700 1 -- 172.21.15.102:0/2449609640 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45040accf0 con 0x7f450406df10 2024-08-17T02:26:05.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.133+0000 7f44eb7fe700 1 -- 172.21.15.102:0/2449609640 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f44f401a400 con 0x7f450406df10 2024-08-17T02:26:05.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.133+0000 7f44eb7fe700 1 --2- 172.21.15.102:0/2449609640 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f44f0060860 0x7f44f0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.133+0000 7f4502ffd700 1 --2- 172.21.15.102:0/2449609640 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f44f0060860 0x7f44f0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.133+0000 7f4502ffd700 1 --2- 172.21.15.102:0/2449609640 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f44f0060860 0x7f44f0062d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4504070590 tx=0x7f44fc007ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.137+0000 7fcd157fa700 1 -- 172.21.15.102:0/339216397 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10011600 con 0x7fcd2006df10 2024-08-17T02:26:05.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.137+0000 7fcd157fa700 1 -- 172.21.15.102:0/339216397 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd10011760 con 0x7fcd2006df10 2024-08-17T02:26:05.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.137+0000 7fcd157fa700 1 -- 172.21.15.102:0/339216397 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10011b00 con 0x7fcd2006df10 2024-08-17T02:26:05.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.137+0000 7fcd262d8700 1 -- 172.21.15.102:0/339216397 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd200aa110 con 0x7fcd2006df10 2024-08-17T02:26:05.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.137+0000 7fcd262d8700 1 -- 172.21.15.102:0/339216397 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd200a9da0 con 0x7fcd2006df10 2024-08-17T02:26:05.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.137+0000 7f44d4ff9700 1 -- 172.21.15.102:0/3134462528 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f44c004d130 con 0x7f44d813f670 2024-08-17T02:26:05.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.137+0000 7f44eb7fe700 1 -- 172.21.15.102:0/2449609640 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f44f4050f40 con 0x7f450406df10 2024-08-17T02:26:05.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.141+0000 7fcd262d8700 1 -- 172.21.15.102:0/339216397 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd200643a0 con 0x7fcd2006df10 2024-08-17T02:26:05.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.141+0000 7f4508e86700 1 -- 172.21.15.102:0/2449609640 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45040643a0 con 0x7f450406df10 2024-08-17T02:26:05.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.141+0000 7fcd157fa700 1 -- 172.21.15.102:0/339216397 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcd10019400 con 0x7fcd2006df10 2024-08-17T02:26:05.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.141+0000 7fcd157fa700 1 --2- 172.21.15.102:0/339216397 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcd04060930 0x7fcd04062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.141+0000 7fcd157fa700 1 -- 172.21.15.102:0/339216397 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd1007cb60 con 0x7fcd2006df10 2024-08-17T02:26:05.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.145+0000 7fcd24ad5700 1 --2- 172.21.15.102:0/339216397 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcd04060930 0x7fcd04062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.145+0000 7fcd24ad5700 1 --2- 172.21.15.102:0/339216397 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcd04060930 0x7fcd04062de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcd2014e990 tx=0x7fcd18009680 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.149+0000 7f44eb7fe700 1 -- 172.21.15.102:0/2449609640 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f44f40505d0 con 0x7f450406df10 2024-08-17T02:26:05.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f7825c30700 1 Processor -- start 2024-08-17T02:26:05.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f7825c30700 1 -- start start 2024-08-17T02:26:05.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f7825c30700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f782013bf10 0x7f782006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f7825c30700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f782013ba00 0x7f782006e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f7825c30700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782013cf90 con 0x7f782013b630 2024-08-17T02:26:05.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f7825c30700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78200b1b20 con 0x7f782013bf10 2024-08-17T02:26:05.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f7825c30700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782013c380 con 0x7f782013ba00 2024-08-17T02:26:05.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7fcd157fa700 1 -- 172.21.15.102:0/339216397 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcd1004d030 con 0x7fcd2006df10 2024-08-17T02:26:05.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f781f7fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f782013b630 0x7f78200b1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:37560/0 (socket says 172.21.15.102:37560) 2024-08-17T02:26:05.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f781f7fe700 1 -- 172.21.15.102:0/3413423546 learned_addr learned my addr 172.21.15.102:0/3413423546 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:05.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f781ffff700 1 --2- 172.21.15.102:0/3413423546 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f782013ba00 0x7f782006e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f781e7fc700 1 -- 172.21.15.102:0/3413423546 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043679139 0 0) 0x7f782013cf90 con 0x7f782013b630 2024-08-17T02:26:05.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f781e7fc700 1 -- 172.21.15.102:0/3413423546 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7808003570 con 0x7f782013b630 2024-08-17T02:26:05.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f781ffff700 1 -- 172.21.15.102:0/3413423546 >> v2:172.21.15.121:3300/0 conn(0x7f782013bf10 msgr2=0x7f782006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:05.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f781e7fc700 1 -- 172.21.15.102:0/3413423546 <== mon.1 v1:172.21.15.121:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4205393494 0 0) 0x7f7808003570 con 0x7f782013b630 2024-08-17T02:26:05.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f781effd700 1 --2- 172.21.15.102:0/3413423546 >> v2:172.21.15.121:3300/0 conn(0x7f782013bf10 0x7f782006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f781ffff700 1 --2- 172.21.15.102:0/3413423546 >> v2:172.21.15.121:3300/0 conn(0x7f782013bf10 0x7f782006df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f781ffff700 1 -- 172.21.15.102:0/3413423546 >> v1:172.21.15.121:6789/0 conn(0x7f782013b630 legacy=0x7f78200b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f781ffff700 1 -- 172.21.15.102:0/3413423546 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782013c660 con 0x7f782013ba00 2024-08-17T02:26:05.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.157+0000 7f781effd700 1 --2- 172.21.15.102:0/3413423546 >> v2:172.21.15.121:3300/0 conn(0x7f782013bf10 0x7f782006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:05.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.161+0000 7f781ffff700 1 --2- 172.21.15.102:0/3413423546 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f782013ba00 0x7f782006e450 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7818009bd0 tx=0x7f7818009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=756e5a3aea1406c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.161+0000 7f781e7fc700 1 -- 172.21.15.102:0/3413423546 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810001470 con 0x7f782013ba00 2024-08-17T02:26:05.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.161+0000 7f781e7fc700 1 -- 172.21.15.102:0/3413423546 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781800d720 con 0x7f782013ba00 2024-08-17T02:26:05.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.161+0000 7f7825c30700 1 -- 172.21.15.102:0/3413423546 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f782013ba00 msgr2=0x7f782006e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.161+0000 7f7825c30700 1 --2- 172.21.15.102:0/3413423546 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f782013ba00 0x7f782006e450 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7818009bd0 tx=0x7f7818009c00 comp rx=0 tx=0).stop 2024-08-17T02:26:05.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.161+0000 7f7825c30700 1 -- 172.21.15.102:0/3413423546 shutdown_connections 2024-08-17T02:26:05.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.161+0000 7f7825c30700 1 --2- 172.21.15.102:0/3413423546 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f782013ba00 0x7f782006e450 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.161+0000 7f7825c30700 1 --2- 172.21.15.102:0/3413423546 >> v2:172.21.15.121:3300/0 conn(0x7f782013bf10 0x7f782006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.161+0000 7f7825c30700 1 -- 172.21.15.102:0/3413423546 >> 172.21.15.102:0/3413423546 conn(0x7f78200678d0 msgr2=0x7f7820067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.161+0000 7f7825c30700 1 -- 172.21.15.102:0/3413423546 shutdown_connections 2024-08-17T02:26:05.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.161+0000 7f7825c30700 1 -- 172.21.15.102:0/3413423546 wait complete. 2024-08-17T02:26:05.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.161+0000 7f7825c30700 1 Processor -- start 2024-08-17T02:26:05.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.161+0000 7f7825c30700 1 -- start start 2024-08-17T02:26:05.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.165+0000 7f7825c30700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f782013b630 0x7f782013a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.165+0000 7f7825c30700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f782013ba00 0x7f78201351e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.165+0000 7f7825c30700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f782013bf10 0x7f7820157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.165+0000 7f7825c30700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7820138bb0 con 0x7f782013b630 2024-08-17T02:26:05.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.165+0000 7f7825c30700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7820137fa0 con 0x7f782013ba00 2024-08-17T02:26:05.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.165+0000 7f7825c30700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7820138280 con 0x7f782013bf10 2024-08-17T02:26:05.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.165+0000 7f781f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f782013b630 0x7f782013a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.165+0000 7f781f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f782013b630 0x7f782013a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44398/0 (socket says 172.21.15.102:44398) 2024-08-17T02:26:05.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.165+0000 7f781f7fe700 1 -- 172.21.15.102:0/4143275476 learned_addr learned my addr 172.21.15.102:0/4143275476 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:05.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.165+0000 7f781ffff700 1 --2- 172.21.15.102:0/4143275476 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f782013bf10 0x7f7820157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.165+0000 7f781f7fe700 1 -- 172.21.15.102:0/4143275476 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f782013bf10 msgr2=0x7f7820157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.165+0000 7f781f7fe700 1 --2- 172.21.15.102:0/4143275476 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f782013bf10 0x7f7820157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.165+0000 7f781f7fe700 1 -- 172.21.15.102:0/4143275476 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f782013ba00 msgr2=0x7f78201351e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.165+0000 7f781f7fe700 1 --2- 172.21.15.102:0/4143275476 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f782013ba00 0x7f78201351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.165+0000 7f781f7fe700 1 -- 172.21.15.102:0/4143275476 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7818009790 con 0x7f782013b630 2024-08-17T02:26:05.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.165+0000 7f781f7fe700 1 --2- 172.21.15.102:0/4143275476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f782013b630 0x7f782013a120 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f781000cb90 tx=0x7f7810001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.173+0000 7f78077fe700 1 -- 172.21.15.102:0/4143275476 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810001d10 con 0x7f782013b630 2024-08-17T02:26:05.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.173+0000 7f7825c30700 1 -- 172.21.15.102:0/4143275476 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7820138560 con 0x7f782013b630 2024-08-17T02:26:05.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.173+0000 7f7825c30700 1 -- 172.21.15.102:0/4143275476 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7820159260 con 0x7f782013b630 2024-08-17T02:26:05.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.173+0000 7f78077fe700 1 -- 172.21.15.102:0/4143275476 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7810007570 con 0x7f782013b630 2024-08-17T02:26:05.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.173+0000 7f78077fe700 1 -- 172.21.15.102:0/4143275476 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78100076e0 con 0x7f782013b630 2024-08-17T02:26:05.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.177+0000 7f7825c30700 1 -- 172.21.15.102:0/4143275476 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78000052b0 con 0x7f782013b630 2024-08-17T02:26:05.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.177+0000 7f78077fe700 1 -- 172.21.15.102:0/4143275476 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f781000a5d0 con 0x7f782013b630 2024-08-17T02:26:05.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.177+0000 7f78077fe700 1 --2- 172.21.15.102:0/4143275476 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f780c060860 0x7f780c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.177+0000 7f781effd700 1 --2- 172.21.15.102:0/4143275476 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f780c060860 0x7f780c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.177+0000 7f781effd700 1 --2- 172.21.15.102:0/4143275476 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f780c060860 0x7f780c062d10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7814006fd0 tx=0x7f7814008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.181+0000 7f78077fe700 1 -- 172.21.15.102:0/4143275476 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7810053440 con 0x7f782013b630 2024-08-17T02:26:05.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.189+0000 7f78077fe700 1 -- 172.21.15.102:0/4143275476 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f781004b480 con 0x7f782013b630 2024-08-17T02:26:05.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.409+0000 7f5a2b1dc700 1 -- 172.21.15.102:0/884893096 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5a240b1ce0 con 0x7f5a240ae5d0 2024-08-17T02:26:05.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.409+0000 7f5a20ff9700 1 -- 172.21.15.102:0/884893096 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5a18017020 con 0x7f5a240ae5d0 2024-08-17T02:26:05.413 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.413+0000 7f5a0a7fc700 1 -- 172.21.15.102:0/884893096 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5a100608e0 msgr2=0x7f5a10062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.413+0000 7f5a0a7fc700 1 --2- 172.21.15.102:0/884893096 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5a100608e0 0x7f5a10062d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c007fd0 tx=0x7f5a1c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.413+0000 7f5a0a7fc700 1 -- 172.21.15.102:0/884893096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a240ae5d0 msgr2=0x7f5a240b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.413+0000 7f5a0a7fc700 1 --2- 172.21.15.102:0/884893096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a240ae5d0 0x7f5a240b0f60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800ea50 tx=0x7f5a18009ae0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.413+0000 7f5a0a7fc700 1 -- 172.21.15.102:0/884893096 shutdown_connections 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.413+0000 7f5a0a7fc700 1 --2- 172.21.15.102:0/884893096 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5a100608e0 0x7f5a10062d90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.413+0000 7f5a0a7fc700 1 --2- 172.21.15.102:0/884893096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a2414fc20 0x7f5a2414e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.413+0000 7f5a0a7fc700 1 --2- 172.21.15.102:0/884893096 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5a2414f850 0x7f5a240aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.413+0000 7f5a0a7fc700 1 --2- 172.21.15.102:0/884893096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a240ae5d0 0x7f5a240b0f60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.413+0000 7f5a0a7fc700 1 -- 172.21.15.102:0/884893096 >> 172.21.15.102:0/884893096 conn(0x7f5a24068300 msgr2=0x7f5a24156100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.413+0000 7f5a0a7fc700 1 -- 172.21.15.102:0/884893096 shutdown_connections 2024-08-17T02:26:05.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.413+0000 7f5a0a7fc700 1 -- 172.21.15.102:0/884893096 wait complete. 2024-08-17T02:26:05.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-08-17T02:26:05.429 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:05.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.429+0000 7fa76d632700 1 -- 172.21.15.102:0/788372404 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa744005830 con 0x7fa7680b0350 2024-08-17T02:26:05.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.429+0000 7fa757fff700 1 -- 172.21.15.102:0/788372404 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa75c07ce60 con 0x7fa7680b0350 2024-08-17T02:26:05.433 INFO:teuthology.orchestra.run.smithi102.stdout:60129542151 2024-08-17T02:26:05.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.433+0000 7fa76d632700 1 -- 172.21.15.102:0/788372404 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa74c060960 msgr2=0x7fa74c062e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.433+0000 7fa76d632700 1 --2- 172.21.15.102:0/788372404 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa74c060960 0x7fa74c062e10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa758007110 tx=0x7fa758007f10 comp rx=0 tx=0).stop 2024-08-17T02:26:05.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.433+0000 7fa76d632700 1 -- 172.21.15.102:0/788372404 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7680b0350 msgr2=0x7fa76814ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.433+0000 7fa76d632700 1 --2- 172.21.15.102:0/788372404 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7680b0350 0x7fa76814ee90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa76806c2d0 tx=0x7fa75c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:05.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.433+0000 7fa76d632700 1 -- 172.21.15.102:0/788372404 shutdown_connections 2024-08-17T02:26:05.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.433+0000 7fa76d632700 1 --2- 172.21.15.102:0/788372404 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa74c060960 0x7fa74c062e10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.433+0000 7fa76d632700 1 --2- 172.21.15.102:0/788372404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa768155d20 0x7fa76814df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.433+0000 7fa76d632700 1 --2- 172.21.15.102:0/788372404 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa7680b0350 0x7fa76814ee90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.433+0000 7fa76d632700 1 --2- 172.21.15.102:0/788372404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa76806df10 0x7fa76813e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.433+0000 7fa76d632700 1 -- 172.21.15.102:0/788372404 >> 172.21.15.102:0/788372404 conn(0x7fa7680678d0 msgr2=0x7fa76806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.433+0000 7fa76d632700 1 -- 172.21.15.102:0/788372404 shutdown_connections 2024-08-17T02:26:05.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.433+0000 7fa76d632700 1 -- 172.21.15.102:0/788372404 wait complete. 2024-08-17T02:26:05.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.437+0000 7f310af83700 1 -- 172.21.15.102:0/91313208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f31040643a0 con 0x7f3104155950 2024-08-17T02:26:05.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.437+0000 7f30f9ffb700 1 -- 172.21.15.102:0/91313208 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f30fc01a090 con 0x7f3104155950 2024-08-17T02:26:05.439 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-08-17T02:26:05.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.437+0000 7f766759e700 1 -- 172.21.15.102:0/1275763895 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f76600ffce0 con 0x7f7660054440 2024-08-17T02:26:05.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.437+0000 7f76567fc700 1 -- 172.21.15.102:0/1275763895 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f765c017090 con 0x7f7660054440 2024-08-17T02:26:05.441 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-08-17T02:26:05.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f30e77fe700 1 -- 172.21.15.102:0/91313208 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f30e8060860 msgr2=0x7f30e8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f30e77fe700 1 --2- 172.21.15.102:0/91313208 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f30e8060860 0x7f30e8062d10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3100009dd0 tx=0x7f31000091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f30e77fe700 1 -- 172.21.15.102:0/91313208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3104155950 msgr2=0x7f3104154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f30e77fe700 1 --2- 172.21.15.102:0/91313208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3104155950 0x7f3104154c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009fa0 tx=0x7f30fc009990 comp rx=0 tx=0).stop 2024-08-17T02:26:05.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f30e77fe700 1 -- 172.21.15.102:0/91313208 shutdown_connections 2024-08-17T02:26:05.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f30e77fe700 1 --2- 172.21.15.102:0/91313208 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f30e8060860 0x7f30e8062d10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f30e77fe700 1 --2- 172.21.15.102:0/91313208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3104155950 0x7f3104154c50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f30e77fe700 1 --2- 172.21.15.102:0/91313208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31040ae120 0x7f31040997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f30e77fe700 1 --2- 172.21.15.102:0/91313208 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f31040a9260 0x7f3104157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f30e77fe700 1 -- 172.21.15.102:0/91313208 >> 172.21.15.102:0/91313208 conn(0x7f3104066e00 msgr2=0x7f31040abe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f30e77fe700 1 -- 172.21.15.102:0/91313208 shutdown_connections 2024-08-17T02:26:05.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f30e77fe700 1 -- 172.21.15.102:0/91313208 wait complete. 2024-08-17T02:26:05.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f766759e700 1 -- 172.21.15.102:0/1275763895 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7648060860 msgr2=0x7f7648062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f766759e700 1 --2- 172.21.15.102:0/1275763895 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7648060860 0x7f7648062d10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f766804b8d0 tx=0x7f7668089040 comp rx=0 tx=0).stop 2024-08-17T02:26:05.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f766759e700 1 -- 172.21.15.102:0/1275763895 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7660054440 msgr2=0x7f7660037f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f766759e700 1 --2- 172.21.15.102:0/1275763895 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7660054440 0x7f7660037f70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f765c00c490 tx=0x7f765c007ec0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f766759e700 1 -- 172.21.15.102:0/1275763895 shutdown_connections 2024-08-17T02:26:05.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f766759e700 1 --2- 172.21.15.102:0/1275763895 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7648060860 0x7f7648062d10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f766759e700 1 --2- 172.21.15.102:0/1275763895 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7660054440 0x7f7660037f70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f766759e700 1 --2- 172.21.15.102:0/1275763895 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f76600e19b0 0x7f76601021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f766759e700 1 --2- 172.21.15.102:0/1275763895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7660006740 0x7f7660037a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f766759e700 1 -- 172.21.15.102:0/1275763895 >> 172.21.15.102:0/1275763895 conn(0x7f766000a030 msgr2=0x7f7660051e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f4508e86700 1 -- 172.21.15.102:0/2449609640 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4504153890 con 0x7f450406df10 2024-08-17T02:26:05.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.441+0000 7f44eb7fe700 1 -- 172.21.15.102:0/2449609640 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44f4050160 con 0x7f450406df10 2024-08-17T02:26:05.445 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-08-17T02:26:05.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.445+0000 7f44ddd5e700 1 -- 172.21.15.102:0/3134462528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f44bc005560 con 0x7f44d813f670 2024-08-17T02:26:05.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.445+0000 7f44d4ff9700 1 -- 172.21.15.102:0/3134462528 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44c0050750 con 0x7f44d813f670 2024-08-17T02:26:05.450 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-08-17T02:26:05.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f4508e86700 1 -- 172.21.15.102:0/2449609640 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f44f0060860 msgr2=0x7f44f0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f4508e86700 1 --2- 172.21.15.102:0/2449609640 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f44f0060860 0x7f44f0062d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4504070590 tx=0x7f44fc007ed0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f4508e86700 1 -- 172.21.15.102:0/2449609640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f450406df10 msgr2=0x7f45040a9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f4508e86700 1 --2- 172.21.15.102:0/2449609640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f450406df10 0x7f45040a9cd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f44f400b600 tx=0x7f44f40091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f4508e86700 1 -- 172.21.15.102:0/2449609640 shutdown_connections 2024-08-17T02:26:05.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f4508e86700 1 --2- 172.21.15.102:0/2449609640 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f44f0060860 0x7f44f0062d10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f4508e86700 1 --2- 172.21.15.102:0/2449609640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4504165c50 0x7f4504182af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f4508e86700 1 --2- 172.21.15.102:0/2449609640 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f45040aeb80 0x7f45040ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f4508e86700 1 --2- 172.21.15.102:0/2449609640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f450406df10 0x7f45040a9cd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f4508e86700 1 -- 172.21.15.102:0/2449609640 >> 172.21.15.102:0/2449609640 conn(0x7f45040678d0 msgr2=0x7f4504164350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f4508e86700 1 -- 172.21.15.102:0/2449609640 shutdown_connections 2024-08-17T02:26:05.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f4508e86700 1 -- 172.21.15.102:0/2449609640 wait complete. 2024-08-17T02:26:05.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.3 2024-08-17T02:26:05.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f44ddd5e700 1 -- 172.21.15.102:0/3134462528 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f44b8060860 msgr2=0x7f44b8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f44ddd5e700 1 --2- 172.21.15.102:0/3134462528 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f44b8060860 0x7f44b8062d10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f44d00099b0 tx=0x7f44d0017000 comp rx=0 tx=0).stop 2024-08-17T02:26:05.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f44ddd5e700 1 -- 172.21.15.102:0/3134462528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44d813f670 msgr2=0x7f44d806a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f44ddd5e700 1 --2- 172.21.15.102:0/3134462528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44d813f670 0x7f44d806a420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f44c000d860 tx=0x7f44c0008040 comp rx=0 tx=0).stop 2024-08-17T02:26:05.454 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:05.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.449+0000 7f766759e700 1 -- 172.21.15.102:0/1275763895 shutdown_connections 2024-08-17T02:26:05.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.453+0000 7f44ddd5e700 1 -- 172.21.15.102:0/3134462528 shutdown_connections 2024-08-17T02:26:05.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.453+0000 7f44ddd5e700 1 --2- 172.21.15.102:0/3134462528 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f44b8060860 0x7f44b8062d10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.453+0000 7f44ddd5e700 1 --2- 172.21.15.102:0/3134462528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44d813f670 0x7f44d806a420 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.453+0000 7f44ddd5e700 1 --2- 172.21.15.102:0/3134462528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44d813fa40 0x7f44d813dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.453+0000 7f44ddd5e700 1 --2- 172.21.15.102:0/3134462528 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f44d80ae340 0x7f44d814fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.453+0000 7f766759e700 1 -- 172.21.15.102:0/1275763895 wait complete. 2024-08-17T02:26:05.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.453+0000 7f44ddd5e700 1 -- 172.21.15.102:0/3134462528 >> 172.21.15.102:0/3134462528 conn(0x7f44d80ca2b0 msgr2=0x7f44d806df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.453+0000 7f44ddd5e700 1 -- 172.21.15.102:0/3134462528 shutdown_connections 2024-08-17T02:26:05.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.453+0000 7f44ddd5e700 1 -- 172.21.15.102:0/3134462528 wait complete. 2024-08-17T02:26:05.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2024-08-17T02:26:05.456 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:05.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.461+0000 7fcd262d8700 1 -- 172.21.15.102:0/339216397 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd2006f5f0 con 0x7fcd2006df10 2024-08-17T02:26:05.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.461+0000 7fcd157fa700 1 -- 172.21.15.102:0/339216397 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcd1001e020 con 0x7fcd2006df10 2024-08-17T02:26:05.464 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-08-17T02:26:05.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-08-17T02:26:05.465 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:05.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-08-17T02:26:05.466 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:05.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.465+0000 7fcd262d8700 1 -- 172.21.15.102:0/339216397 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcd04060930 msgr2=0x7fcd04062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.465+0000 7fcd262d8700 1 --2- 172.21.15.102:0/339216397 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcd04060930 0x7fcd04062de0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcd2014e990 tx=0x7fcd18009680 comp rx=0 tx=0).stop 2024-08-17T02:26:05.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.465+0000 7fcd262d8700 1 -- 172.21.15.102:0/339216397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2006df10 msgr2=0x7fcd200a9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.465+0000 7fcd262d8700 1 --2- 172.21.15.102:0/339216397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2006df10 0x7fcd200a9860 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000c8b0 tx=0x7fcd10008040 comp rx=0 tx=0).stop 2024-08-17T02:26:05.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.465+0000 7fcd262d8700 1 -- 172.21.15.102:0/339216397 shutdown_connections 2024-08-17T02:26:05.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.465+0000 7fcd262d8700 1 --2- 172.21.15.102:0/339216397 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcd04060930 0x7fcd04062de0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.465+0000 7fcd262d8700 1 --2- 172.21.15.102:0/339216397 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd20155d20 0x7fcd2014a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.465+0000 7fcd262d8700 1 --2- 172.21.15.102:0/339216397 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd200ad7c0 0x7fcd20158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.465+0000 7fcd262d8700 1 --2- 172.21.15.102:0/339216397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2006df10 0x7fcd200a9860 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.465+0000 7fcd262d8700 1 -- 172.21.15.102:0/339216397 >> 172.21.15.102:0/339216397 conn(0x7fcd200678d0 msgr2=0x7fcd20159930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.465+0000 7fcd262d8700 1 -- 172.21.15.102:0/339216397 shutdown_connections 2024-08-17T02:26:05.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.465+0000 7fcd262d8700 1 -- 172.21.15.102:0/339216397 wait complete. 2024-08-17T02:26:05.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-08-17T02:26:05.468 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:05.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-08-17T02:26:05.475 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:05.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.477+0000 7f7825c30700 1 -- 172.21.15.102:0/4143275476 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7800005560 con 0x7f782013b630 2024-08-17T02:26:05.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.477+0000 7f78077fe700 1 -- 172.21.15.102:0/4143275476 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7810018090 con 0x7f782013b630 2024-08-17T02:26:05.479 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-08-17T02:26:05.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.477+0000 7f7825c30700 1 -- 172.21.15.102:0/4143275476 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f780c060860 msgr2=0x7f780c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.477+0000 7f7825c30700 1 --2- 172.21.15.102:0/4143275476 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f780c060860 0x7f780c062d10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7814006fd0 tx=0x7f7814008040 comp rx=0 tx=0).stop 2024-08-17T02:26:05.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.477+0000 7f7825c30700 1 -- 172.21.15.102:0/4143275476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f782013b630 msgr2=0x7f782013a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.477+0000 7f7825c30700 1 --2- 172.21.15.102:0/4143275476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f782013b630 0x7f782013a120 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f781000cb90 tx=0x7f7810001a80 comp rx=0 tx=0).stop 2024-08-17T02:26:05.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.477+0000 7f7825c30700 1 -- 172.21.15.102:0/4143275476 shutdown_connections 2024-08-17T02:26:05.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.477+0000 7f7825c30700 1 --2- 172.21.15.102:0/4143275476 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f780c060860 0x7f780c062d10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.477+0000 7f7825c30700 1 --2- 172.21.15.102:0/4143275476 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f782013bf10 0x7f7820157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.477+0000 7f7825c30700 1 --2- 172.21.15.102:0/4143275476 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f782013ba00 0x7f78201351e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.477+0000 7f7825c30700 1 --2- 172.21.15.102:0/4143275476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f782013b630 0x7f782013a120 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.477+0000 7f7825c30700 1 -- 172.21.15.102:0/4143275476 >> 172.21.15.102:0/4143275476 conn(0x7f78200678d0 msgr2=0x7f78200cb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.477+0000 7f7825c30700 1 -- 172.21.15.102:0/4143275476 shutdown_connections 2024-08-17T02:26:05.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.477+0000 7f7825c30700 1 -- 172.21.15.102:0/4143275476 wait complete. 2024-08-17T02:26:05.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-08-17T02:26:05.490 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:05.491 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:26:05.491 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:05.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c8de4700 1 Processor -- start 2024-08-17T02:26:05.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c8de4700 1 -- start start 2024-08-17T02:26:05.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c8de4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59c406aff0 0x7f59c41556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c8de4700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f59c413e960 0x7f59c4156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c8de4700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c4156940 con 0x7f59c40b1660 2024-08-17T02:26:05.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c8de4700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c4155d30 con 0x7f59c413e960 2024-08-17T02:26:05.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c8de4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4156010 con 0x7f59c406aff0 2024-08-17T02:26:05.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c3fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f59c413e960 0x7f59c4156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c2ffd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f59c40b1660 0x7f59c413e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:37566/0 (socket says 172.21.15.102:37566) 2024-08-17T02:26:05.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c2ffd700 1 -- 172.21.15.102:0/163040644 learned_addr learned my addr 172.21.15.102:0/163040644 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:05.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c37fe700 1 --2- 172.21.15.102:0/163040644 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59c406aff0 0x7f59c41556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c3fff700 1 -- 172.21.15.102:0/163040644 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59c406aff0 msgr2=0x7f59c41556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:05.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c3fff700 1 --2- 172.21.15.102:0/163040644 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59c406aff0 0x7f59c41556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c27fc700 1 -- 172.21.15.102:0/163040644 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491794817 0 0) 0x7f59c4156940 con 0x7f59c40b1660 2024-08-17T02:26:05.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c3fff700 1 -- 172.21.15.102:0/163040644 >> v1:172.21.15.121:6789/0 conn(0x7f59c40b1660 legacy=0x7f59c413e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c3fff700 1 -- 172.21.15.102:0/163040644 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c41562f0 con 0x7f59c413e960 2024-08-17T02:26:05.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c3fff700 1 --2- 172.21.15.102:0/163040644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59c413e960 0x7f59c4156dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009e60 tx=0x7f59bc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b87de8d6428ddbf0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c27fc700 1 -- 172.21.15.102:0/163040644 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00e070 con 0x7f59c413e960 2024-08-17T02:26:05.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c27fc700 1 -- 172.21.15.102:0/163040644 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc00bb60 con 0x7f59c413e960 2024-08-17T02:26:05.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.581+0000 7f59c27fc700 1 -- 172.21.15.102:0/163040644 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc012430 con 0x7f59c413e960 2024-08-17T02:26:05.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c8de4700 1 -- 172.21.15.102:0/163040644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59c413e960 msgr2=0x7f59c4156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c8de4700 1 --2- 172.21.15.102:0/163040644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59c413e960 0x7f59c4156dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009e60 tx=0x7f59bc009780 comp rx=0 tx=0).stop 2024-08-17T02:26:05.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c8de4700 1 -- 172.21.15.102:0/163040644 shutdown_connections 2024-08-17T02:26:05.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c8de4700 1 --2- 172.21.15.102:0/163040644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59c413e960 0x7f59c4156dd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c8de4700 1 --2- 172.21.15.102:0/163040644 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59c406aff0 0x7f59c41556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c8de4700 1 -- 172.21.15.102:0/163040644 >> 172.21.15.102:0/163040644 conn(0x7f59c40678d0 msgr2=0x7f59c4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c8de4700 1 -- 172.21.15.102:0/163040644 shutdown_connections 2024-08-17T02:26:05.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c8de4700 1 -- 172.21.15.102:0/163040644 wait complete. 2024-08-17T02:26:05.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c8de4700 1 Processor -- start 2024-08-17T02:26:05.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c8de4700 1 -- start start 2024-08-17T02:26:05.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c8de4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c406aff0 0x7f59c412f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c8de4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59c40b1660 0x7f59c41548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c8de4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59c413e960 0x7f59c41396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c8de4700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c412f570 con 0x7f59c406aff0 2024-08-17T02:26:05.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c8de4700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c413ade0 con 0x7f59c40b1660 2024-08-17T02:26:05.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c8de4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4154e30 con 0x7f59c413e960 2024-08-17T02:26:05.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c37fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c406aff0 0x7f59c412f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c37fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c406aff0 0x7f59c412f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44400/0 (socket says 172.21.15.102:44400) 2024-08-17T02:26:05.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c37fe700 1 -- 172.21.15.102:0/1780897597 learned_addr learned my addr 172.21.15.102:0/1780897597 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:05.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c3fff700 1 --2- 172.21.15.102:0/1780897597 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59c413e960 0x7f59c41396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.585+0000 7f59c2ffd700 1 --2- 172.21.15.102:0/1780897597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59c40b1660 0x7f59c41548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.589+0000 7f59c37fe700 1 -- 172.21.15.102:0/1780897597 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59c413e960 msgr2=0x7f59c41396d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.589+0000 7f59c37fe700 1 --2- 172.21.15.102:0/1780897597 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59c413e960 0x7f59c41396d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.589+0000 7f59c37fe700 1 -- 172.21.15.102:0/1780897597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59c40b1660 msgr2=0x7f59c41548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.589+0000 7f59c37fe700 1 --2- 172.21.15.102:0/1780897597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59c40b1660 0x7f59c41548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.589+0000 7f59c37fe700 1 -- 172.21.15.102:0/1780897597 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc009a20 con 0x7f59c406aff0 2024-08-17T02:26:05.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.589+0000 7f59c2ffd700 1 --2- 172.21.15.102:0/1780897597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59c40b1660 0x7f59c41548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:05.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.589+0000 7f59c3fff700 1 --2- 172.21.15.102:0/1780897597 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59c413e960 0x7f59c41396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:05.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.589+0000 7f59c37fe700 1 --2- 172.21.15.102:0/1780897597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c406aff0 0x7f59c412f030 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f59b400e930 tx=0x7f59b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.589+0000 7f59bb7fe700 1 -- 172.21.15.102:0/1780897597 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4013680 con 0x7f59c406aff0 2024-08-17T02:26:05.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.589+0000 7f59bb7fe700 1 -- 172.21.15.102:0/1780897597 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b40137e0 con 0x7f59c406aff0 2024-08-17T02:26:05.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.589+0000 7f59bb7fe700 1 -- 172.21.15.102:0/1780897597 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4013b80 con 0x7f59c406aff0 2024-08-17T02:26:05.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.589+0000 7f59c8de4700 1 -- 172.21.15.102:0/1780897597 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c413a1d0 con 0x7f59c406aff0 2024-08-17T02:26:05.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.589+0000 7f59c8de4700 1 -- 172.21.15.102:0/1780897597 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c413a790 con 0x7f59c406aff0 2024-08-17T02:26:05.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.589+0000 7f59c8de4700 1 -- 172.21.15.102:0/1780897597 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c40643a0 con 0x7f59c406aff0 2024-08-17T02:26:05.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.593+0000 7f59bb7fe700 1 -- 172.21.15.102:0/1780897597 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f59b400c3e0 con 0x7f59c406aff0 2024-08-17T02:26:05.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.593+0000 7f59bb7fe700 1 --2- 172.21.15.102:0/1780897597 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f59a4060860 0x7f59a4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.593+0000 7f59c2ffd700 1 --2- 172.21.15.102:0/1780897597 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f59a4060860 0x7f59a4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.593+0000 7f59bb7fe700 1 -- 172.21.15.102:0/1780897597 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59b407cca0 con 0x7f59c406aff0 2024-08-17T02:26:05.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.593+0000 7f59c2ffd700 1 --2- 172.21.15.102:0/1780897597 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f59a4060860 0x7f59a4062d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f59c415a040 tx=0x7f59ac007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.601+0000 7f59bb7fe700 1 -- 172.21.15.102:0/1780897597 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f59b404d0f0 con 0x7f59c406aff0 2024-08-17T02:26:05.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.745+0000 7f59c8de4700 1 -- 172.21.15.102:0/1780897597 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f59c40b0220 con 0x7f59a4060860 2024-08-17T02:26:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.761+0000 7f59bb7fe700 1 -- 172.21.15.102:0/1780897597 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264380 (secure 0 0 0) 0x7f59c40b0220 con 0x7f59a4060860 2024-08-17T02:26:05.768 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:05.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.765+0000 7f59c8de4700 1 -- 172.21.15.102:0/1780897597 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f59a4060860 msgr2=0x7f59a4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.765+0000 7f59c8de4700 1 --2- 172.21.15.102:0/1780897597 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f59a4060860 0x7f59a4062d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f59c415a040 tx=0x7f59ac007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:05.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.765+0000 7f59c8de4700 1 -- 172.21.15.102:0/1780897597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c406aff0 msgr2=0x7f59c412f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.765+0000 7f59c8de4700 1 --2- 172.21.15.102:0/1780897597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c406aff0 0x7f59c412f030 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f59b400e930 tx=0x7f59b40091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.765+0000 7f59c8de4700 1 -- 172.21.15.102:0/1780897597 shutdown_connections 2024-08-17T02:26:05.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.765+0000 7f59c8de4700 1 --2- 172.21.15.102:0/1780897597 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f59a4060860 0x7f59a4062d10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.765+0000 7f59c8de4700 1 --2- 172.21.15.102:0/1780897597 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f59c413e960 0x7f59c41396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.765+0000 7f59c8de4700 1 --2- 172.21.15.102:0/1780897597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59c40b1660 0x7f59c41548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.765+0000 7f59c8de4700 1 --2- 172.21.15.102:0/1780897597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c406aff0 0x7f59c412f030 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.765+0000 7f59c8de4700 1 -- 172.21.15.102:0/1780897597 >> 172.21.15.102:0/1780897597 conn(0x7f59c40678d0 msgr2=0x7f59c4068fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.765+0000 7f59c8de4700 1 -- 172.21.15.102:0/1780897597 shutdown_connections 2024-08-17T02:26:05.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.765+0000 7f59c8de4700 1 -- 172.21.15.102:0/1780897597 wait complete. 2024-08-17T02:26:05.771 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-08-17T02:26:05.781 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-17T02:26:05.179272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381768,"kb_used_data":2888,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592952,"statfs":{"total":773094113280,"available":770655182848,"internally_reserved":0,"allocated":2957312,"data_stored":1775724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.174838"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047525+0000","last_change":"2024-08-17T02:25:56.041834+0000","last_active":"2024-08-17T02:25:56.047525+0000","last_peered":"2024-08-17T02:25:56.047525+0000","last_clean":"2024-08-17T02:25:56.047525+0000","last_became_active":"2024-08-17T02:25:56.041161+0000","last_became_peered":"2024-08-17T02:25:56.041161+0000","last_unstale":"2024-08-17T02:25:56.047525+0000","last_undegraded":"2024-08-17T02:25:56.047525+0000","last_fullsized":"2024-08-17T02:25:56.047525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:31.069744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.037667+0000","last_change":"2024-08-17T02:25:56.031048+0000","last_active":"2024-08-17T02:25:56.037667+0000","last_peered":"2024-08-17T02:25:56.037667+0000","last_clean":"2024-08-17T02:25:56.037667+0000","last_became_active":"2024-08-17T02:25:56.030544+0000","last_became_peered":"2024-08-17T02:25:56.030544+0000","last_unstale":"2024-08-17T02:25:56.037667+0000","last_undegraded":"2024-08-17T02:25:56.037667+0000","last_fullsized":"2024-08-17T02:25:56.037667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:36.323034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.027320+0000","last_change":"2024-08-17T02:25:56.018521+0000","last_active":"2024-08-17T02:25:56.027320+0000","last_peered":"2024-08-17T02:25:56.027320+0000","last_clean":"2024-08-17T02:25:56.027320+0000","last_became_active":"2024-08-17T02:25:56.018150+0000","last_became_peered":"2024-08-17T02:25:56.018150+0000","last_unstale":"2024-08-17T02:25:56.027320+0000","last_undegraded":"2024-08-17T02:25:56.027320+0000","last_fullsized":"2024-08-17T02:25:56.027320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:15.442494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.037757+0000","last_change":"2024-08-17T02:25:56.028099+0000","last_active":"2024-08-17T02:25:56.037757+0000","last_peered":"2024-08-17T02:25:56.037757+0000","last_clean":"2024-08-17T02:25:56.037757+0000","last_became_active":"2024-08-17T02:25:56.027809+0000","last_became_peered":"2024-08-17T02:25:56.027809+0000","last_unstale":"2024-08-17T02:25:56.037757+0000","last_undegraded":"2024-08-17T02:25:56.037757+0000","last_fullsized":"2024-08-17T02:25:56.037757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:29.722508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047567+0000","last_change":"2024-08-17T02:25:56.041835+0000","last_active":"2024-08-17T02:25:56.047567+0000","last_peered":"2024-08-17T02:25:56.047567+0000","last_clean":"2024-08-17T02:25:56.047567+0000","last_became_active":"2024-08-17T02:25:56.040175+0000","last_became_peered":"2024-08-17T02:25:56.040175+0000","last_unstale":"2024-08-17T02:25:56.047567+0000","last_undegraded":"2024-08-17T02:25:56.047567+0000","last_fullsized":"2024-08-17T02:25:56.047567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:52.232984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041089+0000","last_change":"2024-08-17T02:25:56.036640+0000","last_active":"2024-08-17T02:25:56.041089+0000","last_peered":"2024-08-17T02:25:56.041089+0000","last_clean":"2024-08-17T02:25:56.041089+0000","last_became_active":"2024-08-17T02:25:56.035988+0000","last_became_peered":"2024-08-17T02:25:56.035988+0000","last_unstale":"2024-08-17T02:25:56.041089+0000","last_undegraded":"2024-08-17T02:25:56.041089+0000","last_fullsized":"2024-08-17T02:25:56.041089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:51.489903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.040700+0000","last_change":"2024-08-17T02:25:56.018767+0000","last_active":"2024-08-17T02:25:56.040700+0000","last_peered":"2024-08-17T02:25:56.040700+0000","last_clean":"2024-08-17T02:25:56.040700+0000","last_became_active":"2024-08-17T02:25:56.018454+0000","last_became_peered":"2024-08-17T02:25:56.018454+0000","last_unstale":"2024-08-17T02:25:56.040700+0000","last_undegraded":"2024-08-17T02:25:56.040700+0000","last_fullsized":"2024-08-17T02:25:56.040700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:24.040734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041569+0000","last_change":"2024-08-17T02:25:56.036004+0000","last_active":"2024-08-17T02:25:56.041569+0000","last_peered":"2024-08-17T02:25:56.041569+0000","last_clean":"2024-08-17T02:25:56.041569+0000","last_became_active":"2024-08-17T02:25:56.035748+0000","last_became_peered":"2024-08-17T02:25:56.035748+0000","last_unstale":"2024-08-17T02:25:56.041569+0000","last_undegraded":"2024-08-17T02:25:56.041569+0000","last_fullsized":"2024-08-17T02:25:56.041569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:24.560363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047491+0000","last_change":"2024-08-17T02:25:56.041696+0000","last_active":"2024-08-17T02:25:56.047491+0000","last_peered":"2024-08-17T02:25:56.047491+0000","last_clean":"2024-08-17T02:25:56.047491+0000","last_became_active":"2024-08-17T02:25:56.040480+0000","last_became_peered":"2024-08-17T02:25:56.040480+0000","last_unstale":"2024-08-17T02:25:56.047491+0000","last_undegraded":"2024-08-17T02:25:56.047491+0000","last_fullsized":"2024-08-17T02:25:56.047491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:17.900093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044205+0000","last_change":"2024-08-17T02:25:56.036179+0000","last_active":"2024-08-17T02:25:56.044205+0000","last_peered":"2024-08-17T02:25:56.044205+0000","last_clean":"2024-08-17T02:25:56.044205+0000","last_became_active":"2024-08-17T02:25:56.035909+0000","last_became_peered":"2024-08-17T02:25:56.035909+0000","last_unstale":"2024-08-17T02:25:56.044205+0000","last_undegraded":"2024-08-17T02:25:56.044205+0000","last_fullsized":"2024-08-17T02:25:56.044205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:32.738921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.034210+0000","last_change":"2024-08-17T02:25:56.027962+0000","last_active":"2024-08-17T02:25:56.034210+0000","last_peered":"2024-08-17T02:25:56.034210+0000","last_clean":"2024-08-17T02:25:56.034210+0000","last_became_active":"2024-08-17T02:25:56.027599+0000","last_became_peered":"2024-08-17T02:25:56.027599+0000","last_unstale":"2024-08-17T02:25:56.034210+0000","last_undegraded":"2024-08-17T02:25:56.034210+0000","last_fullsized":"2024-08-17T02:25:56.034210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:40.638494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.031526+0000","last_change":"2024-08-17T02:25:56.022137+0000","last_active":"2024-08-17T02:25:56.031526+0000","last_peered":"2024-08-17T02:25:56.031526+0000","last_clean":"2024-08-17T02:25:56.031526+0000","last_became_active":"2024-08-17T02:25:56.018606+0000","last_became_peered":"2024-08-17T02:25:56.018606+0000","last_unstale":"2024-08-17T02:25:56.031526+0000","last_undegraded":"2024-08-17T02:25:56.031526+0000","last_fullsized":"2024-08-17T02:25:56.031526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:24.083566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.029816+0000","last_change":"2024-08-17T02:25:56.026153+0000","last_active":"2024-08-17T02:25:56.029816+0000","last_peered":"2024-08-17T02:25:56.029816+0000","last_clean":"2024-08-17T02:25:56.029816+0000","last_became_active":"2024-08-17T02:25:56.025787+0000","last_became_peered":"2024-08-17T02:25:56.025787+0000","last_unstale":"2024-08-17T02:25:56.029816+0000","last_undegraded":"2024-08-17T02:25:56.029816+0000","last_fullsized":"2024-08-17T02:25:56.029816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:25.457349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.032456+0000","last_change":"2024-08-17T02:25:56.028794+0000","last_active":"2024-08-17T02:25:56.032456+0000","last_peered":"2024-08-17T02:25:56.032456+0000","last_clean":"2024-08-17T02:25:56.032456+0000","last_became_active":"2024-08-17T02:25:56.028458+0000","last_became_peered":"2024-08-17T02:25:56.028458+0000","last_unstale":"2024-08-17T02:25:56.032456+0000","last_undegraded":"2024-08-17T02:25:56.032456+0000","last_fullsized":"2024-08-17T02:25:56.032456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:55.320971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041117+0000","last_change":"2024-08-17T02:25:56.036545+0000","last_active":"2024-08-17T02:25:56.041117+0000","last_peered":"2024-08-17T02:25:56.041117+0000","last_clean":"2024-08-17T02:25:56.041117+0000","last_became_active":"2024-08-17T02:25:56.036266+0000","last_became_peered":"2024-08-17T02:25:56.036266+0000","last_unstale":"2024-08-17T02:25:56.041117+0000","last_undegraded":"2024-08-17T02:25:56.041117+0000","last_fullsized":"2024-08-17T02:25:56.041117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:58.197912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.034417+0000","last_change":"2024-08-17T02:25:56.024271+0000","last_active":"2024-08-17T02:25:56.034417+0000","last_peered":"2024-08-17T02:25:56.034417+0000","last_clean":"2024-08-17T02:25:56.034417+0000","last_became_active":"2024-08-17T02:25:56.023779+0000","last_became_peered":"2024-08-17T02:25:56.023779+0000","last_unstale":"2024-08-17T02:25:56.034417+0000","last_undegraded":"2024-08-17T02:25:56.034417+0000","last_fullsized":"2024-08-17T02:25:56.034417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:08:39.924999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.050174+0000","last_change":"2024-08-17T02:25:56.045776+0000","last_active":"2024-08-17T02:25:56.050174+0000","last_peered":"2024-08-17T02:25:56.050174+0000","last_clean":"2024-08-17T02:25:56.050174+0000","last_became_active":"2024-08-17T02:25:56.045509+0000","last_became_peered":"2024-08-17T02:25:56.045509+0000","last_unstale":"2024-08-17T02:25:56.050174+0000","last_undegraded":"2024-08-17T02:25:56.050174+0000","last_fullsized":"2024-08-17T02:25:56.050174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:59.671251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.031740+0000","last_change":"2024-08-17T02:25:56.024593+0000","last_active":"2024-08-17T02:25:56.031740+0000","last_peered":"2024-08-17T02:25:56.031740+0000","last_clean":"2024-08-17T02:25:56.031740+0000","last_became_active":"2024-08-17T02:25:56.024239+0000","last_became_peered":"2024-08-17T02:25:56.024239+0000","last_unstale":"2024-08-17T02:25:56.031740+0000","last_undegraded":"2024-08-17T02:25:56.031740+0000","last_fullsized":"2024-08-17T02:25:56.031740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:15.239096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047506+0000","last_change":"2024-08-17T02:25:56.041808+0000","last_active":"2024-08-17T02:25:56.047506+0000","last_peered":"2024-08-17T02:25:56.047506+0000","last_clean":"2024-08-17T02:25:56.047506+0000","last_became_active":"2024-08-17T02:25:56.040916+0000","last_became_peered":"2024-08-17T02:25:56.040916+0000","last_unstale":"2024-08-17T02:25:56.047506+0000","last_undegraded":"2024-08-17T02:25:56.047506+0000","last_fullsized":"2024-08-17T02:25:56.047506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:57.018682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.027498+0000","last_change":"2024-08-17T02:25:56.023215+0000","last_active":"2024-08-17T02:25:56.027498+0000","last_peered":"2024-08-17T02:25:56.027498+0000","last_clean":"2024-08-17T02:25:56.027498+0000","last_became_active":"2024-08-17T02:25:56.022935+0000","last_became_peered":"2024-08-17T02:25:56.022935+0000","last_unstale":"2024-08-17T02:25:56.027498+0000","last_undegraded":"2024-08-17T02:25:56.027498+0000","last_fullsized":"2024-08-17T02:25:56.027498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:24.560363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041377+0000","last_change":"2024-08-17T02:25:56.036032+0000","last_active":"2024-08-17T02:25:56.041377+0000","last_peered":"2024-08-17T02:25:56.041377+0000","last_clean":"2024-08-17T02:25:56.041377+0000","last_became_active":"2024-08-17T02:25:56.035200+0000","last_became_peered":"2024-08-17T02:25:56.035200+0000","last_unstale":"2024-08-17T02:25:56.041377+0000","last_undegraded":"2024-08-17T02:25:56.041377+0000","last_fullsized":"2024-08-17T02:25:56.041377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:40.638494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047292+0000","last_change":"2024-08-17T02:25:56.043121+0000","last_active":"2024-08-17T02:25:56.047292+0000","last_peered":"2024-08-17T02:25:56.047292+0000","last_clean":"2024-08-17T02:25:56.047292+0000","last_became_active":"2024-08-17T02:25:56.042862+0000","last_became_peered":"2024-08-17T02:25:56.042862+0000","last_unstale":"2024-08-17T02:25:56.047292+0000","last_undegraded":"2024-08-17T02:25:56.047292+0000","last_fullsized":"2024-08-17T02:25:56.047292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:10.710311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.024108+0000","last_change":"2024-08-17T02:25:56.021487+0000","last_active":"2024-08-17T02:25:56.024108+0000","last_peered":"2024-08-17T02:25:56.024108+0000","last_clean":"2024-08-17T02:25:56.024108+0000","last_became_active":"2024-08-17T02:25:56.020379+0000","last_became_peered":"2024-08-17T02:25:56.020379+0000","last_unstale":"2024-08-17T02:25:56.024108+0000","last_undegraded":"2024-08-17T02:25:56.024108+0000","last_fullsized":"2024-08-17T02:25:56.024108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:55.237015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.035235+0000","last_change":"2024-08-17T02:25:56.025828+0000","last_active":"2024-08-17T02:25:56.035235+0000","last_peered":"2024-08-17T02:25:56.035235+0000","last_clean":"2024-08-17T02:25:56.035235+0000","last_became_active":"2024-08-17T02:25:56.025558+0000","last_became_peered":"2024-08-17T02:25:56.025558+0000","last_unstale":"2024-08-17T02:25:56.035235+0000","last_undegraded":"2024-08-17T02:25:56.035235+0000","last_fullsized":"2024-08-17T02:25:56.035235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:33:14.351722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041414+0000","last_change":"2024-08-17T02:25:56.032974+0000","last_active":"2024-08-17T02:25:56.041414+0000","last_peered":"2024-08-17T02:25:56.041414+0000","last_clean":"2024-08-17T02:25:56.041414+0000","last_became_active":"2024-08-17T02:25:56.032693+0000","last_became_peered":"2024-08-17T02:25:56.032693+0000","last_unstale":"2024-08-17T02:25:56.041414+0000","last_undegraded":"2024-08-17T02:25:56.041414+0000","last_fullsized":"2024-08-17T02:25:56.041414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:39.511023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047076+0000","last_change":"2024-08-17T02:25:56.042862+0000","last_active":"2024-08-17T02:25:56.047076+0000","last_peered":"2024-08-17T02:25:56.047076+0000","last_clean":"2024-08-17T02:25:56.047076+0000","last_became_active":"2024-08-17T02:25:56.042507+0000","last_became_peered":"2024-08-17T02:25:56.042507+0000","last_unstale":"2024-08-17T02:25:56.047076+0000","last_undegraded":"2024-08-17T02:25:56.047076+0000","last_fullsized":"2024-08-17T02:25:56.047076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:09.506321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.037837+0000","last_change":"2024-08-17T02:25:56.031020+0000","last_active":"2024-08-17T02:25:56.037837+0000","last_peered":"2024-08-17T02:25:56.037837+0000","last_clean":"2024-08-17T02:25:56.037837+0000","last_became_active":"2024-08-17T02:25:56.030750+0000","last_became_peered":"2024-08-17T02:25:56.030750+0000","last_unstale":"2024-08-17T02:25:56.037837+0000","last_undegraded":"2024-08-17T02:25:56.037837+0000","last_fullsized":"2024-08-17T02:25:56.037837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:57.681709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041753+0000","last_change":"2024-08-17T02:25:56.034831+0000","last_active":"2024-08-17T02:25:56.041753+0000","last_peered":"2024-08-17T02:25:56.041753+0000","last_clean":"2024-08-17T02:25:56.041753+0000","last_became_active":"2024-08-17T02:25:56.034550+0000","last_became_peered":"2024-08-17T02:25:56.034550+0000","last_unstale":"2024-08-17T02:25:56.041753+0000","last_undegraded":"2024-08-17T02:25:56.041753+0000","last_fullsized":"2024-08-17T02:25:56.041753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:55.320971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.030341+0000","last_change":"2024-08-17T02:25:56.025278+0000","last_active":"2024-08-17T02:25:56.030341+0000","last_peered":"2024-08-17T02:25:56.030341+0000","last_clean":"2024-08-17T02:25:56.030341+0000","last_became_active":"2024-08-17T02:25:56.023690+0000","last_became_peered":"2024-08-17T02:25:56.023690+0000","last_unstale":"2024-08-17T02:25:56.030341+0000","last_undegraded":"2024-08-17T02:25:56.030341+0000","last_fullsized":"2024-08-17T02:25:56.030341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:09.506321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.035834+0000","last_change":"2024-08-17T02:25:56.025247+0000","last_active":"2024-08-17T02:25:56.035834+0000","last_peered":"2024-08-17T02:25:56.035834+0000","last_clean":"2024-08-17T02:25:56.035834+0000","last_became_active":"2024-08-17T02:25:56.024908+0000","last_became_peered":"2024-08-17T02:25:56.024908+0000","last_unstale":"2024-08-17T02:25:56.035834+0000","last_undegraded":"2024-08-17T02:25:56.035834+0000","last_fullsized":"2024-08-17T02:25:56.035834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:42.383928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.031806+0000","last_change":"2024-08-17T02:25:56.025374+0000","last_active":"2024-08-17T02:25:56.031806+0000","last_peered":"2024-08-17T02:25:56.031806+0000","last_clean":"2024-08-17T02:25:56.031806+0000","last_became_active":"2024-08-17T02:25:56.025085+0000","last_became_peered":"2024-08-17T02:25:56.025085+0000","last_unstale":"2024-08-17T02:25:56.031806+0000","last_undegraded":"2024-08-17T02:25:56.031806+0000","last_fullsized":"2024-08-17T02:25:56.031806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:50:31.109301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.024776+0000","last_change":"2024-08-17T02:25:56.019936+0000","last_active":"2024-08-17T02:25:56.024776+0000","last_peered":"2024-08-17T02:25:56.024776+0000","last_clean":"2024-08-17T02:25:56.024776+0000","last_became_active":"2024-08-17T02:25:56.019534+0000","last_became_peered":"2024-08-17T02:25:56.019534+0000","last_unstale":"2024-08-17T02:25:56.024776+0000","last_undegraded":"2024-08-17T02:25:56.024776+0000","last_fullsized":"2024-08-17T02:25:56.024776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:55.320971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.034322+0000","last_change":"2024-08-17T02:25:56.027794+0000","last_active":"2024-08-17T02:25:56.034322+0000","last_peered":"2024-08-17T02:25:56.034322+0000","last_clean":"2024-08-17T02:25:56.034322+0000","last_became_active":"2024-08-17T02:25:56.026104+0000","last_became_peered":"2024-08-17T02:25:56.026104+0000","last_unstale":"2024-08-17T02:25:56.034322+0000","last_undegraded":"2024-08-17T02:25:56.034322+0000","last_fullsized":"2024-08-17T02:25:56.034322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:38.820190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.045256+0000","last_change":"2024-08-17T02:25:54.996735+0000","last_active":"2024-08-17T02:25:56.045256+0000","last_peered":"2024-08-17T02:25:56.045256+0000","last_clean":"2024-08-17T02:25:56.045256+0000","last_became_active":"2024-08-17T02:25:54.996446+0000","last_became_peered":"2024-08-17T02:25:54.996446+0000","last_unstale":"2024-08-17T02:25:56.045256+0000","last_undegraded":"2024-08-17T02:25:56.045256+0000","last_fullsized":"2024-08-17T02:25:56.045256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.027333+0000","last_change":"2024-08-17T02:25:56.019338+0000","last_active":"2024-08-17T02:25:56.027333+0000","last_peered":"2024-08-17T02:25:56.027333+0000","last_clean":"2024-08-17T02:25:56.027333+0000","last_became_active":"2024-08-17T02:25:56.018424+0000","last_became_peered":"2024-08-17T02:25:56.018424+0000","last_unstale":"2024-08-17T02:25:56.027333+0000","last_undegraded":"2024-08-17T02:25:56.027333+0000","last_fullsized":"2024-08-17T02:25:56.027333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:36:59.886094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.042638+0000","last_change":"2024-08-17T02:25:55.002905+0000","last_active":"2024-08-17T02:25:56.042638+0000","last_peered":"2024-08-17T02:25:56.042638+0000","last_clean":"2024-08-17T02:25:56.042638+0000","last_became_active":"2024-08-17T02:25:55.002626+0000","last_became_peered":"2024-08-17T02:25:55.002626+0000","last_unstale":"2024-08-17T02:25:56.042638+0000","last_undegraded":"2024-08-17T02:25:56.042638+0000","last_fullsized":"2024-08-17T02:25:56.042638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:00.101762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.012817+0000","last_change":"2024-08-17T02:25:55.002842+0000","last_active":"2024-08-17T02:25:56.012817+0000","last_peered":"2024-08-17T02:25:56.012817+0000","last_clean":"2024-08-17T02:25:56.012817+0000","last_became_active":"2024-08-17T02:25:55.002548+0000","last_became_peered":"2024-08-17T02:25:55.002548+0000","last_unstale":"2024-08-17T02:25:56.012817+0000","last_undegraded":"2024-08-17T02:25:56.012817+0000","last_fullsized":"2024-08-17T02:25:56.012817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:26.856354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.038777+0000","last_change":"2024-08-17T02:25:56.030862+0000","last_active":"2024-08-17T02:25:56.038777+0000","last_peered":"2024-08-17T02:25:56.038777+0000","last_clean":"2024-08-17T02:25:56.038777+0000","last_became_active":"2024-08-17T02:25:56.030561+0000","last_became_peered":"2024-08-17T02:25:56.030561+0000","last_unstale":"2024-08-17T02:25:56.038777+0000","last_undegraded":"2024-08-17T02:25:56.038777+0000","last_fullsized":"2024-08-17T02:25:56.038777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:36:59.886094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.021273+0000","last_change":"2024-08-17T02:25:54.995596+0000","last_active":"2024-08-17T02:25:56.021273+0000","last_peered":"2024-08-17T02:25:56.021273+0000","last_clean":"2024-08-17T02:25:56.021273+0000","last_became_active":"2024-08-17T02:25:54.994045+0000","last_became_peered":"2024-08-17T02:25:54.994045+0000","last_unstale":"2024-08-17T02:25:56.021273+0000","last_undegraded":"2024-08-17T02:25:56.021273+0000","last_fullsized":"2024-08-17T02:25:56.021273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:25:59.640731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.037529+0000","last_change":"2024-08-17T02:25:56.030467+0000","last_active":"2024-08-17T02:25:56.037529+0000","last_peered":"2024-08-17T02:25:56.037529+0000","last_clean":"2024-08-17T02:25:56.037529+0000","last_became_active":"2024-08-17T02:25:56.030177+0000","last_became_peered":"2024-08-17T02:25:56.030177+0000","last_unstale":"2024-08-17T02:25:56.037529+0000","last_undegraded":"2024-08-17T02:25:56.037529+0000","last_fullsized":"2024-08-17T02:25:56.037529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:14:23.828783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.014529+0000","last_change":"2024-08-17T02:25:55.006457+0000","last_active":"2024-08-17T02:25:56.014529+0000","last_peered":"2024-08-17T02:25:56.014529+0000","last_clean":"2024-08-17T02:25:56.014529+0000","last_became_active":"2024-08-17T02:25:55.006225+0000","last_became_peered":"2024-08-17T02:25:55.006225+0000","last_unstale":"2024-08-17T02:25:56.014529+0000","last_undegraded":"2024-08-17T02:25:56.014529+0000","last_fullsized":"2024-08-17T02:25:56.014529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:01.595885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047268+0000","last_change":"2024-08-17T02:25:56.043053+0000","last_active":"2024-08-17T02:25:56.047268+0000","last_peered":"2024-08-17T02:25:56.047268+0000","last_clean":"2024-08-17T02:25:56.047268+0000","last_became_active":"2024-08-17T02:25:56.042765+0000","last_became_peered":"2024-08-17T02:25:56.042765+0000","last_unstale":"2024-08-17T02:25:56.047268+0000","last_undegraded":"2024-08-17T02:25:56.047268+0000","last_fullsized":"2024-08-17T02:25:56.047268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:26:12.529793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.024646+0000","last_change":"2024-08-17T02:25:55.007141+0000","last_active":"2024-08-17T02:25:56.024646+0000","last_peered":"2024-08-17T02:25:56.024646+0000","last_clean":"2024-08-17T02:25:56.024646+0000","last_became_active":"2024-08-17T02:25:55.006847+0000","last_became_peered":"2024-08-17T02:25:55.006847+0000","last_unstale":"2024-08-17T02:25:56.024646+0000","last_undegraded":"2024-08-17T02:25:56.024646+0000","last_fullsized":"2024-08-17T02:25:56.024646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:12.268531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041448+0000","last_change":"2024-08-17T02:25:56.037131+0000","last_active":"2024-08-17T02:25:56.041448+0000","last_peered":"2024-08-17T02:25:56.041448+0000","last_clean":"2024-08-17T02:25:56.041448+0000","last_became_active":"2024-08-17T02:25:56.036703+0000","last_became_peered":"2024-08-17T02:25:56.036703+0000","last_unstale":"2024-08-17T02:25:56.041448+0000","last_undegraded":"2024-08-17T02:25:56.041448+0000","last_fullsized":"2024-08-17T02:25:56.041448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:24.560363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041671+0000","last_change":"2024-08-17T02:25:54.996735+0000","last_active":"2024-08-17T02:25:56.041671+0000","last_peered":"2024-08-17T02:25:56.041671+0000","last_clean":"2024-08-17T02:25:56.041671+0000","last_became_active":"2024-08-17T02:25:54.996462+0000","last_became_peered":"2024-08-17T02:25:54.996462+0000","last_unstale":"2024-08-17T02:25:56.041671+0000","last_undegraded":"2024-08-17T02:25:56.041671+0000","last_fullsized":"2024-08-17T02:25:56.041671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:21.048415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.027476+0000","last_change":"2024-08-17T02:25:56.019935+0000","last_active":"2024-08-17T02:25:56.027476+0000","last_peered":"2024-08-17T02:25:56.027476+0000","last_clean":"2024-08-17T02:25:56.027476+0000","last_became_active":"2024-08-17T02:25:56.019608+0000","last_became_peered":"2024-08-17T02:25:56.019608+0000","last_unstale":"2024-08-17T02:25:56.027476+0000","last_undegraded":"2024-08-17T02:25:56.027476+0000","last_fullsized":"2024-08-17T02:25:56.027476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:22.058035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047300+0000","last_change":"2024-08-17T02:25:55.001788+0000","last_active":"2024-08-17T02:25:56.047300+0000","last_peered":"2024-08-17T02:25:56.047300+0000","last_clean":"2024-08-17T02:25:56.047300+0000","last_became_active":"2024-08-17T02:25:55.001430+0000","last_became_peered":"2024-08-17T02:25:55.001430+0000","last_unstale":"2024-08-17T02:25:56.047300+0000","last_undegraded":"2024-08-17T02:25:56.047300+0000","last_fullsized":"2024-08-17T02:25:56.047300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:26.856354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047546+0000","last_change":"2024-08-17T02:25:56.041922+0000","last_active":"2024-08-17T02:25:56.047546+0000","last_peered":"2024-08-17T02:25:56.047546+0000","last_clean":"2024-08-17T02:25:56.047546+0000","last_became_active":"2024-08-17T02:25:56.041213+0000","last_became_peered":"2024-08-17T02:25:56.041213+0000","last_unstale":"2024-08-17T02:25:56.047546+0000","last_undegraded":"2024-08-17T02:25:56.047546+0000","last_fullsized":"2024-08-17T02:25:56.047546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:25.128217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044849+0000","last_change":"2024-08-17T02:25:54.997271+0000","last_active":"2024-08-17T02:25:56.044849+0000","last_peered":"2024-08-17T02:25:56.044849+0000","last_clean":"2024-08-17T02:25:56.044849+0000","last_became_active":"2024-08-17T02:25:54.996996+0000","last_became_peered":"2024-08-17T02:25:54.996996+0000","last_unstale":"2024-08-17T02:25:56.044849+0000","last_undegraded":"2024-08-17T02:25:56.044849+0000","last_fullsized":"2024-08-17T02:25:56.044849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.030027+0000","last_change":"2024-08-17T02:25:56.023022+0000","last_active":"2024-08-17T02:25:56.030027+0000","last_peered":"2024-08-17T02:25:56.030027+0000","last_clean":"2024-08-17T02:25:56.030027+0000","last_became_active":"2024-08-17T02:25:56.020092+0000","last_became_peered":"2024-08-17T02:25:56.020092+0000","last_unstale":"2024-08-17T02:25:56.030027+0000","last_undegraded":"2024-08-17T02:25:56.030027+0000","last_fullsized":"2024-08-17T02:25:56.030027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:08.877931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.023336+0000","last_change":"2024-08-17T02:25:55.000169+0000","last_active":"2024-08-17T02:25:56.023336+0000","last_peered":"2024-08-17T02:25:56.023336+0000","last_clean":"2024-08-17T02:25:56.023336+0000","last_became_active":"2024-08-17T02:25:54.999922+0000","last_became_peered":"2024-08-17T02:25:54.999922+0000","last_unstale":"2024-08-17T02:25:56.023336+0000","last_undegraded":"2024-08-17T02:25:56.023336+0000","last_fullsized":"2024-08-17T02:25:56.023336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:37.810570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047588+0000","last_change":"2024-08-17T02:25:56.042130+0000","last_active":"2024-08-17T02:25:56.047588+0000","last_peered":"2024-08-17T02:25:56.047588+0000","last_clean":"2024-08-17T02:25:56.047588+0000","last_became_active":"2024-08-17T02:25:56.040537+0000","last_became_peered":"2024-08-17T02:25:56.040537+0000","last_unstale":"2024-08-17T02:25:56.047588+0000","last_undegraded":"2024-08-17T02:25:56.047588+0000","last_fullsized":"2024-08-17T02:25:56.047588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:24.600349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.013500+0000","last_change":"2024-08-17T02:25:55.007014+0000","last_active":"2024-08-17T02:25:56.013500+0000","last_peered":"2024-08-17T02:25:56.013500+0000","last_clean":"2024-08-17T02:25:56.013500+0000","last_became_active":"2024-08-17T02:25:55.006703+0000","last_became_peered":"2024-08-17T02:25:55.006703+0000","last_unstale":"2024-08-17T02:25:56.013500+0000","last_undegraded":"2024-08-17T02:25:56.013500+0000","last_fullsized":"2024-08-17T02:25:56.013500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:20.748382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.024753+0000","last_change":"2024-08-17T02:25:56.019882+0000","last_active":"2024-08-17T02:25:56.024753+0000","last_peered":"2024-08-17T02:25:56.024753+0000","last_clean":"2024-08-17T02:25:56.024753+0000","last_became_active":"2024-08-17T02:25:56.019469+0000","last_became_peered":"2024-08-17T02:25:56.019469+0000","last_unstale":"2024-08-17T02:25:56.024753+0000","last_undegraded":"2024-08-17T02:25:56.024753+0000","last_fullsized":"2024-08-17T02:25:56.024753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:36:59.886094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.045053+0000","last_change":"2024-08-17T02:25:54.993917+0000","last_active":"2024-08-17T02:25:56.045053+0000","last_peered":"2024-08-17T02:25:56.045053+0000","last_clean":"2024-08-17T02:25:56.045053+0000","last_became_active":"2024-08-17T02:25:54.993586+0000","last_became_peered":"2024-08-17T02:25:54.993586+0000","last_unstale":"2024-08-17T02:25:56.045053+0000","last_undegraded":"2024-08-17T02:25:56.045053+0000","last_fullsized":"2024-08-17T02:25:56.045053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:00.101762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044680+0000","last_change":"2024-08-17T02:25:56.034676+0000","last_active":"2024-08-17T02:25:56.044680+0000","last_peered":"2024-08-17T02:25:56.044680+0000","last_clean":"2024-08-17T02:25:56.044680+0000","last_became_active":"2024-08-17T02:25:56.032428+0000","last_became_peered":"2024-08-17T02:25:56.032428+0000","last_unstale":"2024-08-17T02:25:56.044680+0000","last_undegraded":"2024-08-17T02:25:56.044680+0000","last_fullsized":"2024-08-17T02:25:56.044680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:15.142628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041743+0000","last_change":"2024-08-17T02:25:54.997719+0000","last_active":"2024-08-17T02:25:56.041743+0000","last_peered":"2024-08-17T02:25:56.041743+0000","last_clean":"2024-08-17T02:25:56.041743+0000","last_became_active":"2024-08-17T02:25:54.997406+0000","last_became_peered":"2024-08-17T02:25:54.997406+0000","last_unstale":"2024-08-17T02:25:56.041743+0000","last_undegraded":"2024-08-17T02:25:56.041743+0000","last_fullsized":"2024-08-17T02:25:56.041743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:13.181529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047459+0000","last_change":"2024-08-17T02:25:56.041646+0000","last_active":"2024-08-17T02:25:56.047459+0000","last_peered":"2024-08-17T02:25:56.047459+0000","last_clean":"2024-08-17T02:25:56.047459+0000","last_became_active":"2024-08-17T02:25:56.040446+0000","last_became_peered":"2024-08-17T02:25:56.040446+0000","last_unstale":"2024-08-17T02:25:56.047459+0000","last_undegraded":"2024-08-17T02:25:56.047459+0000","last_fullsized":"2024-08-17T02:25:56.047459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:08.877931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041865+0000","last_change":"2024-08-17T02:25:55.000628+0000","last_active":"2024-08-17T02:25:56.041865+0000","last_peered":"2024-08-17T02:25:56.041865+0000","last_clean":"2024-08-17T02:25:56.041865+0000","last_became_active":"2024-08-17T02:25:55.000178+0000","last_became_peered":"2024-08-17T02:25:55.000178+0000","last_unstale":"2024-08-17T02:25:56.041865+0000","last_undegraded":"2024-08-17T02:25:56.041865+0000","last_fullsized":"2024-08-17T02:25:56.041865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:40.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047416+0000","last_change":"2024-08-17T02:25:56.041357+0000","last_active":"2024-08-17T02:25:56.047416+0000","last_peered":"2024-08-17T02:25:56.047416+0000","last_clean":"2024-08-17T02:25:56.047416+0000","last_became_active":"2024-08-17T02:25:56.040452+0000","last_became_peered":"2024-08-17T02:25:56.040452+0000","last_unstale":"2024-08-17T02:25:56.047416+0000","last_undegraded":"2024-08-17T02:25:56.047416+0000","last_fullsized":"2024-08-17T02:25:56.047416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:58.712854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.043576+0000","last_change":"2024-08-17T02:25:54.993030+0000","last_active":"2024-08-17T02:25:56.043576+0000","last_peered":"2024-08-17T02:25:56.043576+0000","last_clean":"2024-08-17T02:25:56.043576+0000","last_became_active":"2024-08-17T02:25:54.992489+0000","last_became_peered":"2024-08-17T02:25:54.992489+0000","last_unstale":"2024-08-17T02:25:56.043576+0000","last_undegraded":"2024-08-17T02:25:56.043576+0000","last_fullsized":"2024-08-17T02:25:56.043576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:55.678872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.034464+0000","last_change":"2024-08-17T02:25:56.024775+0000","last_active":"2024-08-17T02:25:56.034464+0000","last_peered":"2024-08-17T02:25:56.034464+0000","last_clean":"2024-08-17T02:25:56.034464+0000","last_became_active":"2024-08-17T02:25:56.024421+0000","last_became_peered":"2024-08-17T02:25:56.024421+0000","last_unstale":"2024-08-17T02:25:56.034464+0000","last_undegraded":"2024-08-17T02:25:56.034464+0000","last_fullsized":"2024-08-17T02:25:56.034464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:45:06.291261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.013596+0000","last_change":"2024-08-17T02:25:54.997149+0000","last_active":"2024-08-17T02:25:56.013596+0000","last_peered":"2024-08-17T02:25:56.013596+0000","last_clean":"2024-08-17T02:25:56.013596+0000","last_became_active":"2024-08-17T02:25:54.996821+0000","last_became_peered":"2024-08-17T02:25:54.996821+0000","last_unstale":"2024-08-17T02:25:56.013596+0000","last_undegraded":"2024-08-17T02:25:56.013596+0000","last_fullsized":"2024-08-17T02:25:56.013596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:26.856354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047478+0000","last_change":"2024-08-17T02:25:56.041666+0000","last_active":"2024-08-17T02:25:56.047478+0000","last_peered":"2024-08-17T02:25:56.047478+0000","last_clean":"2024-08-17T02:25:56.047478+0000","last_became_active":"2024-08-17T02:25:56.040381+0000","last_became_peered":"2024-08-17T02:25:56.040381+0000","last_unstale":"2024-08-17T02:25:56.047478+0000","last_undegraded":"2024-08-17T02:25:56.047478+0000","last_fullsized":"2024-08-17T02:25:56.047478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:04.282484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.014877+0000","last_change":"2024-08-17T02:25:51.241912+0000","last_active":"2024-08-17T02:25:56.014877+0000","last_peered":"2024-08-17T02:25:56.014877+0000","last_clean":"2024-08-17T02:25:56.014877+0000","last_became_active":"2024-08-17T02:25:51.239655+0000","last_became_peered":"2024-08-17T02:25:51.239655+0000","last_unstale":"2024-08-17T02:25:56.014877+0000","last_undegraded":"2024-08-17T02:25:56.014877+0000","last_fullsized":"2024-08-17T02:25:56.014877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_clean_scrub_stamp":"2024-08-17T02:25:49.863184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:53.845381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.020368+0000","last_change":"2024-08-17T02:25:54.995452+0000","last_active":"2024-08-17T02:25:56.020368+0000","last_peered":"2024-08-17T02:25:56.020368+0000","last_clean":"2024-08-17T02:25:56.020368+0000","last_became_active":"2024-08-17T02:25:54.994880+0000","last_became_peered":"2024-08-17T02:25:54.994880+0000","last_unstale":"2024-08-17T02:25:56.020368+0000","last_undegraded":"2024-08-17T02:25:56.020368+0000","last_fullsized":"2024-08-17T02:25:56.020368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:06.575204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044202+0000","last_change":"2024-08-17T02:25:56.037423+0000","last_active":"2024-08-17T02:25:56.044202+0000","last_peered":"2024-08-17T02:25:56.044202+0000","last_clean":"2024-08-17T02:25:56.044202+0000","last_became_active":"2024-08-17T02:25:56.037168+0000","last_became_peered":"2024-08-17T02:25:56.037168+0000","last_unstale":"2024-08-17T02:25:56.044202+0000","last_undegraded":"2024-08-17T02:25:56.044202+0000","last_fullsized":"2024-08-17T02:25:56.044202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:08.877931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.014785+0000","last_change":"2024-08-17T02:25:55.000498+0000","last_active":"2024-08-17T02:25:56.014785+0000","last_peered":"2024-08-17T02:25:56.014785+0000","last_clean":"2024-08-17T02:25:56.014785+0000","last_became_active":"2024-08-17T02:25:54.999897+0000","last_became_peered":"2024-08-17T02:25:54.999897+0000","last_unstale":"2024-08-17T02:25:56.014785+0000","last_undegraded":"2024-08-17T02:25:56.014785+0000","last_fullsized":"2024-08-17T02:25:56.014785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:50:30.099680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.017625+0000","last_change":"2024-08-17T02:25:56.014989+0000","last_active":"2024-08-17T02:25:56.017625+0000","last_peered":"2024-08-17T02:25:56.017625+0000","last_clean":"2024-08-17T02:25:56.017625+0000","last_became_active":"2024-08-17T02:25:56.014310+0000","last_became_peered":"2024-08-17T02:25:56.014310+0000","last_unstale":"2024-08-17T02:25:56.017625+0000","last_undegraded":"2024-08-17T02:25:56.017625+0000","last_fullsized":"2024-08-17T02:25:56.017625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:00:15.232217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.014797+0000","last_change":"2024-08-17T02:25:55.000861+0000","last_active":"2024-08-17T02:25:56.014797+0000","last_peered":"2024-08-17T02:25:56.014797+0000","last_clean":"2024-08-17T02:25:56.014797+0000","last_became_active":"2024-08-17T02:25:55.000232+0000","last_became_peered":"2024-08-17T02:25:55.000232+0000","last_unstale":"2024-08-17T02:25:56.014797+0000","last_undegraded":"2024-08-17T02:25:56.014797+0000","last_fullsized":"2024-08-17T02:25:56.014797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:20.748382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.035617+0000","last_change":"2024-08-17T02:25:56.028629+0000","last_active":"2024-08-17T02:25:56.035617+0000","last_peered":"2024-08-17T02:25:56.035617+0000","last_clean":"2024-08-17T02:25:56.035617+0000","last_became_active":"2024-08-17T02:25:56.028325+0000","last_became_peered":"2024-08-17T02:25:56.028325+0000","last_unstale":"2024-08-17T02:25:56.035617+0000","last_undegraded":"2024-08-17T02:25:56.035617+0000","last_fullsized":"2024-08-17T02:25:56.035617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:42:23.855343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.023915+0000","last_change":"2024-08-17T02:25:54.999649+0000","last_active":"2024-08-17T02:25:56.023915+0000","last_peered":"2024-08-17T02:25:56.023915+0000","last_clean":"2024-08-17T02:25:56.023915+0000","last_became_active":"2024-08-17T02:25:54.995798+0000","last_became_peered":"2024-08-17T02:25:54.995798+0000","last_unstale":"2024-08-17T02:25:56.023915+0000","last_undegraded":"2024-08-17T02:25:56.023915+0000","last_fullsized":"2024-08-17T02:25:56.023915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:39.955144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.025289+0000","last_change":"2024-08-17T02:25:56.019288+0000","last_active":"2024-08-17T02:25:56.025289+0000","last_peered":"2024-08-17T02:25:56.025289+0000","last_clean":"2024-08-17T02:25:56.025289+0000","last_became_active":"2024-08-17T02:25:56.018798+0000","last_became_peered":"2024-08-17T02:25:56.018798+0000","last_unstale":"2024-08-17T02:25:56.025289+0000","last_undegraded":"2024-08-17T02:25:56.025289+0000","last_fullsized":"2024-08-17T02:25:56.025289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:07.584824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.022945+0000","last_change":"2024-08-17T02:25:54.995600+0000","last_active":"2024-08-17T02:25:56.022945+0000","last_peered":"2024-08-17T02:25:56.022945+0000","last_clean":"2024-08-17T02:25:56.022945+0000","last_became_active":"2024-08-17T02:25:54.994117+0000","last_became_peered":"2024-08-17T02:25:54.994117+0000","last_unstale":"2024-08-17T02:25:56.022945+0000","last_undegraded":"2024-08-17T02:25:56.022945+0000","last_fullsized":"2024-08-17T02:25:56.022945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:12.268531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.037841+0000","last_change":"2024-08-17T02:25:56.029058+0000","last_active":"2024-08-17T02:25:56.037841+0000","last_peered":"2024-08-17T02:25:56.037841+0000","last_clean":"2024-08-17T02:25:56.037841+0000","last_became_active":"2024-08-17T02:25:56.028723+0000","last_became_peered":"2024-08-17T02:25:56.028723+0000","last_unstale":"2024-08-17T02:25:56.037841+0000","last_undegraded":"2024-08-17T02:25:56.037841+0000","last_fullsized":"2024-08-17T02:25:56.037841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:19:28.379133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.018098+0000","last_change":"2024-08-17T02:25:55.000605+0000","last_active":"2024-08-17T02:25:56.018098+0000","last_peered":"2024-08-17T02:25:56.018098+0000","last_clean":"2024-08-17T02:25:56.018098+0000","last_became_active":"2024-08-17T02:25:55.000291+0000","last_became_peered":"2024-08-17T02:25:55.000291+0000","last_unstale":"2024-08-17T02:25:56.018098+0000","last_undegraded":"2024-08-17T02:25:56.018098+0000","last_fullsized":"2024-08-17T02:25:56.018098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:04.186628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.032284+0000","last_change":"2024-08-17T02:25:56.027086+0000","last_active":"2024-08-17T02:25:56.032284+0000","last_peered":"2024-08-17T02:25:56.032284+0000","last_clean":"2024-08-17T02:25:56.032284+0000","last_became_active":"2024-08-17T02:25:56.026817+0000","last_became_peered":"2024-08-17T02:25:56.026817+0000","last_unstale":"2024-08-17T02:25:56.032284+0000","last_undegraded":"2024-08-17T02:25:56.032284+0000","last_fullsized":"2024-08-17T02:25:56.032284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:11.672911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:25:57.037358+0000","last_change":"2024-08-17T02:25:55.004265+0000","last_active":"2024-08-17T02:25:57.037358+0000","last_peered":"2024-08-17T02:25:57.037358+0000","last_clean":"2024-08-17T02:25:57.037358+0000","last_became_active":"2024-08-17T02:25:55.003943+0000","last_became_peered":"2024-08-17T02:25:55.003943+0000","last_unstale":"2024-08-17T02:25:57.037358+0000","last_undegraded":"2024-08-17T02:25:57.037358+0000","last_fullsized":"2024-08-17T02:25:57.037358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:37.810570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044597+0000","last_change":"2024-08-17T02:25:56.042831+0000","last_active":"2024-08-17T02:25:56.044597+0000","last_peered":"2024-08-17T02:25:56.044597+0000","last_clean":"2024-08-17T02:25:56.044597+0000","last_became_active":"2024-08-17T02:25:56.042634+0000","last_became_peered":"2024-08-17T02:25:56.042634+0000","last_unstale":"2024-08-17T02:25:56.044597+0000","last_undegraded":"2024-08-17T02:25:56.044597+0000","last_fullsized":"2024-08-17T02:25:56.044597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:32.738921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.045124+0000","last_change":"2024-08-17T02:25:55.001866+0000","last_active":"2024-08-17T02:25:56.045124+0000","last_peered":"2024-08-17T02:25:56.045124+0000","last_clean":"2024-08-17T02:25:56.045124+0000","last_became_active":"2024-08-17T02:25:55.001524+0000","last_became_peered":"2024-08-17T02:25:55.001524+0000","last_unstale":"2024-08-17T02:25:56.045124+0000","last_undegraded":"2024-08-17T02:25:56.045124+0000","last_fullsized":"2024-08-17T02:25:56.045124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:00:14.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.032472+0000","last_change":"2024-08-17T02:25:56.028887+0000","last_active":"2024-08-17T02:25:56.032472+0000","last_peered":"2024-08-17T02:25:56.032472+0000","last_clean":"2024-08-17T02:25:56.032472+0000","last_became_active":"2024-08-17T02:25:56.028557+0000","last_became_peered":"2024-08-17T02:25:56.028557+0000","last_unstale":"2024-08-17T02:25:56.032472+0000","last_undegraded":"2024-08-17T02:25:56.032472+0000","last_fullsized":"2024-08-17T02:25:56.032472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:39.367618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.014668+0000","last_change":"2024-08-17T02:25:55.000105+0000","last_active":"2024-08-17T02:25:56.014668+0000","last_peered":"2024-08-17T02:25:56.014668+0000","last_clean":"2024-08-17T02:25:56.014668+0000","last_became_active":"2024-08-17T02:25:54.999581+0000","last_became_peered":"2024-08-17T02:25:54.999581+0000","last_unstale":"2024-08-17T02:25:56.014668+0000","last_undegraded":"2024-08-17T02:25:56.014668+0000","last_fullsized":"2024-08-17T02:25:56.014668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:14.229475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.028105+0000","last_change":"2024-08-17T02:25:56.018046+0000","last_active":"2024-08-17T02:25:56.028105+0000","last_peered":"2024-08-17T02:25:56.028105+0000","last_clean":"2024-08-17T02:25:56.028105+0000","last_became_active":"2024-08-17T02:25:56.016770+0000","last_became_peered":"2024-08-17T02:25:56.016770+0000","last_unstale":"2024-08-17T02:25:56.028105+0000","last_undegraded":"2024-08-17T02:25:56.028105+0000","last_fullsized":"2024-08-17T02:25:56.028105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:56.688493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.023115+0000","last_change":"2024-08-17T02:25:54.999172+0000","last_active":"2024-08-17T02:25:56.023115+0000","last_peered":"2024-08-17T02:25:56.023115+0000","last_clean":"2024-08-17T02:25:56.023115+0000","last_became_active":"2024-08-17T02:25:54.998807+0000","last_became_peered":"2024-08-17T02:25:54.998807+0000","last_unstale":"2024-08-17T02:25:56.023115+0000","last_undegraded":"2024-08-17T02:25:56.023115+0000","last_fullsized":"2024-08-17T02:25:56.023115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:25:59.640731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.032555+0000","last_change":"2024-08-17T02:25:56.028861+0000","last_active":"2024-08-17T02:25:56.032555+0000","last_peered":"2024-08-17T02:25:56.032555+0000","last_clean":"2024-08-17T02:25:56.032555+0000","last_became_active":"2024-08-17T02:25:56.028556+0000","last_became_peered":"2024-08-17T02:25:56.028556+0000","last_unstale":"2024-08-17T02:25:56.032555+0000","last_undegraded":"2024-08-17T02:25:56.032555+0000","last_fullsized":"2024-08-17T02:25:56.032555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:15.442494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.023347+0000","last_change":"2024-08-17T02:25:54.997943+0000","last_active":"2024-08-17T02:25:56.023347+0000","last_peered":"2024-08-17T02:25:56.023347+0000","last_clean":"2024-08-17T02:25:56.023347+0000","last_became_active":"2024-08-17T02:25:54.997169+0000","last_became_peered":"2024-08-17T02:25:54.997169+0000","last_unstale":"2024-08-17T02:25:56.023347+0000","last_undegraded":"2024-08-17T02:25:56.023347+0000","last_fullsized":"2024-08-17T02:25:56.023347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:06.575204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.026482+0000","last_change":"2024-08-17T02:25:56.021687+0000","last_active":"2024-08-17T02:25:56.026482+0000","last_peered":"2024-08-17T02:25:56.026482+0000","last_clean":"2024-08-17T02:25:56.026482+0000","last_became_active":"2024-08-17T02:25:56.020957+0000","last_became_peered":"2024-08-17T02:25:56.020957+0000","last_unstale":"2024-08-17T02:25:56.026482+0000","last_undegraded":"2024-08-17T02:25:56.026482+0000","last_fullsized":"2024-08-17T02:25:56.026482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:40.638494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044872+0000","last_change":"2024-08-17T02:25:54.999914+0000","last_active":"2024-08-17T02:25:56.044872+0000","last_peered":"2024-08-17T02:25:56.044872+0000","last_clean":"2024-08-17T02:25:56.044872+0000","last_became_active":"2024-08-17T02:25:54.999660+0000","last_became_peered":"2024-08-17T02:25:54.999660+0000","last_unstale":"2024-08-17T02:25:56.044872+0000","last_undegraded":"2024-08-17T02:25:56.044872+0000","last_fullsized":"2024-08-17T02:25:56.044872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:00:14.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.027375+0000","last_change":"2024-08-17T02:25:56.023133+0000","last_active":"2024-08-17T02:25:56.027375+0000","last_peered":"2024-08-17T02:25:56.027375+0000","last_clean":"2024-08-17T02:25:56.027375+0000","last_became_active":"2024-08-17T02:25:56.022831+0000","last_became_peered":"2024-08-17T02:25:56.022831+0000","last_unstale":"2024-08-17T02:25:56.027375+0000","last_undegraded":"2024-08-17T02:25:56.027375+0000","last_fullsized":"2024-08-17T02:25:56.027375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:08.877931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041005+0000","last_change":"2024-08-17T02:25:56.037053+0000","last_active":"2024-08-17T02:25:56.041005+0000","last_peered":"2024-08-17T02:25:56.041005+0000","last_clean":"2024-08-17T02:25:56.041005+0000","last_became_active":"2024-08-17T02:25:56.034842+0000","last_became_peered":"2024-08-17T02:25:56.034842+0000","last_unstale":"2024-08-17T02:25:56.041005+0000","last_undegraded":"2024-08-17T02:25:56.041005+0000","last_fullsized":"2024-08-17T02:25:56.041005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:35.583197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044916+0000","last_change":"2024-08-17T02:25:55.001827+0000","last_active":"2024-08-17T02:25:56.044916+0000","last_peered":"2024-08-17T02:25:56.044916+0000","last_clean":"2024-08-17T02:25:56.044916+0000","last_became_active":"2024-08-17T02:25:55.001554+0000","last_became_peered":"2024-08-17T02:25:55.001554+0000","last_unstale":"2024-08-17T02:25:56.044916+0000","last_undegraded":"2024-08-17T02:25:56.044916+0000","last_fullsized":"2024-08-17T02:25:56.044916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:28.545139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.034569+0000","last_change":"2024-08-17T02:25:56.025255+0000","last_active":"2024-08-17T02:25:56.034569+0000","last_peered":"2024-08-17T02:25:56.034569+0000","last_clean":"2024-08-17T02:25:56.034569+0000","last_became_active":"2024-08-17T02:25:56.023945+0000","last_became_peered":"2024-08-17T02:25:56.023945+0000","last_unstale":"2024-08-17T02:25:56.034569+0000","last_undegraded":"2024-08-17T02:25:56.034569+0000","last_fullsized":"2024-08-17T02:25:56.034569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:57.681709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044998+0000","last_change":"2024-08-17T02:25:55.003882+0000","last_active":"2024-08-17T02:25:56.044998+0000","last_peered":"2024-08-17T02:25:56.044998+0000","last_clean":"2024-08-17T02:25:56.044998+0000","last_became_active":"2024-08-17T02:25:55.003585+0000","last_became_peered":"2024-08-17T02:25:55.003585+0000","last_unstale":"2024-08-17T02:25:56.044998+0000","last_undegraded":"2024-08-17T02:25:56.044998+0000","last_fullsized":"2024-08-17T02:25:56.044998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:10.820465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041428+0000","last_change":"2024-08-17T02:25:56.036969+0000","last_active":"2024-08-17T02:25:56.041428+0000","last_peered":"2024-08-17T02:25:56.041428+0000","last_clean":"2024-08-17T02:25:56.041428+0000","last_became_active":"2024-08-17T02:25:56.036345+0000","last_became_peered":"2024-08-17T02:25:56.036345+0000","last_unstale":"2024-08-17T02:25:56.041428+0000","last_undegraded":"2024-08-17T02:25:56.041428+0000","last_fullsized":"2024-08-17T02:25:56.041428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:32.738921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041631+0000","last_change":"2024-08-17T02:25:54.995388+0000","last_active":"2024-08-17T02:25:56.041631+0000","last_peered":"2024-08-17T02:25:56.041631+0000","last_clean":"2024-08-17T02:25:56.041631+0000","last_became_active":"2024-08-17T02:25:54.994967+0000","last_became_peered":"2024-08-17T02:25:54.994967+0000","last_unstale":"2024-08-17T02:25:56.041631+0000","last_undegraded":"2024-08-17T02:25:56.041631+0000","last_fullsized":"2024-08-17T02:25:56.041631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:14.842533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.029964+0000","last_change":"2024-08-17T02:25:56.026659+0000","last_active":"2024-08-17T02:25:56.029964+0000","last_peered":"2024-08-17T02:25:56.029964+0000","last_clean":"2024-08-17T02:25:56.029964+0000","last_became_active":"2024-08-17T02:25:56.026321+0000","last_became_peered":"2024-08-17T02:25:56.026321+0000","last_unstale":"2024-08-17T02:25:56.029964+0000","last_undegraded":"2024-08-17T02:25:56.029964+0000","last_fullsized":"2024-08-17T02:25:56.029964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:54.730677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.048379+0000","last_change":"2024-08-17T02:25:55.001847+0000","last_active":"2024-08-17T02:25:56.048379+0000","last_peered":"2024-08-17T02:25:56.048379+0000","last_clean":"2024-08-17T02:25:56.048379+0000","last_became_active":"2024-08-17T02:25:55.001518+0000","last_became_peered":"2024-08-17T02:25:55.001518+0000","last_unstale":"2024-08-17T02:25:56.048379+0000","last_undegraded":"2024-08-17T02:25:56.048379+0000","last_fullsized":"2024-08-17T02:25:56.048379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:14.842533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":811008,"data_stored":664727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":75341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":73879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":225280,"data_stored":73915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":75341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":212992,"data_stored":73789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":221184,"data_stored":73949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298164,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073676,"statfs":{"total":96636764160,"available":96331444224,"internally_reserved":0,"allocated":819200,"data_stored":664783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:05.785 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:05.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.885+0000 7f3d22dc4700 1 Processor -- start 2024-08-17T02:26:05.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.885+0000 7f3d22dc4700 1 -- start start 2024-08-17T02:26:05.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.885+0000 7f3d22dc4700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3d1c0b0350 0x7f3d1c0ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.885+0000 7f3d22dc4700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d1c0af2b0 con 0x7f3d1c06df10 2024-08-17T02:26:05.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.885+0000 7f3d22dc4700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d1c0af590 con 0x7f3d1c155d20 2024-08-17T02:26:05.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.885+0000 7f3d22dc4700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1c0b07a0 con 0x7f3d1c0b0350 2024-08-17T02:26:05.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.885+0000 7f3d225c3700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f3d1c06df10 0x7f3d1c06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57580/0 (socket says 172.21.15.102:57580) 2024-08-17T02:26:05.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.885+0000 7f3d225c3700 1 -- 172.21.15.102:0/524535120 learned_addr learned my addr 172.21.15.102:0/524535120 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:05.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.885+0000 7f3d215c1700 1 --2- 172.21.15.102:0/524535120 >> v2:172.21.15.121:3300/0 conn(0x7f3d1c0b0350 0x7f3d1c0ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.885+0000 7f3d20dc0700 1 -- 172.21.15.102:0/524535120 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406908034 0 0) 0x7f3d1c0af2b0 con 0x7f3d1c06df10 2024-08-17T02:26:05.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.885+0000 7f3d20dc0700 1 -- 172.21.15.102:0/524535120 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d08003570 con 0x7f3d1c06df10 2024-08-17T02:26:05.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.885+0000 7f3d215c1700 1 -- 172.21.15.102:0/524535120 >> v1:172.21.15.121:6789/0 conn(0x7f3d1c155d20 legacy=0x7f3d1c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.885+0000 7f3d215c1700 1 -- 172.21.15.102:0/524535120 >> v1:172.21.15.102:6789/0 conn(0x7f3d1c06df10 legacy=0x7f3d1c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.885+0000 7f3d215c1700 1 -- 172.21.15.102:0/524535120 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c0af870 con 0x7f3d1c0b0350 2024-08-17T02:26:05.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.885+0000 7f3d215c1700 1 --2- 172.21.15.102:0/524535120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c0b0350 0x7f3d1c0ad7c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3d100098e0 tx=0x7f3d100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37acd8470aa395ee server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.885+0000 7f3d20dc0700 1 -- 172.21.15.102:0/524535120 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1000f6b0 con 0x7f3d1c0b0350 2024-08-17T02:26:05.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d20dc0700 1 -- 172.21.15.102:0/524535120 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1000f810 con 0x7f3d1c0b0350 2024-08-17T02:26:05.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d20dc0700 1 -- 172.21.15.102:0/524535120 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1000fbb0 con 0x7f3d1c0b0350 2024-08-17T02:26:05.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d22dc4700 1 -- 172.21.15.102:0/524535120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c0b0350 msgr2=0x7f3d1c0ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d22dc4700 1 --2- 172.21.15.102:0/524535120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c0b0350 0x7f3d1c0ad7c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3d100098e0 tx=0x7f3d100091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d22dc4700 1 -- 172.21.15.102:0/524535120 shutdown_connections 2024-08-17T02:26:05.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d22dc4700 1 --2- 172.21.15.102:0/524535120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c0b0350 0x7f3d1c0ad7c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d22dc4700 1 -- 172.21.15.102:0/524535120 >> 172.21.15.102:0/524535120 conn(0x7f3d1c0678d0 msgr2=0x7f3d1c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d22dc4700 1 -- 172.21.15.102:0/524535120 shutdown_connections 2024-08-17T02:26:05.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d22dc4700 1 -- 172.21.15.102:0/524535120 wait complete. 2024-08-17T02:26:05.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d22dc4700 1 Processor -- start 2024-08-17T02:26:05.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d22dc4700 1 -- start start 2024-08-17T02:26:05.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d22dc4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d1c06df10 0x7f3d1c145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d22dc4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d1c0b0350 0x7f3d1c1497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d22dc4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c155d20 0x7f3d1c154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d22dc4700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c14df30 con 0x7f3d1c0b0350 2024-08-17T02:26:05.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d22dc4700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c14d320 con 0x7f3d1c155d20 2024-08-17T02:26:05.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d22dc4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c14d600 con 0x7f3d1c06df10 2024-08-17T02:26:05.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d215c1700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d1c0b0350 0x7f3d1c1497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d215c1700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d1c0b0350 0x7f3d1c1497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44414/0 (socket says 172.21.15.102:44414) 2024-08-17T02:26:05.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d215c1700 1 -- 172.21.15.102:0/3279940319 learned_addr learned my addr 172.21.15.102:0/3279940319 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:05.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d225c3700 1 --2- 172.21.15.102:0/3279940319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c155d20 0x7f3d1c154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d21dc2700 1 --2- 172.21.15.102:0/3279940319 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d1c06df10 0x7f3d1c145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d215c1700 1 -- 172.21.15.102:0/3279940319 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d1c06df10 msgr2=0x7f3d1c145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d215c1700 1 --2- 172.21.15.102:0/3279940319 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d1c06df10 0x7f3d1c145810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d215c1700 1 -- 172.21.15.102:0/3279940319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c155d20 msgr2=0x7f3d1c154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d215c1700 1 --2- 172.21.15.102:0/3279940319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c155d20 0x7f3d1c154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d215c1700 1 -- 172.21.15.102:0/3279940319 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d10009420 con 0x7f3d1c0b0350 2024-08-17T02:26:05.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.889+0000 7f3d215c1700 1 --2- 172.21.15.102:0/3279940319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d1c0b0350 0x7f3d1c1497e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3d100093f0 tx=0x7f3d10019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.893+0000 7f3d0dffb700 1 -- 172.21.15.102:0/3279940319 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1001f070 con 0x7f3d1c0b0350 2024-08-17T02:26:05.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.893+0000 7f3d0dffb700 1 -- 172.21.15.102:0/3279940319 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1000f980 con 0x7f3d1c0b0350 2024-08-17T02:26:05.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.893+0000 7f3d22dc4700 1 -- 172.21.15.102:0/3279940319 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1c14d8e0 con 0x7f3d1c0b0350 2024-08-17T02:26:05.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.893+0000 7f3d0dffb700 1 -- 172.21.15.102:0/3279940319 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10010470 con 0x7f3d1c0b0350 2024-08-17T02:26:05.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.893+0000 7f3d22dc4700 1 -- 172.21.15.102:0/3279940319 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1c145d50 con 0x7f3d1c0b0350 2024-08-17T02:26:05.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.893+0000 7f3d22dc4700 1 -- 172.21.15.102:0/3279940319 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1c14e0a0 con 0x7f3d1c0b0350 2024-08-17T02:26:05.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.893+0000 7f3d0dffb700 1 -- 172.21.15.102:0/3279940319 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3d10023070 con 0x7f3d1c0b0350 2024-08-17T02:26:05.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.893+0000 7f3d0dffb700 1 --2- 172.21.15.102:0/3279940319 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3d00060860 0x7f3d00062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.893+0000 7f3d21dc2700 1 --2- 172.21.15.102:0/3279940319 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3d00060860 0x7f3d00062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.893+0000 7f3d0dffb700 1 -- 172.21.15.102:0/3279940319 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d10014070 con 0x7f3d1c0b0350 2024-08-17T02:26:05.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.893+0000 7f3d21dc2700 1 --2- 172.21.15.102:0/3279940319 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3d00060860 0x7f3d00062d10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3d180037c0 tx=0x7f3d18009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:05.901+0000 7f3d0dffb700 1 -- 172.21.15.102:0/3279940319 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3d10050480 con 0x7f3d1c0b0350 2024-08-17T02:26:06.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.049+0000 7f3d22dc4700 1 -- 172.21.15.102:0/3279940319 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d1c0643a0 con 0x7f3d00060860 2024-08-17T02:26:06.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.053+0000 7f3d0dffb700 1 -- 172.21.15.102:0/3279940319 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264380 (secure 0 0 0) 0x7f3d1c0643a0 con 0x7f3d00060860 2024-08-17T02:26:06.060 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:06.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.057+0000 7f3d22dc4700 1 -- 172.21.15.102:0/3279940319 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3d00060860 msgr2=0x7f3d00062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.057+0000 7f3d22dc4700 1 --2- 172.21.15.102:0/3279940319 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3d00060860 0x7f3d00062d10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3d180037c0 tx=0x7f3d18009040 comp rx=0 tx=0).stop 2024-08-17T02:26:06.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.057+0000 7f3d22dc4700 1 -- 172.21.15.102:0/3279940319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d1c0b0350 msgr2=0x7f3d1c1497e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.057+0000 7f3d22dc4700 1 --2- 172.21.15.102:0/3279940319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d1c0b0350 0x7f3d1c1497e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3d100093f0 tx=0x7f3d10019000 comp rx=0 tx=0).stop 2024-08-17T02:26:06.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.061+0000 7f3d22dc4700 1 -- 172.21.15.102:0/3279940319 shutdown_connections 2024-08-17T02:26:06.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.061+0000 7f3d22dc4700 1 --2- 172.21.15.102:0/3279940319 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3d00060860 0x7f3d00062d10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.061+0000 7f3d22dc4700 1 --2- 172.21.15.102:0/3279940319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d1c0b0350 0x7f3d1c1497e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.061+0000 7f3d22dc4700 1 --2- 172.21.15.102:0/3279940319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d1c155d20 0x7f3d1c154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.061+0000 7f3d22dc4700 1 --2- 172.21.15.102:0/3279940319 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d1c06df10 0x7f3d1c145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.061+0000 7f3d22dc4700 1 -- 172.21.15.102:0/3279940319 >> 172.21.15.102:0/3279940319 conn(0x7f3d1c0678d0 msgr2=0x7f3d1c068f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.061+0000 7f3d22dc4700 1 -- 172.21.15.102:0/3279940319 shutdown_connections 2024-08-17T02:26:06.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.061+0000 7f3d22dc4700 1 -- 172.21.15.102:0/3279940319 wait complete. 2024-08-17T02:26:06.064 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-08-17T02:26:06.074 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-17T02:26:05.179272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381768,"kb_used_data":2888,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592952,"statfs":{"total":773094113280,"available":770655182848,"internally_reserved":0,"allocated":2957312,"data_stored":1775724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.174838"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047525+0000","last_change":"2024-08-17T02:25:56.041834+0000","last_active":"2024-08-17T02:25:56.047525+0000","last_peered":"2024-08-17T02:25:56.047525+0000","last_clean":"2024-08-17T02:25:56.047525+0000","last_became_active":"2024-08-17T02:25:56.041161+0000","last_became_peered":"2024-08-17T02:25:56.041161+0000","last_unstale":"2024-08-17T02:25:56.047525+0000","last_undegraded":"2024-08-17T02:25:56.047525+0000","last_fullsized":"2024-08-17T02:25:56.047525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:31.069744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.037667+0000","last_change":"2024-08-17T02:25:56.031048+0000","last_active":"2024-08-17T02:25:56.037667+0000","last_peered":"2024-08-17T02:25:56.037667+0000","last_clean":"2024-08-17T02:25:56.037667+0000","last_became_active":"2024-08-17T02:25:56.030544+0000","last_became_peered":"2024-08-17T02:25:56.030544+0000","last_unstale":"2024-08-17T02:25:56.037667+0000","last_undegraded":"2024-08-17T02:25:56.037667+0000","last_fullsized":"2024-08-17T02:25:56.037667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:36.323034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.027320+0000","last_change":"2024-08-17T02:25:56.018521+0000","last_active":"2024-08-17T02:25:56.027320+0000","last_peered":"2024-08-17T02:25:56.027320+0000","last_clean":"2024-08-17T02:25:56.027320+0000","last_became_active":"2024-08-17T02:25:56.018150+0000","last_became_peered":"2024-08-17T02:25:56.018150+0000","last_unstale":"2024-08-17T02:25:56.027320+0000","last_undegraded":"2024-08-17T02:25:56.027320+0000","last_fullsized":"2024-08-17T02:25:56.027320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:15.442494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.037757+0000","last_change":"2024-08-17T02:25:56.028099+0000","last_active":"2024-08-17T02:25:56.037757+0000","last_peered":"2024-08-17T02:25:56.037757+0000","last_clean":"2024-08-17T02:25:56.037757+0000","last_became_active":"2024-08-17T02:25:56.027809+0000","last_became_peered":"2024-08-17T02:25:56.027809+0000","last_unstale":"2024-08-17T02:25:56.037757+0000","last_undegraded":"2024-08-17T02:25:56.037757+0000","last_fullsized":"2024-08-17T02:25:56.037757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:29.722508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047567+0000","last_change":"2024-08-17T02:25:56.041835+0000","last_active":"2024-08-17T02:25:56.047567+0000","last_peered":"2024-08-17T02:25:56.047567+0000","last_clean":"2024-08-17T02:25:56.047567+0000","last_became_active":"2024-08-17T02:25:56.040175+0000","last_became_peered":"2024-08-17T02:25:56.040175+0000","last_unstale":"2024-08-17T02:25:56.047567+0000","last_undegraded":"2024-08-17T02:25:56.047567+0000","last_fullsized":"2024-08-17T02:25:56.047567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:52.232984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041089+0000","last_change":"2024-08-17T02:25:56.036640+0000","last_active":"2024-08-17T02:25:56.041089+0000","last_peered":"2024-08-17T02:25:56.041089+0000","last_clean":"2024-08-17T02:25:56.041089+0000","last_became_active":"2024-08-17T02:25:56.035988+0000","last_became_peered":"2024-08-17T02:25:56.035988+0000","last_unstale":"2024-08-17T02:25:56.041089+0000","last_undegraded":"2024-08-17T02:25:56.041089+0000","last_fullsized":"2024-08-17T02:25:56.041089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:41:51.489903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.040700+0000","last_change":"2024-08-17T02:25:56.018767+0000","last_active":"2024-08-17T02:25:56.040700+0000","last_peered":"2024-08-17T02:25:56.040700+0000","last_clean":"2024-08-17T02:25:56.040700+0000","last_became_active":"2024-08-17T02:25:56.018454+0000","last_became_peered":"2024-08-17T02:25:56.018454+0000","last_unstale":"2024-08-17T02:25:56.040700+0000","last_undegraded":"2024-08-17T02:25:56.040700+0000","last_fullsized":"2024-08-17T02:25:56.040700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:24.040734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041569+0000","last_change":"2024-08-17T02:25:56.036004+0000","last_active":"2024-08-17T02:25:56.041569+0000","last_peered":"2024-08-17T02:25:56.041569+0000","last_clean":"2024-08-17T02:25:56.041569+0000","last_became_active":"2024-08-17T02:25:56.035748+0000","last_became_peered":"2024-08-17T02:25:56.035748+0000","last_unstale":"2024-08-17T02:25:56.041569+0000","last_undegraded":"2024-08-17T02:25:56.041569+0000","last_fullsized":"2024-08-17T02:25:56.041569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:24.560363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047491+0000","last_change":"2024-08-17T02:25:56.041696+0000","last_active":"2024-08-17T02:25:56.047491+0000","last_peered":"2024-08-17T02:25:56.047491+0000","last_clean":"2024-08-17T02:25:56.047491+0000","last_became_active":"2024-08-17T02:25:56.040480+0000","last_became_peered":"2024-08-17T02:25:56.040480+0000","last_unstale":"2024-08-17T02:25:56.047491+0000","last_undegraded":"2024-08-17T02:25:56.047491+0000","last_fullsized":"2024-08-17T02:25:56.047491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:17.900093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044205+0000","last_change":"2024-08-17T02:25:56.036179+0000","last_active":"2024-08-17T02:25:56.044205+0000","last_peered":"2024-08-17T02:25:56.044205+0000","last_clean":"2024-08-17T02:25:56.044205+0000","last_became_active":"2024-08-17T02:25:56.035909+0000","last_became_peered":"2024-08-17T02:25:56.035909+0000","last_unstale":"2024-08-17T02:25:56.044205+0000","last_undegraded":"2024-08-17T02:25:56.044205+0000","last_fullsized":"2024-08-17T02:25:56.044205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:32.738921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.034210+0000","last_change":"2024-08-17T02:25:56.027962+0000","last_active":"2024-08-17T02:25:56.034210+0000","last_peered":"2024-08-17T02:25:56.034210+0000","last_clean":"2024-08-17T02:25:56.034210+0000","last_became_active":"2024-08-17T02:25:56.027599+0000","last_became_peered":"2024-08-17T02:25:56.027599+0000","last_unstale":"2024-08-17T02:25:56.034210+0000","last_undegraded":"2024-08-17T02:25:56.034210+0000","last_fullsized":"2024-08-17T02:25:56.034210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:40.638494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.031526+0000","last_change":"2024-08-17T02:25:56.022137+0000","last_active":"2024-08-17T02:25:56.031526+0000","last_peered":"2024-08-17T02:25:56.031526+0000","last_clean":"2024-08-17T02:25:56.031526+0000","last_became_active":"2024-08-17T02:25:56.018606+0000","last_became_peered":"2024-08-17T02:25:56.018606+0000","last_unstale":"2024-08-17T02:25:56.031526+0000","last_undegraded":"2024-08-17T02:25:56.031526+0000","last_fullsized":"2024-08-17T02:25:56.031526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:24.083566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.029816+0000","last_change":"2024-08-17T02:25:56.026153+0000","last_active":"2024-08-17T02:25:56.029816+0000","last_peered":"2024-08-17T02:25:56.029816+0000","last_clean":"2024-08-17T02:25:56.029816+0000","last_became_active":"2024-08-17T02:25:56.025787+0000","last_became_peered":"2024-08-17T02:25:56.025787+0000","last_unstale":"2024-08-17T02:25:56.029816+0000","last_undegraded":"2024-08-17T02:25:56.029816+0000","last_fullsized":"2024-08-17T02:25:56.029816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:25.457349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.032456+0000","last_change":"2024-08-17T02:25:56.028794+0000","last_active":"2024-08-17T02:25:56.032456+0000","last_peered":"2024-08-17T02:25:56.032456+0000","last_clean":"2024-08-17T02:25:56.032456+0000","last_became_active":"2024-08-17T02:25:56.028458+0000","last_became_peered":"2024-08-17T02:25:56.028458+0000","last_unstale":"2024-08-17T02:25:56.032456+0000","last_undegraded":"2024-08-17T02:25:56.032456+0000","last_fullsized":"2024-08-17T02:25:56.032456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:55.320971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041117+0000","last_change":"2024-08-17T02:25:56.036545+0000","last_active":"2024-08-17T02:25:56.041117+0000","last_peered":"2024-08-17T02:25:56.041117+0000","last_clean":"2024-08-17T02:25:56.041117+0000","last_became_active":"2024-08-17T02:25:56.036266+0000","last_became_peered":"2024-08-17T02:25:56.036266+0000","last_unstale":"2024-08-17T02:25:56.041117+0000","last_undegraded":"2024-08-17T02:25:56.041117+0000","last_fullsized":"2024-08-17T02:25:56.041117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:58.197912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.034417+0000","last_change":"2024-08-17T02:25:56.024271+0000","last_active":"2024-08-17T02:25:56.034417+0000","last_peered":"2024-08-17T02:25:56.034417+0000","last_clean":"2024-08-17T02:25:56.034417+0000","last_became_active":"2024-08-17T02:25:56.023779+0000","last_became_peered":"2024-08-17T02:25:56.023779+0000","last_unstale":"2024-08-17T02:25:56.034417+0000","last_undegraded":"2024-08-17T02:25:56.034417+0000","last_fullsized":"2024-08-17T02:25:56.034417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:08:39.924999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.050174+0000","last_change":"2024-08-17T02:25:56.045776+0000","last_active":"2024-08-17T02:25:56.050174+0000","last_peered":"2024-08-17T02:25:56.050174+0000","last_clean":"2024-08-17T02:25:56.050174+0000","last_became_active":"2024-08-17T02:25:56.045509+0000","last_became_peered":"2024-08-17T02:25:56.045509+0000","last_unstale":"2024-08-17T02:25:56.050174+0000","last_undegraded":"2024-08-17T02:25:56.050174+0000","last_fullsized":"2024-08-17T02:25:56.050174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:40:59.671251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.031740+0000","last_change":"2024-08-17T02:25:56.024593+0000","last_active":"2024-08-17T02:25:56.031740+0000","last_peered":"2024-08-17T02:25:56.031740+0000","last_clean":"2024-08-17T02:25:56.031740+0000","last_became_active":"2024-08-17T02:25:56.024239+0000","last_became_peered":"2024-08-17T02:25:56.024239+0000","last_unstale":"2024-08-17T02:25:56.031740+0000","last_undegraded":"2024-08-17T02:25:56.031740+0000","last_fullsized":"2024-08-17T02:25:56.031740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:15.239096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047506+0000","last_change":"2024-08-17T02:25:56.041808+0000","last_active":"2024-08-17T02:25:56.047506+0000","last_peered":"2024-08-17T02:25:56.047506+0000","last_clean":"2024-08-17T02:25:56.047506+0000","last_became_active":"2024-08-17T02:25:56.040916+0000","last_became_peered":"2024-08-17T02:25:56.040916+0000","last_unstale":"2024-08-17T02:25:56.047506+0000","last_undegraded":"2024-08-17T02:25:56.047506+0000","last_fullsized":"2024-08-17T02:25:56.047506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:57.018682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.027498+0000","last_change":"2024-08-17T02:25:56.023215+0000","last_active":"2024-08-17T02:25:56.027498+0000","last_peered":"2024-08-17T02:25:56.027498+0000","last_clean":"2024-08-17T02:25:56.027498+0000","last_became_active":"2024-08-17T02:25:56.022935+0000","last_became_peered":"2024-08-17T02:25:56.022935+0000","last_unstale":"2024-08-17T02:25:56.027498+0000","last_undegraded":"2024-08-17T02:25:56.027498+0000","last_fullsized":"2024-08-17T02:25:56.027498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:24.560363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041377+0000","last_change":"2024-08-17T02:25:56.036032+0000","last_active":"2024-08-17T02:25:56.041377+0000","last_peered":"2024-08-17T02:25:56.041377+0000","last_clean":"2024-08-17T02:25:56.041377+0000","last_became_active":"2024-08-17T02:25:56.035200+0000","last_became_peered":"2024-08-17T02:25:56.035200+0000","last_unstale":"2024-08-17T02:25:56.041377+0000","last_undegraded":"2024-08-17T02:25:56.041377+0000","last_fullsized":"2024-08-17T02:25:56.041377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:40.638494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047292+0000","last_change":"2024-08-17T02:25:56.043121+0000","last_active":"2024-08-17T02:25:56.047292+0000","last_peered":"2024-08-17T02:25:56.047292+0000","last_clean":"2024-08-17T02:25:56.047292+0000","last_became_active":"2024-08-17T02:25:56.042862+0000","last_became_peered":"2024-08-17T02:25:56.042862+0000","last_unstale":"2024-08-17T02:25:56.047292+0000","last_undegraded":"2024-08-17T02:25:56.047292+0000","last_fullsized":"2024-08-17T02:25:56.047292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:10.710311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.024108+0000","last_change":"2024-08-17T02:25:56.021487+0000","last_active":"2024-08-17T02:25:56.024108+0000","last_peered":"2024-08-17T02:25:56.024108+0000","last_clean":"2024-08-17T02:25:56.024108+0000","last_became_active":"2024-08-17T02:25:56.020379+0000","last_became_peered":"2024-08-17T02:25:56.020379+0000","last_unstale":"2024-08-17T02:25:56.024108+0000","last_undegraded":"2024-08-17T02:25:56.024108+0000","last_fullsized":"2024-08-17T02:25:56.024108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:55.237015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.035235+0000","last_change":"2024-08-17T02:25:56.025828+0000","last_active":"2024-08-17T02:25:56.035235+0000","last_peered":"2024-08-17T02:25:56.035235+0000","last_clean":"2024-08-17T02:25:56.035235+0000","last_became_active":"2024-08-17T02:25:56.025558+0000","last_became_peered":"2024-08-17T02:25:56.025558+0000","last_unstale":"2024-08-17T02:25:56.035235+0000","last_undegraded":"2024-08-17T02:25:56.035235+0000","last_fullsized":"2024-08-17T02:25:56.035235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:33:14.351722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041414+0000","last_change":"2024-08-17T02:25:56.032974+0000","last_active":"2024-08-17T02:25:56.041414+0000","last_peered":"2024-08-17T02:25:56.041414+0000","last_clean":"2024-08-17T02:25:56.041414+0000","last_became_active":"2024-08-17T02:25:56.032693+0000","last_became_peered":"2024-08-17T02:25:56.032693+0000","last_unstale":"2024-08-17T02:25:56.041414+0000","last_undegraded":"2024-08-17T02:25:56.041414+0000","last_fullsized":"2024-08-17T02:25:56.041414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:39.511023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047076+0000","last_change":"2024-08-17T02:25:56.042862+0000","last_active":"2024-08-17T02:25:56.047076+0000","last_peered":"2024-08-17T02:25:56.047076+0000","last_clean":"2024-08-17T02:25:56.047076+0000","last_became_active":"2024-08-17T02:25:56.042507+0000","last_became_peered":"2024-08-17T02:25:56.042507+0000","last_unstale":"2024-08-17T02:25:56.047076+0000","last_undegraded":"2024-08-17T02:25:56.047076+0000","last_fullsized":"2024-08-17T02:25:56.047076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:09.506321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.037837+0000","last_change":"2024-08-17T02:25:56.031020+0000","last_active":"2024-08-17T02:25:56.037837+0000","last_peered":"2024-08-17T02:25:56.037837+0000","last_clean":"2024-08-17T02:25:56.037837+0000","last_became_active":"2024-08-17T02:25:56.030750+0000","last_became_peered":"2024-08-17T02:25:56.030750+0000","last_unstale":"2024-08-17T02:25:56.037837+0000","last_undegraded":"2024-08-17T02:25:56.037837+0000","last_fullsized":"2024-08-17T02:25:56.037837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:57.681709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041753+0000","last_change":"2024-08-17T02:25:56.034831+0000","last_active":"2024-08-17T02:25:56.041753+0000","last_peered":"2024-08-17T02:25:56.041753+0000","last_clean":"2024-08-17T02:25:56.041753+0000","last_became_active":"2024-08-17T02:25:56.034550+0000","last_became_peered":"2024-08-17T02:25:56.034550+0000","last_unstale":"2024-08-17T02:25:56.041753+0000","last_undegraded":"2024-08-17T02:25:56.041753+0000","last_fullsized":"2024-08-17T02:25:56.041753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:55.320971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.030341+0000","last_change":"2024-08-17T02:25:56.025278+0000","last_active":"2024-08-17T02:25:56.030341+0000","last_peered":"2024-08-17T02:25:56.030341+0000","last_clean":"2024-08-17T02:25:56.030341+0000","last_became_active":"2024-08-17T02:25:56.023690+0000","last_became_peered":"2024-08-17T02:25:56.023690+0000","last_unstale":"2024-08-17T02:25:56.030341+0000","last_undegraded":"2024-08-17T02:25:56.030341+0000","last_fullsized":"2024-08-17T02:25:56.030341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:09.506321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.035834+0000","last_change":"2024-08-17T02:25:56.025247+0000","last_active":"2024-08-17T02:25:56.035834+0000","last_peered":"2024-08-17T02:25:56.035834+0000","last_clean":"2024-08-17T02:25:56.035834+0000","last_became_active":"2024-08-17T02:25:56.024908+0000","last_became_peered":"2024-08-17T02:25:56.024908+0000","last_unstale":"2024-08-17T02:25:56.035834+0000","last_undegraded":"2024-08-17T02:25:56.035834+0000","last_fullsized":"2024-08-17T02:25:56.035834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:42.383928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.031806+0000","last_change":"2024-08-17T02:25:56.025374+0000","last_active":"2024-08-17T02:25:56.031806+0000","last_peered":"2024-08-17T02:25:56.031806+0000","last_clean":"2024-08-17T02:25:56.031806+0000","last_became_active":"2024-08-17T02:25:56.025085+0000","last_became_peered":"2024-08-17T02:25:56.025085+0000","last_unstale":"2024-08-17T02:25:56.031806+0000","last_undegraded":"2024-08-17T02:25:56.031806+0000","last_fullsized":"2024-08-17T02:25:56.031806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:50:31.109301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.024776+0000","last_change":"2024-08-17T02:25:56.019936+0000","last_active":"2024-08-17T02:25:56.024776+0000","last_peered":"2024-08-17T02:25:56.024776+0000","last_clean":"2024-08-17T02:25:56.024776+0000","last_became_active":"2024-08-17T02:25:56.019534+0000","last_became_peered":"2024-08-17T02:25:56.019534+0000","last_unstale":"2024-08-17T02:25:56.024776+0000","last_undegraded":"2024-08-17T02:25:56.024776+0000","last_fullsized":"2024-08-17T02:25:56.024776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:15:55.320971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.034322+0000","last_change":"2024-08-17T02:25:56.027794+0000","last_active":"2024-08-17T02:25:56.034322+0000","last_peered":"2024-08-17T02:25:56.034322+0000","last_clean":"2024-08-17T02:25:56.034322+0000","last_became_active":"2024-08-17T02:25:56.026104+0000","last_became_peered":"2024-08-17T02:25:56.026104+0000","last_unstale":"2024-08-17T02:25:56.034322+0000","last_undegraded":"2024-08-17T02:25:56.034322+0000","last_fullsized":"2024-08-17T02:25:56.034322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:38.820190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.045256+0000","last_change":"2024-08-17T02:25:54.996735+0000","last_active":"2024-08-17T02:25:56.045256+0000","last_peered":"2024-08-17T02:25:56.045256+0000","last_clean":"2024-08-17T02:25:56.045256+0000","last_became_active":"2024-08-17T02:25:54.996446+0000","last_became_peered":"2024-08-17T02:25:54.996446+0000","last_unstale":"2024-08-17T02:25:56.045256+0000","last_undegraded":"2024-08-17T02:25:56.045256+0000","last_fullsized":"2024-08-17T02:25:56.045256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.027333+0000","last_change":"2024-08-17T02:25:56.019338+0000","last_active":"2024-08-17T02:25:56.027333+0000","last_peered":"2024-08-17T02:25:56.027333+0000","last_clean":"2024-08-17T02:25:56.027333+0000","last_became_active":"2024-08-17T02:25:56.018424+0000","last_became_peered":"2024-08-17T02:25:56.018424+0000","last_unstale":"2024-08-17T02:25:56.027333+0000","last_undegraded":"2024-08-17T02:25:56.027333+0000","last_fullsized":"2024-08-17T02:25:56.027333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:36:59.886094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.042638+0000","last_change":"2024-08-17T02:25:55.002905+0000","last_active":"2024-08-17T02:25:56.042638+0000","last_peered":"2024-08-17T02:25:56.042638+0000","last_clean":"2024-08-17T02:25:56.042638+0000","last_became_active":"2024-08-17T02:25:55.002626+0000","last_became_peered":"2024-08-17T02:25:55.002626+0000","last_unstale":"2024-08-17T02:25:56.042638+0000","last_undegraded":"2024-08-17T02:25:56.042638+0000","last_fullsized":"2024-08-17T02:25:56.042638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:00.101762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.012817+0000","last_change":"2024-08-17T02:25:55.002842+0000","last_active":"2024-08-17T02:25:56.012817+0000","last_peered":"2024-08-17T02:25:56.012817+0000","last_clean":"2024-08-17T02:25:56.012817+0000","last_became_active":"2024-08-17T02:25:55.002548+0000","last_became_peered":"2024-08-17T02:25:55.002548+0000","last_unstale":"2024-08-17T02:25:56.012817+0000","last_undegraded":"2024-08-17T02:25:56.012817+0000","last_fullsized":"2024-08-17T02:25:56.012817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:26.856354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.038777+0000","last_change":"2024-08-17T02:25:56.030862+0000","last_active":"2024-08-17T02:25:56.038777+0000","last_peered":"2024-08-17T02:25:56.038777+0000","last_clean":"2024-08-17T02:25:56.038777+0000","last_became_active":"2024-08-17T02:25:56.030561+0000","last_became_peered":"2024-08-17T02:25:56.030561+0000","last_unstale":"2024-08-17T02:25:56.038777+0000","last_undegraded":"2024-08-17T02:25:56.038777+0000","last_fullsized":"2024-08-17T02:25:56.038777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:36:59.886094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.021273+0000","last_change":"2024-08-17T02:25:54.995596+0000","last_active":"2024-08-17T02:25:56.021273+0000","last_peered":"2024-08-17T02:25:56.021273+0000","last_clean":"2024-08-17T02:25:56.021273+0000","last_became_active":"2024-08-17T02:25:54.994045+0000","last_became_peered":"2024-08-17T02:25:54.994045+0000","last_unstale":"2024-08-17T02:25:56.021273+0000","last_undegraded":"2024-08-17T02:25:56.021273+0000","last_fullsized":"2024-08-17T02:25:56.021273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:25:59.640731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.037529+0000","last_change":"2024-08-17T02:25:56.030467+0000","last_active":"2024-08-17T02:25:56.037529+0000","last_peered":"2024-08-17T02:25:56.037529+0000","last_clean":"2024-08-17T02:25:56.037529+0000","last_became_active":"2024-08-17T02:25:56.030177+0000","last_became_peered":"2024-08-17T02:25:56.030177+0000","last_unstale":"2024-08-17T02:25:56.037529+0000","last_undegraded":"2024-08-17T02:25:56.037529+0000","last_fullsized":"2024-08-17T02:25:56.037529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:14:23.828783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.014529+0000","last_change":"2024-08-17T02:25:55.006457+0000","last_active":"2024-08-17T02:25:56.014529+0000","last_peered":"2024-08-17T02:25:56.014529+0000","last_clean":"2024-08-17T02:25:56.014529+0000","last_became_active":"2024-08-17T02:25:55.006225+0000","last_became_peered":"2024-08-17T02:25:55.006225+0000","last_unstale":"2024-08-17T02:25:56.014529+0000","last_undegraded":"2024-08-17T02:25:56.014529+0000","last_fullsized":"2024-08-17T02:25:56.014529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:01.595885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047268+0000","last_change":"2024-08-17T02:25:56.043053+0000","last_active":"2024-08-17T02:25:56.047268+0000","last_peered":"2024-08-17T02:25:56.047268+0000","last_clean":"2024-08-17T02:25:56.047268+0000","last_became_active":"2024-08-17T02:25:56.042765+0000","last_became_peered":"2024-08-17T02:25:56.042765+0000","last_unstale":"2024-08-17T02:25:56.047268+0000","last_undegraded":"2024-08-17T02:25:56.047268+0000","last_fullsized":"2024-08-17T02:25:56.047268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:26:12.529793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.024646+0000","last_change":"2024-08-17T02:25:55.007141+0000","last_active":"2024-08-17T02:25:56.024646+0000","last_peered":"2024-08-17T02:25:56.024646+0000","last_clean":"2024-08-17T02:25:56.024646+0000","last_became_active":"2024-08-17T02:25:55.006847+0000","last_became_peered":"2024-08-17T02:25:55.006847+0000","last_unstale":"2024-08-17T02:25:56.024646+0000","last_undegraded":"2024-08-17T02:25:56.024646+0000","last_fullsized":"2024-08-17T02:25:56.024646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:12.268531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041448+0000","last_change":"2024-08-17T02:25:56.037131+0000","last_active":"2024-08-17T02:25:56.041448+0000","last_peered":"2024-08-17T02:25:56.041448+0000","last_clean":"2024-08-17T02:25:56.041448+0000","last_became_active":"2024-08-17T02:25:56.036703+0000","last_became_peered":"2024-08-17T02:25:56.036703+0000","last_unstale":"2024-08-17T02:25:56.041448+0000","last_undegraded":"2024-08-17T02:25:56.041448+0000","last_fullsized":"2024-08-17T02:25:56.041448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:24.560363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041671+0000","last_change":"2024-08-17T02:25:54.996735+0000","last_active":"2024-08-17T02:25:56.041671+0000","last_peered":"2024-08-17T02:25:56.041671+0000","last_clean":"2024-08-17T02:25:56.041671+0000","last_became_active":"2024-08-17T02:25:54.996462+0000","last_became_peered":"2024-08-17T02:25:54.996462+0000","last_unstale":"2024-08-17T02:25:56.041671+0000","last_undegraded":"2024-08-17T02:25:56.041671+0000","last_fullsized":"2024-08-17T02:25:56.041671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:21.048415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.027476+0000","last_change":"2024-08-17T02:25:56.019935+0000","last_active":"2024-08-17T02:25:56.027476+0000","last_peered":"2024-08-17T02:25:56.027476+0000","last_clean":"2024-08-17T02:25:56.027476+0000","last_became_active":"2024-08-17T02:25:56.019608+0000","last_became_peered":"2024-08-17T02:25:56.019608+0000","last_unstale":"2024-08-17T02:25:56.027476+0000","last_undegraded":"2024-08-17T02:25:56.027476+0000","last_fullsized":"2024-08-17T02:25:56.027476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:22.058035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047300+0000","last_change":"2024-08-17T02:25:55.001788+0000","last_active":"2024-08-17T02:25:56.047300+0000","last_peered":"2024-08-17T02:25:56.047300+0000","last_clean":"2024-08-17T02:25:56.047300+0000","last_became_active":"2024-08-17T02:25:55.001430+0000","last_became_peered":"2024-08-17T02:25:55.001430+0000","last_unstale":"2024-08-17T02:25:56.047300+0000","last_undegraded":"2024-08-17T02:25:56.047300+0000","last_fullsized":"2024-08-17T02:25:56.047300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:26.856354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047546+0000","last_change":"2024-08-17T02:25:56.041922+0000","last_active":"2024-08-17T02:25:56.047546+0000","last_peered":"2024-08-17T02:25:56.047546+0000","last_clean":"2024-08-17T02:25:56.047546+0000","last_became_active":"2024-08-17T02:25:56.041213+0000","last_became_peered":"2024-08-17T02:25:56.041213+0000","last_unstale":"2024-08-17T02:25:56.047546+0000","last_undegraded":"2024-08-17T02:25:56.047546+0000","last_fullsized":"2024-08-17T02:25:56.047546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:25.128217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044849+0000","last_change":"2024-08-17T02:25:54.997271+0000","last_active":"2024-08-17T02:25:56.044849+0000","last_peered":"2024-08-17T02:25:56.044849+0000","last_clean":"2024-08-17T02:25:56.044849+0000","last_became_active":"2024-08-17T02:25:54.996996+0000","last_became_peered":"2024-08-17T02:25:54.996996+0000","last_unstale":"2024-08-17T02:25:56.044849+0000","last_undegraded":"2024-08-17T02:25:56.044849+0000","last_fullsized":"2024-08-17T02:25:56.044849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:43.100997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.030027+0000","last_change":"2024-08-17T02:25:56.023022+0000","last_active":"2024-08-17T02:25:56.030027+0000","last_peered":"2024-08-17T02:25:56.030027+0000","last_clean":"2024-08-17T02:25:56.030027+0000","last_became_active":"2024-08-17T02:25:56.020092+0000","last_became_peered":"2024-08-17T02:25:56.020092+0000","last_unstale":"2024-08-17T02:25:56.030027+0000","last_undegraded":"2024-08-17T02:25:56.030027+0000","last_fullsized":"2024-08-17T02:25:56.030027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:08.877931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.023336+0000","last_change":"2024-08-17T02:25:55.000169+0000","last_active":"2024-08-17T02:25:56.023336+0000","last_peered":"2024-08-17T02:25:56.023336+0000","last_clean":"2024-08-17T02:25:56.023336+0000","last_became_active":"2024-08-17T02:25:54.999922+0000","last_became_peered":"2024-08-17T02:25:54.999922+0000","last_unstale":"2024-08-17T02:25:56.023336+0000","last_undegraded":"2024-08-17T02:25:56.023336+0000","last_fullsized":"2024-08-17T02:25:56.023336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:37.810570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047588+0000","last_change":"2024-08-17T02:25:56.042130+0000","last_active":"2024-08-17T02:25:56.047588+0000","last_peered":"2024-08-17T02:25:56.047588+0000","last_clean":"2024-08-17T02:25:56.047588+0000","last_became_active":"2024-08-17T02:25:56.040537+0000","last_became_peered":"2024-08-17T02:25:56.040537+0000","last_unstale":"2024-08-17T02:25:56.047588+0000","last_undegraded":"2024-08-17T02:25:56.047588+0000","last_fullsized":"2024-08-17T02:25:56.047588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:24.600349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.013500+0000","last_change":"2024-08-17T02:25:55.007014+0000","last_active":"2024-08-17T02:25:56.013500+0000","last_peered":"2024-08-17T02:25:56.013500+0000","last_clean":"2024-08-17T02:25:56.013500+0000","last_became_active":"2024-08-17T02:25:55.006703+0000","last_became_peered":"2024-08-17T02:25:55.006703+0000","last_unstale":"2024-08-17T02:25:56.013500+0000","last_undegraded":"2024-08-17T02:25:56.013500+0000","last_fullsized":"2024-08-17T02:25:56.013500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:20.748382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.024753+0000","last_change":"2024-08-17T02:25:56.019882+0000","last_active":"2024-08-17T02:25:56.024753+0000","last_peered":"2024-08-17T02:25:56.024753+0000","last_clean":"2024-08-17T02:25:56.024753+0000","last_became_active":"2024-08-17T02:25:56.019469+0000","last_became_peered":"2024-08-17T02:25:56.019469+0000","last_unstale":"2024-08-17T02:25:56.024753+0000","last_undegraded":"2024-08-17T02:25:56.024753+0000","last_fullsized":"2024-08-17T02:25:56.024753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:36:59.886094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.045053+0000","last_change":"2024-08-17T02:25:54.993917+0000","last_active":"2024-08-17T02:25:56.045053+0000","last_peered":"2024-08-17T02:25:56.045053+0000","last_clean":"2024-08-17T02:25:56.045053+0000","last_became_active":"2024-08-17T02:25:54.993586+0000","last_became_peered":"2024-08-17T02:25:54.993586+0000","last_unstale":"2024-08-17T02:25:56.045053+0000","last_undegraded":"2024-08-17T02:25:56.045053+0000","last_fullsized":"2024-08-17T02:25:56.045053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:00.101762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044680+0000","last_change":"2024-08-17T02:25:56.034676+0000","last_active":"2024-08-17T02:25:56.044680+0000","last_peered":"2024-08-17T02:25:56.044680+0000","last_clean":"2024-08-17T02:25:56.044680+0000","last_became_active":"2024-08-17T02:25:56.032428+0000","last_became_peered":"2024-08-17T02:25:56.032428+0000","last_unstale":"2024-08-17T02:25:56.044680+0000","last_undegraded":"2024-08-17T02:25:56.044680+0000","last_fullsized":"2024-08-17T02:25:56.044680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:15.142628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041743+0000","last_change":"2024-08-17T02:25:54.997719+0000","last_active":"2024-08-17T02:25:56.041743+0000","last_peered":"2024-08-17T02:25:56.041743+0000","last_clean":"2024-08-17T02:25:56.041743+0000","last_became_active":"2024-08-17T02:25:54.997406+0000","last_became_peered":"2024-08-17T02:25:54.997406+0000","last_unstale":"2024-08-17T02:25:56.041743+0000","last_undegraded":"2024-08-17T02:25:56.041743+0000","last_fullsized":"2024-08-17T02:25:56.041743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:13.181529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047459+0000","last_change":"2024-08-17T02:25:56.041646+0000","last_active":"2024-08-17T02:25:56.047459+0000","last_peered":"2024-08-17T02:25:56.047459+0000","last_clean":"2024-08-17T02:25:56.047459+0000","last_became_active":"2024-08-17T02:25:56.040446+0000","last_became_peered":"2024-08-17T02:25:56.040446+0000","last_unstale":"2024-08-17T02:25:56.047459+0000","last_undegraded":"2024-08-17T02:25:56.047459+0000","last_fullsized":"2024-08-17T02:25:56.047459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:08.877931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041865+0000","last_change":"2024-08-17T02:25:55.000628+0000","last_active":"2024-08-17T02:25:56.041865+0000","last_peered":"2024-08-17T02:25:56.041865+0000","last_clean":"2024-08-17T02:25:56.041865+0000","last_became_active":"2024-08-17T02:25:55.000178+0000","last_became_peered":"2024-08-17T02:25:55.000178+0000","last_unstale":"2024-08-17T02:25:56.041865+0000","last_undegraded":"2024-08-17T02:25:56.041865+0000","last_fullsized":"2024-08-17T02:25:56.041865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:40.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047416+0000","last_change":"2024-08-17T02:25:56.041357+0000","last_active":"2024-08-17T02:25:56.047416+0000","last_peered":"2024-08-17T02:25:56.047416+0000","last_clean":"2024-08-17T02:25:56.047416+0000","last_became_active":"2024-08-17T02:25:56.040452+0000","last_became_peered":"2024-08-17T02:25:56.040452+0000","last_unstale":"2024-08-17T02:25:56.047416+0000","last_undegraded":"2024-08-17T02:25:56.047416+0000","last_fullsized":"2024-08-17T02:25:56.047416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:58.712854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.043576+0000","last_change":"2024-08-17T02:25:54.993030+0000","last_active":"2024-08-17T02:25:56.043576+0000","last_peered":"2024-08-17T02:25:56.043576+0000","last_clean":"2024-08-17T02:25:56.043576+0000","last_became_active":"2024-08-17T02:25:54.992489+0000","last_became_peered":"2024-08-17T02:25:54.992489+0000","last_unstale":"2024-08-17T02:25:56.043576+0000","last_undegraded":"2024-08-17T02:25:56.043576+0000","last_fullsized":"2024-08-17T02:25:56.043576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:55.678872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.034464+0000","last_change":"2024-08-17T02:25:56.024775+0000","last_active":"2024-08-17T02:25:56.034464+0000","last_peered":"2024-08-17T02:25:56.034464+0000","last_clean":"2024-08-17T02:25:56.034464+0000","last_became_active":"2024-08-17T02:25:56.024421+0000","last_became_peered":"2024-08-17T02:25:56.024421+0000","last_unstale":"2024-08-17T02:25:56.034464+0000","last_undegraded":"2024-08-17T02:25:56.034464+0000","last_fullsized":"2024-08-17T02:25:56.034464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:45:06.291261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.013596+0000","last_change":"2024-08-17T02:25:54.997149+0000","last_active":"2024-08-17T02:25:56.013596+0000","last_peered":"2024-08-17T02:25:56.013596+0000","last_clean":"2024-08-17T02:25:56.013596+0000","last_became_active":"2024-08-17T02:25:54.996821+0000","last_became_peered":"2024-08-17T02:25:54.996821+0000","last_unstale":"2024-08-17T02:25:56.013596+0000","last_undegraded":"2024-08-17T02:25:56.013596+0000","last_fullsized":"2024-08-17T02:25:56.013596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:26.856354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.047478+0000","last_change":"2024-08-17T02:25:56.041666+0000","last_active":"2024-08-17T02:25:56.047478+0000","last_peered":"2024-08-17T02:25:56.047478+0000","last_clean":"2024-08-17T02:25:56.047478+0000","last_became_active":"2024-08-17T02:25:56.040381+0000","last_became_peered":"2024-08-17T02:25:56.040381+0000","last_unstale":"2024-08-17T02:25:56.047478+0000","last_undegraded":"2024-08-17T02:25:56.047478+0000","last_fullsized":"2024-08-17T02:25:56.047478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:04.282484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.014877+0000","last_change":"2024-08-17T02:25:51.241912+0000","last_active":"2024-08-17T02:25:56.014877+0000","last_peered":"2024-08-17T02:25:56.014877+0000","last_clean":"2024-08-17T02:25:56.014877+0000","last_became_active":"2024-08-17T02:25:51.239655+0000","last_became_peered":"2024-08-17T02:25:51.239655+0000","last_unstale":"2024-08-17T02:25:56.014877+0000","last_undegraded":"2024-08-17T02:25:56.014877+0000","last_fullsized":"2024-08-17T02:25:56.014877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_clean_scrub_stamp":"2024-08-17T02:25:49.863184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:53.845381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.020368+0000","last_change":"2024-08-17T02:25:54.995452+0000","last_active":"2024-08-17T02:25:56.020368+0000","last_peered":"2024-08-17T02:25:56.020368+0000","last_clean":"2024-08-17T02:25:56.020368+0000","last_became_active":"2024-08-17T02:25:54.994880+0000","last_became_peered":"2024-08-17T02:25:54.994880+0000","last_unstale":"2024-08-17T02:25:56.020368+0000","last_undegraded":"2024-08-17T02:25:56.020368+0000","last_fullsized":"2024-08-17T02:25:56.020368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:06.575204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044202+0000","last_change":"2024-08-17T02:25:56.037423+0000","last_active":"2024-08-17T02:25:56.044202+0000","last_peered":"2024-08-17T02:25:56.044202+0000","last_clean":"2024-08-17T02:25:56.044202+0000","last_became_active":"2024-08-17T02:25:56.037168+0000","last_became_peered":"2024-08-17T02:25:56.037168+0000","last_unstale":"2024-08-17T02:25:56.044202+0000","last_undegraded":"2024-08-17T02:25:56.044202+0000","last_fullsized":"2024-08-17T02:25:56.044202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:08.877931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.014785+0000","last_change":"2024-08-17T02:25:55.000498+0000","last_active":"2024-08-17T02:25:56.014785+0000","last_peered":"2024-08-17T02:25:56.014785+0000","last_clean":"2024-08-17T02:25:56.014785+0000","last_became_active":"2024-08-17T02:25:54.999897+0000","last_became_peered":"2024-08-17T02:25:54.999897+0000","last_unstale":"2024-08-17T02:25:56.014785+0000","last_undegraded":"2024-08-17T02:25:56.014785+0000","last_fullsized":"2024-08-17T02:25:56.014785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:50:30.099680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.017625+0000","last_change":"2024-08-17T02:25:56.014989+0000","last_active":"2024-08-17T02:25:56.017625+0000","last_peered":"2024-08-17T02:25:56.017625+0000","last_clean":"2024-08-17T02:25:56.017625+0000","last_became_active":"2024-08-17T02:25:56.014310+0000","last_became_peered":"2024-08-17T02:25:56.014310+0000","last_unstale":"2024-08-17T02:25:56.017625+0000","last_undegraded":"2024-08-17T02:25:56.017625+0000","last_fullsized":"2024-08-17T02:25:56.017625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:00:15.232217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.014797+0000","last_change":"2024-08-17T02:25:55.000861+0000","last_active":"2024-08-17T02:25:56.014797+0000","last_peered":"2024-08-17T02:25:56.014797+0000","last_clean":"2024-08-17T02:25:56.014797+0000","last_became_active":"2024-08-17T02:25:55.000232+0000","last_became_peered":"2024-08-17T02:25:55.000232+0000","last_unstale":"2024-08-17T02:25:56.014797+0000","last_undegraded":"2024-08-17T02:25:56.014797+0000","last_fullsized":"2024-08-17T02:25:56.014797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:20.748382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.035617+0000","last_change":"2024-08-17T02:25:56.028629+0000","last_active":"2024-08-17T02:25:56.035617+0000","last_peered":"2024-08-17T02:25:56.035617+0000","last_clean":"2024-08-17T02:25:56.035617+0000","last_became_active":"2024-08-17T02:25:56.028325+0000","last_became_peered":"2024-08-17T02:25:56.028325+0000","last_unstale":"2024-08-17T02:25:56.035617+0000","last_undegraded":"2024-08-17T02:25:56.035617+0000","last_fullsized":"2024-08-17T02:25:56.035617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:42:23.855343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.023915+0000","last_change":"2024-08-17T02:25:54.999649+0000","last_active":"2024-08-17T02:25:56.023915+0000","last_peered":"2024-08-17T02:25:56.023915+0000","last_clean":"2024-08-17T02:25:56.023915+0000","last_became_active":"2024-08-17T02:25:54.995798+0000","last_became_peered":"2024-08-17T02:25:54.995798+0000","last_unstale":"2024-08-17T02:25:56.023915+0000","last_undegraded":"2024-08-17T02:25:56.023915+0000","last_fullsized":"2024-08-17T02:25:56.023915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:39.955144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.025289+0000","last_change":"2024-08-17T02:25:56.019288+0000","last_active":"2024-08-17T02:25:56.025289+0000","last_peered":"2024-08-17T02:25:56.025289+0000","last_clean":"2024-08-17T02:25:56.025289+0000","last_became_active":"2024-08-17T02:25:56.018798+0000","last_became_peered":"2024-08-17T02:25:56.018798+0000","last_unstale":"2024-08-17T02:25:56.025289+0000","last_undegraded":"2024-08-17T02:25:56.025289+0000","last_fullsized":"2024-08-17T02:25:56.025289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:07.584824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.022945+0000","last_change":"2024-08-17T02:25:54.995600+0000","last_active":"2024-08-17T02:25:56.022945+0000","last_peered":"2024-08-17T02:25:56.022945+0000","last_clean":"2024-08-17T02:25:56.022945+0000","last_became_active":"2024-08-17T02:25:54.994117+0000","last_became_peered":"2024-08-17T02:25:54.994117+0000","last_unstale":"2024-08-17T02:25:56.022945+0000","last_undegraded":"2024-08-17T02:25:56.022945+0000","last_fullsized":"2024-08-17T02:25:56.022945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:12.268531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.037841+0000","last_change":"2024-08-17T02:25:56.029058+0000","last_active":"2024-08-17T02:25:56.037841+0000","last_peered":"2024-08-17T02:25:56.037841+0000","last_clean":"2024-08-17T02:25:56.037841+0000","last_became_active":"2024-08-17T02:25:56.028723+0000","last_became_peered":"2024-08-17T02:25:56.028723+0000","last_unstale":"2024-08-17T02:25:56.037841+0000","last_undegraded":"2024-08-17T02:25:56.037841+0000","last_fullsized":"2024-08-17T02:25:56.037841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:19:28.379133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.018098+0000","last_change":"2024-08-17T02:25:55.000605+0000","last_active":"2024-08-17T02:25:56.018098+0000","last_peered":"2024-08-17T02:25:56.018098+0000","last_clean":"2024-08-17T02:25:56.018098+0000","last_became_active":"2024-08-17T02:25:55.000291+0000","last_became_peered":"2024-08-17T02:25:55.000291+0000","last_unstale":"2024-08-17T02:25:56.018098+0000","last_undegraded":"2024-08-17T02:25:56.018098+0000","last_fullsized":"2024-08-17T02:25:56.018098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:04.186628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.032284+0000","last_change":"2024-08-17T02:25:56.027086+0000","last_active":"2024-08-17T02:25:56.032284+0000","last_peered":"2024-08-17T02:25:56.032284+0000","last_clean":"2024-08-17T02:25:56.032284+0000","last_became_active":"2024-08-17T02:25:56.026817+0000","last_became_peered":"2024-08-17T02:25:56.026817+0000","last_unstale":"2024-08-17T02:25:56.032284+0000","last_undegraded":"2024-08-17T02:25:56.032284+0000","last_fullsized":"2024-08-17T02:25:56.032284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:11.672911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:25:57.037358+0000","last_change":"2024-08-17T02:25:55.004265+0000","last_active":"2024-08-17T02:25:57.037358+0000","last_peered":"2024-08-17T02:25:57.037358+0000","last_clean":"2024-08-17T02:25:57.037358+0000","last_became_active":"2024-08-17T02:25:55.003943+0000","last_became_peered":"2024-08-17T02:25:55.003943+0000","last_unstale":"2024-08-17T02:25:57.037358+0000","last_undegraded":"2024-08-17T02:25:57.037358+0000","last_fullsized":"2024-08-17T02:25:57.037358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:25:37.810570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044597+0000","last_change":"2024-08-17T02:25:56.042831+0000","last_active":"2024-08-17T02:25:56.044597+0000","last_peered":"2024-08-17T02:25:56.044597+0000","last_clean":"2024-08-17T02:25:56.044597+0000","last_became_active":"2024-08-17T02:25:56.042634+0000","last_became_peered":"2024-08-17T02:25:56.042634+0000","last_unstale":"2024-08-17T02:25:56.044597+0000","last_undegraded":"2024-08-17T02:25:56.044597+0000","last_fullsized":"2024-08-17T02:25:56.044597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:32.738921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.045124+0000","last_change":"2024-08-17T02:25:55.001866+0000","last_active":"2024-08-17T02:25:56.045124+0000","last_peered":"2024-08-17T02:25:56.045124+0000","last_clean":"2024-08-17T02:25:56.045124+0000","last_became_active":"2024-08-17T02:25:55.001524+0000","last_became_peered":"2024-08-17T02:25:55.001524+0000","last_unstale":"2024-08-17T02:25:56.045124+0000","last_undegraded":"2024-08-17T02:25:56.045124+0000","last_fullsized":"2024-08-17T02:25:56.045124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:00:14.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.032472+0000","last_change":"2024-08-17T02:25:56.028887+0000","last_active":"2024-08-17T02:25:56.032472+0000","last_peered":"2024-08-17T02:25:56.032472+0000","last_clean":"2024-08-17T02:25:56.032472+0000","last_became_active":"2024-08-17T02:25:56.028557+0000","last_became_peered":"2024-08-17T02:25:56.028557+0000","last_unstale":"2024-08-17T02:25:56.032472+0000","last_undegraded":"2024-08-17T02:25:56.032472+0000","last_fullsized":"2024-08-17T02:25:56.032472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:39.367618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.014668+0000","last_change":"2024-08-17T02:25:55.000105+0000","last_active":"2024-08-17T02:25:56.014668+0000","last_peered":"2024-08-17T02:25:56.014668+0000","last_clean":"2024-08-17T02:25:56.014668+0000","last_became_active":"2024-08-17T02:25:54.999581+0000","last_became_peered":"2024-08-17T02:25:54.999581+0000","last_unstale":"2024-08-17T02:25:56.014668+0000","last_undegraded":"2024-08-17T02:25:56.014668+0000","last_fullsized":"2024-08-17T02:25:56.014668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:14.229475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.028105+0000","last_change":"2024-08-17T02:25:56.018046+0000","last_active":"2024-08-17T02:25:56.028105+0000","last_peered":"2024-08-17T02:25:56.028105+0000","last_clean":"2024-08-17T02:25:56.028105+0000","last_became_active":"2024-08-17T02:25:56.016770+0000","last_became_peered":"2024-08-17T02:25:56.016770+0000","last_unstale":"2024-08-17T02:25:56.028105+0000","last_undegraded":"2024-08-17T02:25:56.028105+0000","last_fullsized":"2024-08-17T02:25:56.028105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:56.688493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.023115+0000","last_change":"2024-08-17T02:25:54.999172+0000","last_active":"2024-08-17T02:25:56.023115+0000","last_peered":"2024-08-17T02:25:56.023115+0000","last_clean":"2024-08-17T02:25:56.023115+0000","last_became_active":"2024-08-17T02:25:54.998807+0000","last_became_peered":"2024-08-17T02:25:54.998807+0000","last_unstale":"2024-08-17T02:25:56.023115+0000","last_undegraded":"2024-08-17T02:25:56.023115+0000","last_fullsized":"2024-08-17T02:25:56.023115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:25:59.640731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.032555+0000","last_change":"2024-08-17T02:25:56.028861+0000","last_active":"2024-08-17T02:25:56.032555+0000","last_peered":"2024-08-17T02:25:56.032555+0000","last_clean":"2024-08-17T02:25:56.032555+0000","last_became_active":"2024-08-17T02:25:56.028556+0000","last_became_peered":"2024-08-17T02:25:56.028556+0000","last_unstale":"2024-08-17T02:25:56.032555+0000","last_undegraded":"2024-08-17T02:25:56.032555+0000","last_fullsized":"2024-08-17T02:25:56.032555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:15.442494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.023347+0000","last_change":"2024-08-17T02:25:54.997943+0000","last_active":"2024-08-17T02:25:56.023347+0000","last_peered":"2024-08-17T02:25:56.023347+0000","last_clean":"2024-08-17T02:25:56.023347+0000","last_became_active":"2024-08-17T02:25:54.997169+0000","last_became_peered":"2024-08-17T02:25:54.997169+0000","last_unstale":"2024-08-17T02:25:56.023347+0000","last_undegraded":"2024-08-17T02:25:56.023347+0000","last_fullsized":"2024-08-17T02:25:56.023347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:06.575204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.026482+0000","last_change":"2024-08-17T02:25:56.021687+0000","last_active":"2024-08-17T02:25:56.026482+0000","last_peered":"2024-08-17T02:25:56.026482+0000","last_clean":"2024-08-17T02:25:56.026482+0000","last_became_active":"2024-08-17T02:25:56.020957+0000","last_became_peered":"2024-08-17T02:25:56.020957+0000","last_unstale":"2024-08-17T02:25:56.026482+0000","last_undegraded":"2024-08-17T02:25:56.026482+0000","last_fullsized":"2024-08-17T02:25:56.026482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:40.638494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044872+0000","last_change":"2024-08-17T02:25:54.999914+0000","last_active":"2024-08-17T02:25:56.044872+0000","last_peered":"2024-08-17T02:25:56.044872+0000","last_clean":"2024-08-17T02:25:56.044872+0000","last_became_active":"2024-08-17T02:25:54.999660+0000","last_became_peered":"2024-08-17T02:25:54.999660+0000","last_unstale":"2024-08-17T02:25:56.044872+0000","last_undegraded":"2024-08-17T02:25:56.044872+0000","last_fullsized":"2024-08-17T02:25:56.044872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:00:14.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.027375+0000","last_change":"2024-08-17T02:25:56.023133+0000","last_active":"2024-08-17T02:25:56.027375+0000","last_peered":"2024-08-17T02:25:56.027375+0000","last_clean":"2024-08-17T02:25:56.027375+0000","last_became_active":"2024-08-17T02:25:56.022831+0000","last_became_peered":"2024-08-17T02:25:56.022831+0000","last_unstale":"2024-08-17T02:25:56.027375+0000","last_undegraded":"2024-08-17T02:25:56.027375+0000","last_fullsized":"2024-08-17T02:25:56.027375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:08.877931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041005+0000","last_change":"2024-08-17T02:25:56.037053+0000","last_active":"2024-08-17T02:25:56.041005+0000","last_peered":"2024-08-17T02:25:56.041005+0000","last_clean":"2024-08-17T02:25:56.041005+0000","last_became_active":"2024-08-17T02:25:56.034842+0000","last_became_peered":"2024-08-17T02:25:56.034842+0000","last_unstale":"2024-08-17T02:25:56.041005+0000","last_undegraded":"2024-08-17T02:25:56.041005+0000","last_fullsized":"2024-08-17T02:25:56.041005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:35.583197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044916+0000","last_change":"2024-08-17T02:25:55.001827+0000","last_active":"2024-08-17T02:25:56.044916+0000","last_peered":"2024-08-17T02:25:56.044916+0000","last_clean":"2024-08-17T02:25:56.044916+0000","last_became_active":"2024-08-17T02:25:55.001554+0000","last_became_peered":"2024-08-17T02:25:55.001554+0000","last_unstale":"2024-08-17T02:25:56.044916+0000","last_undegraded":"2024-08-17T02:25:56.044916+0000","last_fullsized":"2024-08-17T02:25:56.044916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:28.545139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.034569+0000","last_change":"2024-08-17T02:25:56.025255+0000","last_active":"2024-08-17T02:25:56.034569+0000","last_peered":"2024-08-17T02:25:56.034569+0000","last_clean":"2024-08-17T02:25:56.034569+0000","last_became_active":"2024-08-17T02:25:56.023945+0000","last_became_peered":"2024-08-17T02:25:56.023945+0000","last_unstale":"2024-08-17T02:25:56.034569+0000","last_undegraded":"2024-08-17T02:25:56.034569+0000","last_fullsized":"2024-08-17T02:25:56.034569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:57.681709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.044998+0000","last_change":"2024-08-17T02:25:55.003882+0000","last_active":"2024-08-17T02:25:56.044998+0000","last_peered":"2024-08-17T02:25:56.044998+0000","last_clean":"2024-08-17T02:25:56.044998+0000","last_became_active":"2024-08-17T02:25:55.003585+0000","last_became_peered":"2024-08-17T02:25:55.003585+0000","last_unstale":"2024-08-17T02:25:56.044998+0000","last_undegraded":"2024-08-17T02:25:56.044998+0000","last_fullsized":"2024-08-17T02:25:56.044998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:10.820465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041428+0000","last_change":"2024-08-17T02:25:56.036969+0000","last_active":"2024-08-17T02:25:56.041428+0000","last_peered":"2024-08-17T02:25:56.041428+0000","last_clean":"2024-08-17T02:25:56.041428+0000","last_became_active":"2024-08-17T02:25:56.036345+0000","last_became_peered":"2024-08-17T02:25:56.036345+0000","last_unstale":"2024-08-17T02:25:56.041428+0000","last_undegraded":"2024-08-17T02:25:56.041428+0000","last_fullsized":"2024-08-17T02:25:56.041428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:32.738921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.041631+0000","last_change":"2024-08-17T02:25:54.995388+0000","last_active":"2024-08-17T02:25:56.041631+0000","last_peered":"2024-08-17T02:25:56.041631+0000","last_clean":"2024-08-17T02:25:56.041631+0000","last_became_active":"2024-08-17T02:25:54.994967+0000","last_became_peered":"2024-08-17T02:25:54.994967+0000","last_unstale":"2024-08-17T02:25:56.041631+0000","last_undegraded":"2024-08-17T02:25:56.041631+0000","last_fullsized":"2024-08-17T02:25:56.041631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:14.842533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.029964+0000","last_change":"2024-08-17T02:25:56.026659+0000","last_active":"2024-08-17T02:25:56.029964+0000","last_peered":"2024-08-17T02:25:56.029964+0000","last_clean":"2024-08-17T02:25:56.029964+0000","last_became_active":"2024-08-17T02:25:56.026321+0000","last_became_peered":"2024-08-17T02:25:56.026321+0000","last_unstale":"2024-08-17T02:25:56.029964+0000","last_undegraded":"2024-08-17T02:25:56.029964+0000","last_fullsized":"2024-08-17T02:25:56.029964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:54.970742+0000","last_clean_scrub_stamp":"2024-08-17T02:25:54.970742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:54.730677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:56.048379+0000","last_change":"2024-08-17T02:25:55.001847+0000","last_active":"2024-08-17T02:25:56.048379+0000","last_peered":"2024-08-17T02:25:56.048379+0000","last_clean":"2024-08-17T02:25:56.048379+0000","last_became_active":"2024-08-17T02:25:55.001518+0000","last_became_peered":"2024-08-17T02:25:55.001518+0000","last_unstale":"2024-08-17T02:25:56.048379+0000","last_undegraded":"2024-08-17T02:25:56.048379+0000","last_fullsized":"2024-08-17T02:25:56.048379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:53.961121+0000","last_clean_scrub_stamp":"2024-08-17T02:25:53.961121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:51:14.842533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":811008,"data_stored":664727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":75341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":73879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":225280,"data_stored":73915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":75341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":212992,"data_stored":73789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":221184,"data_stored":73949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298164,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073676,"statfs":{"total":96636764160,"available":96331444224,"internally_reserved":0,"allocated":819200,"data_stored":664783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:06.078 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:26:06.078 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:26:06.078 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:26:06.079 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:26:06.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.173+0000 7f78aee4f700 1 Processor -- start 2024-08-17T02:26:06.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.173+0000 7f78aee4f700 1 -- start start 2024-08-17T02:26:06.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78aee4f700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f78a8155d20 0x7f78a80b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78aee4f700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a80af2b0 con 0x7f78a80ad7c0 2024-08-17T02:26:06.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78aee4f700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a80af590 con 0x7f78a806df10 2024-08-17T02:26:06.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78aee4f700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a80adc10 con 0x7f78a8155d20 2024-08-17T02:26:06.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78ad64c700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f78a80ad7c0 0x7f78a80aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57586/0 (socket says 172.21.15.102:57586) 2024-08-17T02:26:06.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78ad64c700 1 -- 172.21.15.102:0/726727848 learned_addr learned my addr 172.21.15.102:0/726727848 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:06.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78ade4d700 1 --2- 172.21.15.102:0/726727848 >> v2:172.21.15.102:3300/0 conn(0x7f78a8155d20 0x7f78a80b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78ace4b700 1 -- 172.21.15.102:0/726727848 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415107407 0 0) 0x7f78a80af2b0 con 0x7f78a80ad7c0 2024-08-17T02:26:06.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78ace4b700 1 -- 172.21.15.102:0/726727848 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7894003570 con 0x7f78a80ad7c0 2024-08-17T02:26:06.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78ade4d700 1 -- 172.21.15.102:0/726727848 >> v1:172.21.15.121:6789/0 conn(0x7f78a806df10 legacy=0x7f78a806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78ace4b700 1 -- 172.21.15.102:0/726727848 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3302924830 0 0) 0x7f7894003570 con 0x7f78a80ad7c0 2024-08-17T02:26:06.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78ade4d700 1 -- 172.21.15.102:0/726727848 >> v1:172.21.15.102:6789/0 conn(0x7f78a80ad7c0 legacy=0x7f78a80aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78ade4d700 1 -- 172.21.15.102:0/726727848 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80af870 con 0x7f78a8155d20 2024-08-17T02:26:06.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78ade4d700 1 --2- 172.21.15.102:0/726727848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78a8155d20 0x7f78a80b0350 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f78a40098e0 tx=0x7f78a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daeba28adc4d8e3a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78ace4b700 1 -- 172.21.15.102:0/726727848 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7898001470 con 0x7f78a8155d20 2024-08-17T02:26:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78ace4b700 1 -- 172.21.15.102:0/726727848 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a4011420 con 0x7f78a8155d20 2024-08-17T02:26:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78ace4b700 1 -- 172.21.15.102:0/726727848 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a40117c0 con 0x7f78a8155d20 2024-08-17T02:26:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78aee4f700 1 -- 172.21.15.102:0/726727848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78a8155d20 msgr2=0x7f78a80b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78aee4f700 1 --2- 172.21.15.102:0/726727848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78a8155d20 0x7f78a80b0350 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f78a40098e0 tx=0x7f78a40091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78aee4f700 1 -- 172.21.15.102:0/726727848 shutdown_connections 2024-08-17T02:26:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78aee4f700 1 --2- 172.21.15.102:0/726727848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78a8155d20 0x7f78a80b0350 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78aee4f700 1 -- 172.21.15.102:0/726727848 >> 172.21.15.102:0/726727848 conn(0x7f78a80678d0 msgr2=0x7f78a8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78aee4f700 1 -- 172.21.15.102:0/726727848 shutdown_connections 2024-08-17T02:26:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.177+0000 7f78aee4f700 1 -- 172.21.15.102:0/726727848 wait complete. 2024-08-17T02:26:06.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78aee4f700 1 Processor -- start 2024-08-17T02:26:06.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78aee4f700 1 -- start start 2024-08-17T02:26:06.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78aee4f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78a806df10 0x7f78a8148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78aee4f700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f78a80ad7c0 0x7f78a806a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78aee4f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78a8155d20 0x7f78a806a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78aee4f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a814f720 con 0x7f78a806df10 2024-08-17T02:26:06.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78aee4f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8166080 con 0x7f78a8155d20 2024-08-17T02:26:06.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78aee4f700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8165490 con 0x7f78a80ad7c0 2024-08-17T02:26:06.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78ade4d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78a806df10 0x7f78a8148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78ade4d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78a806df10 0x7f78a8148ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44434/0 (socket says 172.21.15.102:44434) 2024-08-17T02:26:06.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78ade4d700 1 -- 172.21.15.102:0/483038852 learned_addr learned my addr 172.21.15.102:0/483038852 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:06.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78ad64c700 1 --2- 172.21.15.102:0/483038852 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f78a80ad7c0 0x7f78a806a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78ae64e700 1 --2- 172.21.15.102:0/483038852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78a8155d20 0x7f78a806a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78ade4d700 1 -- 172.21.15.102:0/483038852 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f78a80ad7c0 msgr2=0x7f78a806a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78ade4d700 1 --2- 172.21.15.102:0/483038852 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f78a80ad7c0 0x7f78a806a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78ade4d700 1 -- 172.21.15.102:0/483038852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78a8155d20 msgr2=0x7f78a806a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78ade4d700 1 --2- 172.21.15.102:0/483038852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78a8155d20 0x7f78a806a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78ade4d700 1 -- 172.21.15.102:0/483038852 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a4009420 con 0x7f78a806df10 2024-08-17T02:26:06.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78ad64c700 1 --2- 172.21.15.102:0/483038852 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f78a80ad7c0 0x7f78a806a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:06.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.181+0000 7f78ae64e700 1 --2- 172.21.15.102:0/483038852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78a8155d20 0x7f78a806a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:06.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.185+0000 7f78ade4d700 1 --2- 172.21.15.102:0/483038852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78a806df10 0x7f78a8148ed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f78a40091e0 tx=0x7f78a4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.185+0000 7f789dffb700 1 -- 172.21.15.102:0/483038852 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a401cc90 con 0x7f78a806df10 2024-08-17T02:26:06.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.185+0000 7f789dffb700 1 -- 172.21.15.102:0/483038852 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a401cdf0 con 0x7f78a806df10 2024-08-17T02:26:06.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.185+0000 7f78aee4f700 1 -- 172.21.15.102:0/483038852 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a8165750 con 0x7f78a806df10 2024-08-17T02:26:06.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.185+0000 7f789dffb700 1 -- 172.21.15.102:0/483038852 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a401a6a0 con 0x7f78a806df10 2024-08-17T02:26:06.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.185+0000 7f78aee4f700 1 -- 172.21.15.102:0/483038852 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a8165d10 con 0x7f78a806df10 2024-08-17T02:26:06.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.185+0000 7f789dffb700 1 -- 172.21.15.102:0/483038852 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f78a401aa90 con 0x7f78a806df10 2024-08-17T02:26:06.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.185+0000 7f78aee4f700 1 -- 172.21.15.102:0/483038852 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a80643a0 con 0x7f78a806df10 2024-08-17T02:26:06.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.185+0000 7f789dffb700 1 --2- 172.21.15.102:0/483038852 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f788c060860 0x7f788c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.185+0000 7f78ad64c700 1 --2- 172.21.15.102:0/483038852 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f788c060860 0x7f788c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.185+0000 7f789dffb700 1 -- 172.21.15.102:0/483038852 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f78a407e550 con 0x7f78a806df10 2024-08-17T02:26:06.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.189+0000 7f78ad64c700 1 --2- 172.21.15.102:0/483038852 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f788c060860 0x7f788c062d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78a814e580 tx=0x7f7898009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.193+0000 7f789dffb700 1 -- 172.21.15.102:0/483038852 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f78a404e9a0 con 0x7f78a806df10 2024-08-17T02:26:06.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.385+0000 7f78aee4f700 1 -- 172.21.15.102:0/483038852 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f78a806f5f0 con 0x7f78a806df10 2024-08-17T02:26:06.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.385+0000 7f789dffb700 1 -- 172.21.15.102:0/483038852 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f78a4051fc0 con 0x7f78a806df10 2024-08-17T02:26:06.387 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:06.387 INFO:teuthology.orchestra.run.smithi102.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:26:06.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.385+0000 7f78aee4f700 1 -- 172.21.15.102:0/483038852 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f788c060860 msgr2=0x7f788c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.385+0000 7f78aee4f700 1 --2- 172.21.15.102:0/483038852 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f788c060860 0x7f788c062d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78a814e580 tx=0x7f7898009040 comp rx=0 tx=0).stop 2024-08-17T02:26:06.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.385+0000 7f78aee4f700 1 -- 172.21.15.102:0/483038852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78a806df10 msgr2=0x7f78a8148ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.385+0000 7f78aee4f700 1 --2- 172.21.15.102:0/483038852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78a806df10 0x7f78a8148ed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f78a40091e0 tx=0x7f78a4016000 comp rx=0 tx=0).stop 2024-08-17T02:26:06.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.385+0000 7f78aee4f700 1 -- 172.21.15.102:0/483038852 shutdown_connections 2024-08-17T02:26:06.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.385+0000 7f78aee4f700 1 --2- 172.21.15.102:0/483038852 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f788c060860 0x7f788c062d10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.385+0000 7f78aee4f700 1 --2- 172.21.15.102:0/483038852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78a8155d20 0x7f78a806a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.385+0000 7f78aee4f700 1 --2- 172.21.15.102:0/483038852 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f78a80ad7c0 0x7f78a806a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.385+0000 7f78aee4f700 1 --2- 172.21.15.102:0/483038852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78a806df10 0x7f78a8148ed0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.385+0000 7f78aee4f700 1 -- 172.21.15.102:0/483038852 >> 172.21.15.102:0/483038852 conn(0x7f78a80678d0 msgr2=0x7f78a80ae080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.385+0000 7f78aee4f700 1 -- 172.21.15.102:0/483038852 shutdown_connections 2024-08-17T02:26:06.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.385+0000 7f78aee4f700 1 -- 172.21.15.102:0/483038852 wait complete. 2024-08-17T02:26:06.399 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:26:06.400 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:06.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.493+0000 7ffa9f0a9700 1 Processor -- start 2024-08-17T02:26:06.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.493+0000 7ffa9f0a9700 1 -- start start 2024-08-17T02:26:06.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.493+0000 7ffa9f0a9700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ffa980b0d20 0x7ffa9806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.493+0000 7ffa9f0a9700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa98141a00 con 0x7ffa980b1800 2024-08-17T02:26:06.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.493+0000 7ffa9f0a9700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9806e8a0 con 0x7ffa9806e450 2024-08-17T02:26:06.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.493+0000 7ffa9f0a9700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa98140b10 con 0x7ffa980b0d20 2024-08-17T02:26:06.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.493+0000 7ffa9e8a8700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ffa980b1800 0x7ffa98141e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57600/0 (socket says 172.21.15.102:57600) 2024-08-17T02:26:06.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9e8a8700 1 -- 172.21.15.102:0/1818880630 learned_addr learned my addr 172.21.15.102:0/1818880630 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:06.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9e0a7700 1 --2- 172.21.15.102:0/1818880630 >> v2:172.21.15.121:3300/0 conn(0x7ffa980b0d20 0x7ffa9806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9d0a5700 1 -- 172.21.15.102:0/1818880630 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895226946 0 0) 0x7ffa98141a00 con 0x7ffa980b1800 2024-08-17T02:26:06.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9d0a5700 1 -- 172.21.15.102:0/1818880630 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa80003570 con 0x7ffa980b1800 2024-08-17T02:26:06.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9e0a7700 1 -- 172.21.15.102:0/1818880630 >> v1:172.21.15.121:6789/0 conn(0x7ffa9806e450 legacy=0x7ffa980b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9e0a7700 1 -- 172.21.15.102:0/1818880630 >> v1:172.21.15.102:6789/0 conn(0x7ffa980b1800 legacy=0x7ffa98141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9e0a7700 1 -- 172.21.15.102:0/1818880630 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98140df0 con 0x7ffa980b0d20 2024-08-17T02:26:06.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9e0a7700 1 --2- 172.21.15.102:0/1818880630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa980b0d20 0x7ffa9806df10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa880098e0 tx=0x7ffa880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b688af4e353aa09e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9d0a5700 1 -- 172.21.15.102:0/1818880630 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8800b640 con 0x7ffa980b0d20 2024-08-17T02:26:06.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9d0a5700 1 -- 172.21.15.102:0/1818880630 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8800b7a0 con 0x7ffa980b0d20 2024-08-17T02:26:06.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9d0a5700 1 -- 172.21.15.102:0/1818880630 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8800bb40 con 0x7ffa980b0d20 2024-08-17T02:26:06.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9f0a9700 1 -- 172.21.15.102:0/1818880630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa980b0d20 msgr2=0x7ffa9806df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9f0a9700 1 --2- 172.21.15.102:0/1818880630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa980b0d20 0x7ffa9806df10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa880098e0 tx=0x7ffa880091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9f0a9700 1 -- 172.21.15.102:0/1818880630 shutdown_connections 2024-08-17T02:26:06.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9f0a9700 1 --2- 172.21.15.102:0/1818880630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa980b0d20 0x7ffa9806df10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9f0a9700 1 -- 172.21.15.102:0/1818880630 >> 172.21.15.102:0/1818880630 conn(0x7ffa980678d0 msgr2=0x7ffa98067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9f0a9700 1 -- 172.21.15.102:0/1818880630 shutdown_connections 2024-08-17T02:26:06.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.497+0000 7ffa9f0a9700 1 -- 172.21.15.102:0/1818880630 wait complete. 2024-08-17T02:26:06.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9f0a9700 1 Processor -- start 2024-08-17T02:26:06.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9f0a9700 1 -- start start 2024-08-17T02:26:06.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9f0a9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa9806e450 0x7ffa980a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9f0a9700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa980b1800 0x7ffa9813fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9f0a9700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa9815dd00 0x7ffa9815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9f0a9700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9815e6e0 con 0x7ffa980b1800 2024-08-17T02:26:06.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9f0a9700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980a6800 con 0x7ffa9806e450 2024-08-17T02:26:06.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9f0a9700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9816de60 con 0x7ffa9815dd00 2024-08-17T02:26:06.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9d8a6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa980b1800 0x7ffa9813fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9d8a6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa980b1800 0x7ffa9813fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44444/0 (socket says 172.21.15.102:44444) 2024-08-17T02:26:06.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9d8a6700 1 -- 172.21.15.102:0/378424777 learned_addr learned my addr 172.21.15.102:0/378424777 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:06.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9e0a7700 1 --2- 172.21.15.102:0/378424777 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa9806e450 0x7ffa980a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9e8a8700 1 --2- 172.21.15.102:0/378424777 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa9815dd00 0x7ffa9815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9d8a6700 1 -- 172.21.15.102:0/378424777 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa9815dd00 msgr2=0x7ffa9815e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9d8a6700 1 --2- 172.21.15.102:0/378424777 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa9815dd00 0x7ffa9815e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9d8a6700 1 -- 172.21.15.102:0/378424777 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa9806e450 msgr2=0x7ffa980a62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9d8a6700 1 --2- 172.21.15.102:0/378424777 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa9806e450 0x7ffa980a62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9d8a6700 1 -- 172.21.15.102:0/378424777 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa88009420 con 0x7ffa980b1800 2024-08-17T02:26:06.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9d8a6700 1 --2- 172.21.15.102:0/378424777 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa980b1800 0x7ffa9813fec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00cb10 tx=0x7ffa8c0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa967fc700 1 -- 172.21.15.102:0/378424777 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c0020c0 con 0x7ffa980b1800 2024-08-17T02:26:06.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa967fc700 1 -- 172.21.15.102:0/378424777 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8c00a7e0 con 0x7ffa980b1800 2024-08-17T02:26:06.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9f0a9700 1 -- 172.21.15.102:0/378424777 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9816e140 con 0x7ffa980b1800 2024-08-17T02:26:06.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa967fc700 1 -- 172.21.15.102:0/378424777 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c00ab80 con 0x7ffa980b1800 2024-08-17T02:26:06.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9f0a9700 1 -- 172.21.15.102:0/378424777 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9816e700 con 0x7ffa980b1800 2024-08-17T02:26:06.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.501+0000 7ffa9f0a9700 1 -- 172.21.15.102:0/378424777 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa980a6ed0 con 0x7ffa980b1800 2024-08-17T02:26:06.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.505+0000 7ffa967fc700 1 -- 172.21.15.102:0/378424777 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ffa8c003030 con 0x7ffa980b1800 2024-08-17T02:26:06.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.505+0000 7ffa967fc700 1 --2- 172.21.15.102:0/378424777 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ffa84060860 0x7ffa84062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.505+0000 7ffa9e0a7700 1 --2- 172.21.15.102:0/378424777 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ffa84060860 0x7ffa84062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.505+0000 7ffa967fc700 1 -- 172.21.15.102:0/378424777 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa8c07cbd0 con 0x7ffa980b1800 2024-08-17T02:26:06.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.505+0000 7ffa9e0a7700 1 --2- 172.21.15.102:0/378424777 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ffa84060860 0x7ffa84062d10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffa9806cd00 tx=0x7ffa88017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.513+0000 7ffa967fc700 1 -- 172.21.15.102:0/378424777 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ffa980a6ed0 con 0x7ffa980b1800 2024-08-17T02:26:06.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.665+0000 7ffa9f0a9700 1 -- 172.21.15.102:0/378424777 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa980a6ed0 con 0x7ffa980b1800 2024-08-17T02:26:06.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.665+0000 7ffa967fc700 1 -- 172.21.15.102:0/378424777 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7ffa980a6ed0 con 0x7ffa980b1800 2024-08-17T02:26:06.668 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:06.668 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:57.002263+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:53.562223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:54.343618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:06.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.669+0000 7ffa9f0a9700 1 -- 172.21.15.102:0/378424777 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ffa84060860 msgr2=0x7ffa84062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.669+0000 7ffa9f0a9700 1 --2- 172.21.15.102:0/378424777 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ffa84060860 0x7ffa84062d10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffa9806cd00 tx=0x7ffa88017000 comp rx=0 tx=0).stop 2024-08-17T02:26:06.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.669+0000 7ffa9f0a9700 1 -- 172.21.15.102:0/378424777 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa980b1800 msgr2=0x7ffa9813fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.669+0000 7ffa9f0a9700 1 --2- 172.21.15.102:0/378424777 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa980b1800 0x7ffa9813fec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00cb10 tx=0x7ffa8c0017b0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.669+0000 7ffa9f0a9700 1 -- 172.21.15.102:0/378424777 shutdown_connections 2024-08-17T02:26:06.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.669+0000 7ffa9f0a9700 1 --2- 172.21.15.102:0/378424777 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ffa84060860 0x7ffa84062d10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.669+0000 7ffa9f0a9700 1 --2- 172.21.15.102:0/378424777 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa980b1800 0x7ffa9813fec0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.669+0000 7ffa9f0a9700 1 --2- 172.21.15.102:0/378424777 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa9815dd00 0x7ffa9815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.669+0000 7ffa9f0a9700 1 --2- 172.21.15.102:0/378424777 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa9806e450 0x7ffa980a62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.669+0000 7ffa9f0a9700 1 -- 172.21.15.102:0/378424777 >> 172.21.15.102:0/378424777 conn(0x7ffa980678d0 msgr2=0x7ffa9815eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.669+0000 7ffa9f0a9700 1 -- 172.21.15.102:0/378424777 shutdown_connections 2024-08-17T02:26:06.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.669+0000 7ffa9f0a9700 1 -- 172.21.15.102:0/378424777 wait complete. 2024-08-17T02:26:06.686 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:49.236728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:53.562223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:54.343618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:06.687 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:06.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.793+0000 7f131aea2700 1 Processor -- start 2024-08-17T02:26:06.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.793+0000 7f131aea2700 1 -- start start 2024-08-17T02:26:06.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f131aea2700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f131413f880 0x7f13140b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f131aea2700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13140b1eb0 0x7f131406e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f131aea2700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13140ad2c0 con 0x7f131406ec40 2024-08-17T02:26:06.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f131aea2700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131406f0c0 con 0x7f131413f880 2024-08-17T02:26:06.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f131aea2700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13140ac6d0 con 0x7f13140b1eb0 2024-08-17T02:26:06.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f131a6a1700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f131406ec40 0x7f13140c8430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57610/0 (socket says 172.21.15.102:57610) 2024-08-17T02:26:06.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f131a6a1700 1 -- 172.21.15.102:0/1230999026 learned_addr learned my addr 172.21.15.102:0/1230999026 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:06.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f1319ea0700 1 --2- 172.21.15.102:0/1230999026 >> v2:172.21.15.102:3300/0 conn(0x7f131413f880 0x7f13140b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f1318e9e700 1 -- 172.21.15.102:0/1230999026 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3614313510 0 0) 0x7f13140ad2c0 con 0x7f131406ec40 2024-08-17T02:26:06.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f131969f700 1 --2- 172.21.15.102:0/1230999026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13140b1eb0 0x7f131406e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f1318e9e700 1 -- 172.21.15.102:0/1230999026 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1300003570 con 0x7f131406ec40 2024-08-17T02:26:06.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f1318e9e700 1 -- 172.21.15.102:0/1230999026 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2245517198 0 0) 0x7f1300003570 con 0x7f131406ec40 2024-08-17T02:26:06.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f1319ea0700 1 -- 172.21.15.102:0/1230999026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13140b1eb0 msgr2=0x7f131406e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:06.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f1319ea0700 1 --2- 172.21.15.102:0/1230999026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13140b1eb0 0x7f131406e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f1319ea0700 1 -- 172.21.15.102:0/1230999026 >> v1:172.21.15.102:6789/0 conn(0x7f131406ec40 legacy=0x7f13140c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f1319ea0700 1 -- 172.21.15.102:0/1230999026 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13140ac990 con 0x7f131413f880 2024-08-17T02:26:06.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f1319ea0700 1 --2- 172.21.15.102:0/1230999026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f131413f880 0x7f13140b0e90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f13040098e0 tx=0x7f13040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac2784ebfc790f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f1318e9e700 1 -- 172.21.15.102:0/1230999026 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c0017f0 con 0x7f131413f880 2024-08-17T02:26:06.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f1318e9e700 1 -- 172.21.15.102:0/1230999026 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1304011420 con 0x7f131413f880 2024-08-17T02:26:06.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f1318e9e700 1 -- 172.21.15.102:0/1230999026 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13040117c0 con 0x7f131413f880 2024-08-17T02:26:06.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f131aea2700 1 -- 172.21.15.102:0/1230999026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f131413f880 msgr2=0x7f13140b0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f131aea2700 1 --2- 172.21.15.102:0/1230999026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f131413f880 0x7f13140b0e90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f13040098e0 tx=0x7f13040091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f131aea2700 1 -- 172.21.15.102:0/1230999026 shutdown_connections 2024-08-17T02:26:06.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f131aea2700 1 --2- 172.21.15.102:0/1230999026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f13140b1eb0 0x7f131406e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f131aea2700 1 --2- 172.21.15.102:0/1230999026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f131413f880 0x7f13140b0e90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f131aea2700 1 -- 172.21.15.102:0/1230999026 >> 172.21.15.102:0/1230999026 conn(0x7f13140ca2c0 msgr2=0x7f131406dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f131aea2700 1 -- 172.21.15.102:0/1230999026 shutdown_connections 2024-08-17T02:26:06.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.797+0000 7f131aea2700 1 -- 172.21.15.102:0/1230999026 wait complete. 2024-08-17T02:26:06.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.801+0000 7f131aea2700 1 Processor -- start 2024-08-17T02:26:06.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.801+0000 7f131aea2700 1 -- start start 2024-08-17T02:26:06.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.801+0000 7f131aea2700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f131406ec40 0x7f131414fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.801+0000 7f131aea2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13140b1eb0 0x7f13141344c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.801+0000 7f131aea2700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f131413f880 0x7f13141513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.801+0000 7f131aea2700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1314068e60 con 0x7f131406ec40 2024-08-17T02:26:06.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.801+0000 7f131aea2700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1314151910 con 0x7f13140b1eb0 2024-08-17T02:26:06.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.801+0000 7f131aea2700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1314151bb0 con 0x7f131413f880 2024-08-17T02:26:06.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.801+0000 7f1319ea0700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f131406ec40 0x7f131414fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.801+0000 7f131969f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13140b1eb0 0x7f13141344c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.801+0000 7f1319ea0700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f131406ec40 0x7f131414fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44466/0 (socket says 172.21.15.102:44466) 2024-08-17T02:26:06.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.801+0000 7f1319ea0700 1 -- 172.21.15.102:0/2824316133 learned_addr learned my addr 172.21.15.102:0/2824316133 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:06.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.801+0000 7f131a6a1700 1 --2- 172.21.15.102:0/2824316133 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f131413f880 0x7f13141513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.805+0000 7f1319ea0700 1 -- 172.21.15.102:0/2824316133 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f131413f880 msgr2=0x7f13141513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.805+0000 7f1319ea0700 1 --2- 172.21.15.102:0/2824316133 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f131413f880 0x7f13141513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.805+0000 7f1319ea0700 1 -- 172.21.15.102:0/2824316133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13140b1eb0 msgr2=0x7f13141344c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.805+0000 7f1319ea0700 1 --2- 172.21.15.102:0/2824316133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13140b1eb0 0x7f13141344c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.805+0000 7f1319ea0700 1 -- 172.21.15.102:0/2824316133 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1304009420 con 0x7f131406ec40 2024-08-17T02:26:06.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.805+0000 7f1319ea0700 1 --2- 172.21.15.102:0/2824316133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f131406ec40 0x7f131414fa70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f13040030c0 tx=0x7f1304016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.805+0000 7f1309ffb700 1 -- 172.21.15.102:0/2824316133 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130401cb30 con 0x7f131406ec40 2024-08-17T02:26:06.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.805+0000 7f1309ffb700 1 -- 172.21.15.102:0/2824316133 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130401cc90 con 0x7f131406ec40 2024-08-17T02:26:06.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.805+0000 7f131aea2700 1 -- 172.21.15.102:0/2824316133 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1314151e90 con 0x7f131406ec40 2024-08-17T02:26:06.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.805+0000 7f1309ffb700 1 -- 172.21.15.102:0/2824316133 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130401a6a0 con 0x7f131406ec40 2024-08-17T02:26:06.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.805+0000 7f131aea2700 1 -- 172.21.15.102:0/2824316133 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1314068af0 con 0x7f131406ec40 2024-08-17T02:26:06.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.805+0000 7f131aea2700 1 -- 172.21.15.102:0/2824316133 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13140638f0 con 0x7f131406ec40 2024-08-17T02:26:06.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.805+0000 7f1309ffb700 1 -- 172.21.15.102:0/2824316133 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f130401aad0 con 0x7f131406ec40 2024-08-17T02:26:06.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.809+0000 7f1309ffb700 1 --2- 172.21.15.102:0/2824316133 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f12f8060890 0x7f12f8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.809+0000 7f1309ffb700 1 -- 172.21.15.102:0/2824316133 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f130407e430 con 0x7f131406ec40 2024-08-17T02:26:06.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.809+0000 7f131969f700 1 --2- 172.21.15.102:0/2824316133 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f12f8060890 0x7f12f8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.809+0000 7f131969f700 1 --2- 172.21.15.102:0/2824316133 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f12f8060890 0x7f12f8062d40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f131414ffb0 tx=0x7f13100091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.817+0000 7f1309ffb700 1 -- 172.21.15.102:0/2824316133 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f130404e7e0 con 0x7f131406ec40 2024-08-17T02:26:06.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.973+0000 7f131aea2700 1 -- 172.21.15.102:0/2824316133 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13140ae9f0 con 0x7f131406ec40 2024-08-17T02:26:06.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.973+0000 7f1309ffb700 1 -- 172.21.15.102:0/2824316133 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1304051e00 con 0x7f131406ec40 2024-08-17T02:26:06.976 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-08-17T02:26:06.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.977+0000 7f131aea2700 1 -- 172.21.15.102:0/2824316133 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f12f8060890 msgr2=0x7f12f8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.977+0000 7f131aea2700 1 --2- 172.21.15.102:0/2824316133 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f12f8060890 0x7f12f8062d40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f131414ffb0 tx=0x7f13100091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.977+0000 7f131aea2700 1 -- 172.21.15.102:0/2824316133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f131406ec40 msgr2=0x7f131414fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.977+0000 7f131aea2700 1 --2- 172.21.15.102:0/2824316133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f131406ec40 0x7f131414fa70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f13040030c0 tx=0x7f1304016000 comp rx=0 tx=0).stop 2024-08-17T02:26:06.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.977+0000 7f131aea2700 1 -- 172.21.15.102:0/2824316133 shutdown_connections 2024-08-17T02:26:06.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.977+0000 7f131aea2700 1 --2- 172.21.15.102:0/2824316133 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f12f8060890 0x7f12f8062d40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.977+0000 7f131aea2700 1 --2- 172.21.15.102:0/2824316133 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f131413f880 0x7f13141513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.977+0000 7f131aea2700 1 --2- 172.21.15.102:0/2824316133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f13140b1eb0 0x7f13141344c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.977+0000 7f131aea2700 1 --2- 172.21.15.102:0/2824316133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f131406ec40 0x7f131414fa70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.977+0000 7f131aea2700 1 -- 172.21.15.102:0/2824316133 >> 172.21.15.102:0/2824316133 conn(0x7f13140ca2c0 msgr2=0x7f131406dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.977+0000 7f131aea2700 1 -- 172.21.15.102:0/2824316133 shutdown_connections 2024-08-17T02:26:06.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:06.977+0000 7f131aea2700 1 -- 172.21.15.102:0/2824316133 wait complete. 2024-08-17T02:26:06.990 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:07.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.101+0000 7fcd10a28700 1 Processor -- start 2024-08-17T02:26:07.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.101+0000 7fcd10a28700 1 -- start start 2024-08-17T02:26:07.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.101+0000 7fcd10a28700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd0c13f680 0x7fcd0c0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.101+0000 7fcd10a28700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcd0c13fa50 0x7fcd0c0ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.101+0000 7fcd10a28700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0c0afc70 con 0x7fcd0c0b0100 2024-08-17T02:26:07.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.101+0000 7fcd10a28700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0c0adc00 con 0x7fcd0c13fa50 2024-08-17T02:26:07.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.101+0000 7fcd10a28700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0af060 con 0x7fcd0c13f680 2024-08-17T02:26:07.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.101+0000 7fcd0affd700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcd0c13fa50 0x7fcd0c0ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.101+0000 7fcd0bfff700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fcd0c0b0100 0x7fcd0c06e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57616/0 (socket says 172.21.15.102:57616) 2024-08-17T02:26:07.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.101+0000 7fcd0bfff700 1 -- 172.21.15.102:0/2603828840 learned_addr learned my addr 172.21.15.102:0/2603828840 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:07.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.101+0000 7fcd0b7fe700 1 --2- 172.21.15.102:0/2603828840 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd0c13f680 0x7fcd0c0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.101+0000 7fcd0a7fc700 1 -- 172.21.15.102:0/2603828840 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166310988 0 0) 0x7fcd0c0afc70 con 0x7fcd0c0b0100 2024-08-17T02:26:07.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.101+0000 7fcd0a7fc700 1 -- 172.21.15.102:0/2603828840 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccf4003570 con 0x7fcd0c0b0100 2024-08-17T02:26:07.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0affd700 1 -- 172.21.15.102:0/2603828840 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd0c13f680 msgr2=0x7fcd0c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:07.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0affd700 1 --2- 172.21.15.102:0/2603828840 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd0c13f680 0x7fcd0c0aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0affd700 1 -- 172.21.15.102:0/2603828840 >> v1:172.21.15.102:6789/0 conn(0x7fcd0c0b0100 legacy=0x7fcd0c06e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0affd700 1 -- 172.21.15.102:0/2603828840 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c0af340 con 0x7fcd0c13fa50 2024-08-17T02:26:07.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0affd700 1 --2- 172.21.15.102:0/2603828840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd0c13fa50 0x7fcd0c0ad6c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0098e0 tx=0x7fccfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab02663929037414 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0a7fc700 1 -- 172.21.15.102:0/2603828840 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc011630 con 0x7fcd0c13fa50 2024-08-17T02:26:07.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0a7fc700 1 -- 172.21.15.102:0/2603828840 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc011790 con 0x7fcd0c13fa50 2024-08-17T02:26:07.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0a7fc700 1 -- 172.21.15.102:0/2603828840 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc011b30 con 0x7fcd0c13fa50 2024-08-17T02:26:07.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd10a28700 1 -- 172.21.15.102:0/2603828840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd0c13fa50 msgr2=0x7fcd0c0ad6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd10a28700 1 --2- 172.21.15.102:0/2603828840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd0c13fa50 0x7fcd0c0ad6c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0098e0 tx=0x7fccfc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd10a28700 1 -- 172.21.15.102:0/2603828840 shutdown_connections 2024-08-17T02:26:07.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd10a28700 1 --2- 172.21.15.102:0/2603828840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd0c13fa50 0x7fcd0c0ad6c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd10a28700 1 --2- 172.21.15.102:0/2603828840 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd0c13f680 0x7fcd0c0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd10a28700 1 -- 172.21.15.102:0/2603828840 >> 172.21.15.102:0/2603828840 conn(0x7fcd0c0678a0 msgr2=0x7fcd0c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd10a28700 1 -- 172.21.15.102:0/2603828840 shutdown_connections 2024-08-17T02:26:07.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd10a28700 1 -- 172.21.15.102:0/2603828840 wait complete. 2024-08-17T02:26:07.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd10a28700 1 Processor -- start 2024-08-17T02:26:07.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd10a28700 1 -- start start 2024-08-17T02:26:07.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd10a28700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd0c0b0100 0x7fcd0c1576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd10a28700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd0c13f680 0x7fcd0c13a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd10a28700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd0c13fa50 0x7fcd0c13aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd10a28700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c157c10 con 0x7fcd0c13fa50 2024-08-17T02:26:07.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd10a28700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0a5450 con 0x7fcd0c0b0100 2024-08-17T02:26:07.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd10a28700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0c0a5fd0 con 0x7fcd0c13f680 2024-08-17T02:26:07.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0bfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd0c13fa50 0x7fcd0c13aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0bfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd0c13fa50 0x7fcd0c13aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44490/0 (socket says 172.21.15.102:44490) 2024-08-17T02:26:07.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0bfff700 1 -- 172.21.15.102:0/2694747936 learned_addr learned my addr 172.21.15.102:0/2694747936 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:07.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0b7fe700 1 --2- 172.21.15.102:0/2694747936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd0c0b0100 0x7fcd0c1576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0affd700 1 --2- 172.21.15.102:0/2694747936 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd0c13f680 0x7fcd0c13a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0bfff700 1 -- 172.21.15.102:0/2694747936 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd0c13f680 msgr2=0x7fcd0c13a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0bfff700 1 --2- 172.21.15.102:0/2694747936 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd0c13f680 0x7fcd0c13a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0bfff700 1 -- 172.21.15.102:0/2694747936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd0c0b0100 msgr2=0x7fcd0c1576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0bfff700 1 --2- 172.21.15.102:0/2694747936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd0c0b0100 0x7fcd0c1576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.105+0000 7fcd0bfff700 1 -- 172.21.15.102:0/2694747936 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc009420 con 0x7fcd0c13fa50 2024-08-17T02:26:07.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.109+0000 7fcd0bfff700 1 --2- 172.21.15.102:0/2694747936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd0c13fa50 0x7fcd0c13aea0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400cca0 tx=0x7fcd04001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.109+0000 7fccf37fe700 1 -- 172.21.15.102:0/2694747936 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0400a8d0 con 0x7fcd0c13fa50 2024-08-17T02:26:07.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.109+0000 7fccf37fe700 1 -- 172.21.15.102:0/2694747936 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0400aa30 con 0x7fcd0c13fa50 2024-08-17T02:26:07.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.109+0000 7fccf37fe700 1 -- 172.21.15.102:0/2694747936 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0400adb0 con 0x7fcd0c13fa50 2024-08-17T02:26:07.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.109+0000 7fcd10a28700 1 -- 172.21.15.102:0/2694747936 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0c0a6460 con 0x7fcd0c13fa50 2024-08-17T02:26:07.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.109+0000 7fcd10a28700 1 -- 172.21.15.102:0/2694747936 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0c0a5980 con 0x7fcd0c13fa50 2024-08-17T02:26:07.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.109+0000 7fcd10a28700 1 -- 172.21.15.102:0/2694747936 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0c0a6160 con 0x7fcd0c13fa50 2024-08-17T02:26:07.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.109+0000 7fccf37fe700 1 -- 172.21.15.102:0/2694747936 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcd04007300 con 0x7fcd0c13fa50 2024-08-17T02:26:07.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.109+0000 7fccf37fe700 1 --2- 172.21.15.102:0/2694747936 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fccf8060860 0x7fccf8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.109+0000 7fccf37fe700 1 -- 172.21.15.102:0/2694747936 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd0407cff0 con 0x7fcd0c13fa50 2024-08-17T02:26:07.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.109+0000 7fcd0b7fe700 1 --2- 172.21.15.102:0/2694747936 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fccf8060860 0x7fccf8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.109+0000 7fcd0b7fe700 1 --2- 172.21.15.102:0/2694747936 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fccf8060860 0x7fccf8062d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c06b010 tx=0x7fcd000091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.121+0000 7fccf37fe700 1 -- 172.21.15.102:0/2694747936 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcd0404d3e0 con 0x7fcd0c13fa50 2024-08-17T02:26:07.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.281+0000 7fcd10a28700 1 -- 172.21.15.102:0/2694747936 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd0c064330 con 0x7fcd0c13fa50 2024-08-17T02:26:07.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.281+0000 7fccf37fe700 1 -- 172.21.15.102:0/2694747936 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd04050a00 con 0x7fcd0c13fa50 2024-08-17T02:26:07.284 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-08-17T02:26:07.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.285+0000 7fcd10a28700 1 -- 172.21.15.102:0/2694747936 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fccf8060860 msgr2=0x7fccf8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.285+0000 7fcd10a28700 1 --2- 172.21.15.102:0/2694747936 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fccf8060860 0x7fccf8062d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c06b010 tx=0x7fcd000091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.285+0000 7fcd10a28700 1 -- 172.21.15.102:0/2694747936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd0c13fa50 msgr2=0x7fcd0c13aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.285+0000 7fcd10a28700 1 --2- 172.21.15.102:0/2694747936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd0c13fa50 0x7fcd0c13aea0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400cca0 tx=0x7fcd04001ae0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.285+0000 7fcd10a28700 1 -- 172.21.15.102:0/2694747936 shutdown_connections 2024-08-17T02:26:07.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.285+0000 7fcd10a28700 1 --2- 172.21.15.102:0/2694747936 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fccf8060860 0x7fccf8062d10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.285+0000 7fcd10a28700 1 --2- 172.21.15.102:0/2694747936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd0c13fa50 0x7fcd0c13aea0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.285+0000 7fcd10a28700 1 --2- 172.21.15.102:0/2694747936 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcd0c13f680 0x7fcd0c13a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.285+0000 7fcd10a28700 1 --2- 172.21.15.102:0/2694747936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd0c0b0100 0x7fcd0c1576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.285+0000 7fcd10a28700 1 -- 172.21.15.102:0/2694747936 >> 172.21.15.102:0/2694747936 conn(0x7fcd0c0678a0 msgr2=0x7fcd0c15ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.285+0000 7fcd10a28700 1 -- 172.21.15.102:0/2694747936 shutdown_connections 2024-08-17T02:26:07.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.285+0000 7fcd10a28700 1 -- 172.21.15.102:0/2694747936 wait complete. 2024-08-17T02:26:07.297 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:07.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.401+0000 7f678d243700 1 Processor -- start 2024-08-17T02:26:07.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.401+0000 7f678d243700 1 -- start start 2024-08-17T02:26:07.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.401+0000 7f678d243700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6788140a30 0x7f67880c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.401+0000 7f678d243700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6788140e00 0x7f67880cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.401+0000 7f678d243700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67880c3b90 con 0x7f67880b0e30 2024-08-17T02:26:07.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.401+0000 7f678d243700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67880ca510 con 0x7f6788140e00 2024-08-17T02:26:07.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.401+0000 7f678d243700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67880ca7f0 con 0x7f6788140a30 2024-08-17T02:26:07.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.401+0000 7f678659c700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6788140e00 0x7f67880cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.401+0000 7f678659c700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6788140e00 0x7f67880cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44506/0 (socket says 172.21.15.102:44506) 2024-08-17T02:26:07.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.401+0000 7f678659c700 1 -- 172.21.15.102:0/3406201146 learned_addr learned my addr 172.21.15.102:0/3406201146 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:07.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.401+0000 7f6786d9d700 1 --2- 172.21.15.102:0/3406201146 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6788140a30 0x7f67880c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.401+0000 7f678659c700 1 -- 172.21.15.102:0/3406201146 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6788140a30 msgr2=0x7f67880c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:07.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.401+0000 7f678659c700 1 --2- 172.21.15.102:0/3406201146 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6788140a30 0x7f67880c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.401+0000 7f678659c700 1 -- 172.21.15.102:0/3406201146 >> v1:172.21.15.121:6789/0 conn(0x7f67880b0e30 legacy=0x7f67880cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.401+0000 7f678659c700 1 -- 172.21.15.102:0/3406201146 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67880c37d0 con 0x7f6788140e00 2024-08-17T02:26:07.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.401+0000 7f678659c700 1 --2- 172.21.15.102:0/3406201146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6788140e00 0x7f67880cbc40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67780099e0 tx=0x7f6778009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c757af29fdfe7d1b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.405+0000 7f6785d9b700 1 -- 172.21.15.102:0/3406201146 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677800b820 con 0x7f6788140e00 2024-08-17T02:26:07.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.405+0000 7f6785d9b700 1 -- 172.21.15.102:0/3406201146 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677800b980 con 0x7f6788140e00 2024-08-17T02:26:07.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.405+0000 7f6785d9b700 1 -- 172.21.15.102:0/3406201146 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677800bd20 con 0x7f6788140e00 2024-08-17T02:26:07.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.405+0000 7f678d243700 1 -- 172.21.15.102:0/3406201146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6788140e00 msgr2=0x7f67880cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.405+0000 7f678d243700 1 --2- 172.21.15.102:0/3406201146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6788140e00 0x7f67880cbc40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67780099e0 tx=0x7f6778009250 comp rx=0 tx=0).stop 2024-08-17T02:26:07.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.405+0000 7f678d243700 1 -- 172.21.15.102:0/3406201146 shutdown_connections 2024-08-17T02:26:07.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.405+0000 7f678d243700 1 --2- 172.21.15.102:0/3406201146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6788140e00 0x7f67880cbc40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.405+0000 7f678d243700 1 --2- 172.21.15.102:0/3406201146 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6788140a30 0x7f67880c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.405+0000 7f678d243700 1 -- 172.21.15.102:0/3406201146 >> 172.21.15.102:0/3406201146 conn(0x7f67880caae0 msgr2=0x7f67880caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.405+0000 7f678d243700 1 -- 172.21.15.102:0/3406201146 shutdown_connections 2024-08-17T02:26:07.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.405+0000 7f678d243700 1 -- 172.21.15.102:0/3406201146 wait complete. 2024-08-17T02:26:07.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f678d243700 1 Processor -- start 2024-08-17T02:26:07.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f678d243700 1 -- start start 2024-08-17T02:26:07.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f678d243700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67880b0e30 0x7f6788167e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f678d243700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6788140a30 0x7f6788156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f678d243700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6788140e00 0x7f678815ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f678d243700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6788168370 con 0x7f6788140e00 2024-08-17T02:26:07.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f678d243700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6788158670 con 0x7f6788140a30 2024-08-17T02:26:07.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f678d243700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6788157a60 con 0x7f67880b0e30 2024-08-17T02:26:07.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f678659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6788140a30 0x7f6788156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f6786d9d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67880b0e30 0x7f6788167e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f6786d9d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67880b0e30 0x7f6788167e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:49506/0 (socket says 172.21.15.102:49506) 2024-08-17T02:26:07.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f6786d9d700 1 -- 172.21.15.102:0/2351890075 learned_addr learned my addr 172.21.15.102:0/2351890075 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:07.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f678759e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6788140e00 0x7f678815ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f678759e700 1 -- 172.21.15.102:0/2351890075 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67880b0e30 msgr2=0x7f6788167e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f678759e700 1 --2- 172.21.15.102:0/2351890075 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67880b0e30 0x7f6788167e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f678759e700 1 -- 172.21.15.102:0/2351890075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6788140a30 msgr2=0x7f6788156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f678759e700 1 --2- 172.21.15.102:0/2351890075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6788140a30 0x7f6788156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f678759e700 1 -- 172.21.15.102:0/2351890075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67780094f0 con 0x7f6788140e00 2024-08-17T02:26:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.409+0000 7f6786d9d700 1 --2- 172.21.15.102:0/2351890075 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67880b0e30 0x7f6788167e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.413+0000 7f678759e700 1 --2- 172.21.15.102:0/2351890075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6788140e00 0x7f678815ac50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f67880b1250 tx=0x7f6780001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.413+0000 7f677effd700 1 -- 172.21.15.102:0/2351890075 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780012630 con 0x7f6788140e00 2024-08-17T02:26:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.413+0000 7f677effd700 1 -- 172.21.15.102:0/2351890075 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67800127b0 con 0x7f6788140e00 2024-08-17T02:26:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.413+0000 7f678d243700 1 -- 172.21.15.102:0/2351890075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6788157d40 con 0x7f6788140e00 2024-08-17T02:26:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.413+0000 7f677effd700 1 -- 172.21.15.102:0/2351890075 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780012b70 con 0x7f6788140e00 2024-08-17T02:26:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.413+0000 7f678d243700 1 -- 172.21.15.102:0/2351890075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6788158300 con 0x7f6788140e00 2024-08-17T02:26:07.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.413+0000 7f678d243700 1 -- 172.21.15.102:0/2351890075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67880645c0 con 0x7f6788140e00 2024-08-17T02:26:07.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.417+0000 7f677effd700 1 -- 172.21.15.102:0/2351890075 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6780003030 con 0x7f6788140e00 2024-08-17T02:26:07.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.417+0000 7f677effd700 1 --2- 172.21.15.102:0/2351890075 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6768060860 0x7f6768062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.417+0000 7f677effd700 1 -- 172.21.15.102:0/2351890075 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f678007d230 con 0x7f6788140e00 2024-08-17T02:26:07.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.417+0000 7f6786d9d700 1 --2- 172.21.15.102:0/2351890075 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6768060860 0x7f6768062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.417+0000 7f6786d9d700 1 --2- 172.21.15.102:0/2351890075 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6768060860 0x7f6768062d10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6770009fd0 tx=0x7f67700091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.425+0000 7f677effd700 1 -- 172.21.15.102:0/2351890075 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f678004d5e0 con 0x7f6788140e00 2024-08-17T02:26:07.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.581+0000 7f678d243700 1 -- 172.21.15.102:0/2351890075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67880b0940 con 0x7f6788140e00 2024-08-17T02:26:07.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.581+0000 7f677effd700 1 -- 172.21.15.102:0/2351890075 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6780050c00 con 0x7f6788140e00 2024-08-17T02:26:07.584 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-08-17T02:26:07.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.585+0000 7f678d243700 1 -- 172.21.15.102:0/2351890075 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6768060860 msgr2=0x7f6768062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.585+0000 7f678d243700 1 --2- 172.21.15.102:0/2351890075 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6768060860 0x7f6768062d10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6770009fd0 tx=0x7f67700091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.585+0000 7f678d243700 1 -- 172.21.15.102:0/2351890075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6788140e00 msgr2=0x7f678815ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.585+0000 7f678d243700 1 --2- 172.21.15.102:0/2351890075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6788140e00 0x7f678815ac50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f67880b1250 tx=0x7f6780001690 comp rx=0 tx=0).stop 2024-08-17T02:26:07.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.585+0000 7f678d243700 1 -- 172.21.15.102:0/2351890075 shutdown_connections 2024-08-17T02:26:07.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.585+0000 7f678d243700 1 --2- 172.21.15.102:0/2351890075 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6768060860 0x7f6768062d10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.585+0000 7f678d243700 1 --2- 172.21.15.102:0/2351890075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6788140e00 0x7f678815ac50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.585+0000 7f678d243700 1 --2- 172.21.15.102:0/2351890075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6788140a30 0x7f6788156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.585+0000 7f678d243700 1 --2- 172.21.15.102:0/2351890075 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67880b0e30 0x7f6788167e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.585+0000 7f678d243700 1 -- 172.21.15.102:0/2351890075 >> 172.21.15.102:0/2351890075 conn(0x7f67880caae0 msgr2=0x7f67880b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.585+0000 7f678d243700 1 -- 172.21.15.102:0/2351890075 shutdown_connections 2024-08-17T02:26:07.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.585+0000 7f678d243700 1 -- 172.21.15.102:0/2351890075 wait complete. 2024-08-17T02:26:07.598 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:07.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.705+0000 7f0283fff700 1 Processor -- start 2024-08-17T02:26:07.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.705+0000 7f0283fff700 1 -- start start 2024-08-17T02:26:07.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.705+0000 7f0283fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f02840b0d20 0x7f028406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.705+0000 7f0283fff700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0284141a00 con 0x7f028406e450 2024-08-17T02:26:07.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.705+0000 7f0283fff700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f028406e8a0 con 0x7f02840b1800 2024-08-17T02:26:07.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.705+0000 7f0283fff700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0284140b10 con 0x7f02840b0d20 2024-08-17T02:26:07.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.705+0000 7f02827fc700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f028406e450 0x7f02840b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57618/0 (socket says 172.21.15.102:57618) 2024-08-17T02:26:07.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.705+0000 7f02827fc700 1 -- 172.21.15.102:0/3461370986 learned_addr learned my addr 172.21.15.102:0/3461370986 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:07.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0282ffd700 1 --2- 172.21.15.102:0/3461370986 >> v2:172.21.15.121:3300/0 conn(0x7f02840b0d20 0x7f028406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 -- 172.21.15.102:0/3461370986 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864842680 0 0) 0x7f0284141a00 con 0x7f028406e450 2024-08-17T02:26:07.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 -- 172.21.15.102:0/3461370986 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0264003570 con 0x7f028406e450 2024-08-17T02:26:07.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 -- 172.21.15.102:0/3461370986 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971038993 0 0) 0x7f028406e8a0 con 0x7f02840b1800 2024-08-17T02:26:07.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 -- 172.21.15.102:0/3461370986 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0284141a00 con 0x7f02840b1800 2024-08-17T02:26:07.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 -- 172.21.15.102:0/3461370986 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2717703998 0 0) 0x7f0264003570 con 0x7f028406e450 2024-08-17T02:26:07.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 -- 172.21.15.102:0/3461370986 >> v2:172.21.15.121:3300/0 conn(0x7f02840b0d20 msgr2=0x7f028406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:07.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 --2- 172.21.15.102:0/3461370986 >> v2:172.21.15.121:3300/0 conn(0x7f02840b0d20 0x7f028406df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 -- 172.21.15.102:0/3461370986 >> v1:172.21.15.121:6789/0 conn(0x7f02840b1800 legacy=0x7f0284141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 -- 172.21.15.102:0/3461370986 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0284140df0 con 0x7f028406e450 2024-08-17T02:26:07.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 -- 172.21.15.102:0/3461370986 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7f026c001470 con 0x7f028406e450 2024-08-17T02:26:07.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 -- 172.21.15.102:0/3461370986 >> v1:172.21.15.102:6789/0 conn(0x7f028406e450 legacy=0x7f02840b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 --2- 172.21.15.102:0/3461370986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0264003bf0 0x7f0264003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 --2- 172.21.15.102:0/3461370986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0264004810 0x7f0264004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 --2- 172.21.15.102:0/3461370986 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f02640051c0 0x7f026400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 -- 172.21.15.102:0/3461370986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0284140b10 con 0x7f0264003bf0 2024-08-17T02:26:07.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 -- 172.21.15.102:0/3461370986 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026400c050 con 0x7f0264004810 2024-08-17T02:26:07.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 -- 172.21.15.102:0/3461370986 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026400c210 con 0x7f02640051c0 2024-08-17T02:26:07.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0282ffd700 1 --2- 172.21.15.102:0/3461370986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0264003bf0 0x7f0264003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f02827fc700 1 --2- 172.21.15.102:0/3461370986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0264004810 0x7f0264004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f02837fe700 1 --2- 172.21.15.102:0/3461370986 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f02640051c0 0x7f026400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0282ffd700 1 -- 172.21.15.102:0/3461370986 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f02640051c0 msgr2=0x7f026400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:07.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0282ffd700 1 --2- 172.21.15.102:0/3461370986 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f02640051c0 0x7f026400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0282ffd700 1 -- 172.21.15.102:0/3461370986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0264004810 msgr2=0x7f0264004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:07.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0282ffd700 1 --2- 172.21.15.102:0/3461370986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0264004810 0x7f0264004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0282ffd700 1 -- 172.21.15.102:0/3461370986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0264003570 con 0x7f0264003bf0 2024-08-17T02:26:07.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f02827fc700 1 --2- 172.21.15.102:0/3461370986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0264004810 0x7f0264004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:07.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f02837fe700 1 --2- 172.21.15.102:0/3461370986 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f02640051c0 0x7f026400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:07.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f02837fe700 1 -- 172.21.15.102:0/3461370986 reap_dead start 2024-08-17T02:26:07.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0282ffd700 1 --2- 172.21.15.102:0/3461370986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0264003bf0 0x7f0264003fc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0274009be0 tx=0x7f02740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3333fe72687067d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 -- 172.21.15.102:0/3461370986 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027400e710 con 0x7f0264003bf0 2024-08-17T02:26:07.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 -- 172.21.15.102:0/3461370986 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027400e870 con 0x7f0264003bf0 2024-08-17T02:26:07.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0281ffb700 1 -- 172.21.15.102:0/3461370986 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027400ec30 con 0x7f0264003bf0 2024-08-17T02:26:07.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0283fff700 1 -- 172.21.15.102:0/3461370986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0264003bf0 msgr2=0x7f0264003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0283fff700 1 --2- 172.21.15.102:0/3461370986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0264003bf0 0x7f0264003fc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0274009be0 tx=0x7f02740091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0283fff700 1 -- 172.21.15.102:0/3461370986 shutdown_connections 2024-08-17T02:26:07.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0283fff700 1 --2- 172.21.15.102:0/3461370986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0264003bf0 0x7f0264003fc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0283fff700 1 -- 172.21.15.102:0/3461370986 >> 172.21.15.102:0/3461370986 conn(0x7f02840678d0 msgr2=0x7f0284067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0283fff700 1 -- 172.21.15.102:0/3461370986 shutdown_connections 2024-08-17T02:26:07.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.709+0000 7f0283fff700 1 -- 172.21.15.102:0/3461370986 wait complete. 2024-08-17T02:26:07.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.713+0000 7f0283fff700 1 Processor -- start 2024-08-17T02:26:07.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.713+0000 7f0283fff700 1 -- start start 2024-08-17T02:26:07.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.713+0000 7f0283fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0284063200 0x7f02840a9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.713+0000 7f0283fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02840a9000 0x7f02840635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.713+0000 7f0283fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f02840a7650 0x7f02841704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.713+0000 7f0283fff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02840a8b70 con 0x7f02840a9000 2024-08-17T02:26:07.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.713+0000 7f0283fff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02840a7f60 con 0x7f0284063200 2024-08-17T02:26:07.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.713+0000 7f0283fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02840a8240 con 0x7f02840a7650 2024-08-17T02:26:07.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.713+0000 7f02827fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02840a9000 0x7f02840635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.713+0000 7f02827fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02840a9000 0x7f02840635d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44536/0 (socket says 172.21.15.102:44536) 2024-08-17T02:26:07.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.713+0000 7f02827fc700 1 -- 172.21.15.102:0/3868501315 learned_addr learned my addr 172.21.15.102:0/3868501315 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:07.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.713+0000 7f0282ffd700 1 --2- 172.21.15.102:0/3868501315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0284063200 0x7f02840a9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.713+0000 7f02837fe700 1 --2- 172.21.15.102:0/3868501315 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f02840a7650 0x7f02841704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.717+0000 7f02827fc700 1 -- 172.21.15.102:0/3868501315 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f02840a7650 msgr2=0x7f02841704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.717+0000 7f02827fc700 1 --2- 172.21.15.102:0/3868501315 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f02840a7650 0x7f02841704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.717+0000 7f02827fc700 1 -- 172.21.15.102:0/3868501315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0284063200 msgr2=0x7f02840a9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.717+0000 7f02827fc700 1 --2- 172.21.15.102:0/3868501315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0284063200 0x7f02840a9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.717+0000 7f02827fc700 1 -- 172.21.15.102:0/3868501315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02840a8520 con 0x7f02840a9000 2024-08-17T02:26:07.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.717+0000 7f02827fc700 1 --2- 172.21.15.102:0/3868501315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02840a9000 0x7f02840635d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f026c008880 tx=0x7f026c008c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.717+0000 7f027affd700 1 -- 172.21.15.102:0/3868501315 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c00fd30 con 0x7f02840a9000 2024-08-17T02:26:07.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.717+0000 7f027affd700 1 -- 172.21.15.102:0/3868501315 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026c00fe90 con 0x7f02840a9000 2024-08-17T02:26:07.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.717+0000 7f0283fff700 1 -- 172.21.15.102:0/3868501315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02840a8800 con 0x7f02840a9000 2024-08-17T02:26:07.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.717+0000 7f027affd700 1 -- 172.21.15.102:0/3868501315 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c013590 con 0x7f02840a9000 2024-08-17T02:26:07.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.717+0000 7f0283fff700 1 -- 172.21.15.102:0/3868501315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02840a7cf0 con 0x7f02840a9000 2024-08-17T02:26:07.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.717+0000 7f0283fff700 1 -- 172.21.15.102:0/3868501315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02840a8d20 con 0x7f02840a9000 2024-08-17T02:26:07.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.717+0000 7f027affd700 1 -- 172.21.15.102:0/3868501315 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f026c013900 con 0x7f02840a9000 2024-08-17T02:26:07.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.721+0000 7f027affd700 1 --2- 172.21.15.102:0/3868501315 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0268060890 0x7f0268062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.721+0000 7f027affd700 1 -- 172.21.15.102:0/3868501315 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f026c07cad0 con 0x7f02840a9000 2024-08-17T02:26:07.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.721+0000 7f0282ffd700 1 --2- 172.21.15.102:0/3868501315 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0268060890 0x7f0268062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.721+0000 7f0282ffd700 1 --2- 172.21.15.102:0/3868501315 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0268060890 0x7f0268062d40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0284061060 tx=0x7f0274019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.725+0000 7f027affd700 1 -- 172.21.15.102:0/3868501315 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f02840a8d20 con 0x7f02840a9000 2024-08-17T02:26:07.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.921+0000 7f0283fff700 1 -- 172.21.15.102:0/3868501315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02840a8d20 con 0x7f02840a9000 2024-08-17T02:26:07.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.921+0000 7f027affd700 1 -- 172.21.15.102:0/3868501315 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f02840a8d20 con 0x7f02840a9000 2024-08-17T02:26:07.926 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:07.926 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/3384500830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3384500830},{"type":"v1","addr":"172.21.15.121:6833","nonce":3384500830}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1668690087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1668690087},{"type":"v1","addr":"172.21.15.102:6837","nonce":1668690087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/932475255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":932475255},{"type":"v1","addr":"172.21.15.102:6835","nonce":932475255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:55.340445+0000","modified":"2024-08-17T02:25:58.024448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/4026340784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4026340784},{"type":"v1","addr":"172.21.15.121:6835","nonce":4026340784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.925+0000 7f0283fff700 1 -- 172.21.15.102:0/3868501315 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0268060890 msgr2=0x7f0268062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.925+0000 7f0283fff700 1 --2- 172.21.15.102:0/3868501315 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0268060890 0x7f0268062d40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0284061060 tx=0x7f0274019000 comp rx=0 tx=0).stop 2024-08-17T02:26:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.925+0000 7f0283fff700 1 -- 172.21.15.102:0/3868501315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02840a9000 msgr2=0x7f02840635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.925+0000 7f0283fff700 1 --2- 172.21.15.102:0/3868501315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02840a9000 0x7f02840635d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f026c008880 tx=0x7f026c008c10 comp rx=0 tx=0).stop 2024-08-17T02:26:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.925+0000 7f0283fff700 1 -- 172.21.15.102:0/3868501315 shutdown_connections 2024-08-17T02:26:07.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.925+0000 7f0283fff700 1 --2- 172.21.15.102:0/3868501315 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0268060890 0x7f0268062d40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.925+0000 7f0283fff700 1 --2- 172.21.15.102:0/3868501315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02840a9000 0x7f02840635d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.925+0000 7f0283fff700 1 --2- 172.21.15.102:0/3868501315 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f02840a7650 0x7f02841704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.925+0000 7f0283fff700 1 --2- 172.21.15.102:0/3868501315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0284063200 0x7f02840a9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.925+0000 7f0283fff700 1 -- 172.21.15.102:0/3868501315 >> 172.21.15.102:0/3868501315 conn(0x7f02840678d0 msgr2=0x7f028415d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.925+0000 7f0283fff700 1 -- 172.21.15.102:0/3868501315 shutdown_connections 2024-08-17T02:26:07.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:07.925+0000 7f0283fff700 1 -- 172.21.15.102:0/3868501315 wait complete. 2024-08-17T02:26:07.929 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 6 2024-08-17T02:26:07.944 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:08.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60e01f4700 1 Processor -- start 2024-08-17T02:26:08.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60e01f4700 1 -- start start 2024-08-17T02:26:08.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60e01f4700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f60d8159810 0x7f60d80b3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60e01f4700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f60d80d0dd0 0x7f60d80cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60e01f4700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60d80cf3e0 con 0x7f60d80cef80 2024-08-17T02:26:08.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60e01f4700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d80c5c60 con 0x7f60d8159810 2024-08-17T02:26:08.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60e01f4700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d80ce120 con 0x7f60d80d0dd0 2024-08-17T02:26:08.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60ddf90700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f60d8159810 0x7f60d80b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60ddf90700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f60d8159810 0x7f60d80b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44544/0 (socket says 172.21.15.102:44544) 2024-08-17T02:26:08.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60ddf90700 1 -- 172.21.15.102:0/219249232 learned_addr learned my addr 172.21.15.102:0/219249232 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:08.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60dd78f700 1 --2- 172.21.15.102:0/219249232 >> v2:172.21.15.121:3300/0 conn(0x7f60d80d0dd0 0x7f60d80cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60ddf90700 1 -- 172.21.15.102:0/219249232 >> v2:172.21.15.121:3300/0 conn(0x7f60d80d0dd0 msgr2=0x7f60d80cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:08.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60ddf90700 1 --2- 172.21.15.102:0/219249232 >> v2:172.21.15.121:3300/0 conn(0x7f60d80d0dd0 0x7f60d80cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60ddf90700 1 -- 172.21.15.102:0/219249232 >> v1:172.21.15.102:6789/0 conn(0x7f60d80cef80 legacy=0x7f60d80c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60ddf90700 1 -- 172.21.15.102:0/219249232 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d80ce390 con 0x7f60d8159810 2024-08-17T02:26:08.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60ddf90700 1 --2- 172.21.15.102:0/219249232 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8159810 0x7f60d80b3270 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f60d806fae0 tx=0x7f60d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feea94a539e37ff5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60dcf8e700 1 -- 172.21.15.102:0/219249232 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d400b860 con 0x7f60d8159810 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60dcf8e700 1 -- 172.21.15.102:0/219249232 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d400b9c0 con 0x7f60d8159810 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60dcf8e700 1 -- 172.21.15.102:0/219249232 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d400bd60 con 0x7f60d8159810 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60e01f4700 1 -- 172.21.15.102:0/219249232 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8159810 msgr2=0x7f60d80b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60e01f4700 1 --2- 172.21.15.102:0/219249232 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8159810 0x7f60d80b3270 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f60d806fae0 tx=0x7f60d4009250 comp rx=0 tx=0).stop 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60e01f4700 1 -- 172.21.15.102:0/219249232 shutdown_connections 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60e01f4700 1 --2- 172.21.15.102:0/219249232 >> v2:172.21.15.121:3300/0 conn(0x7f60d80d0dd0 0x7f60d80cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60e01f4700 1 --2- 172.21.15.102:0/219249232 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8159810 0x7f60d80b3270 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60e01f4700 1 -- 172.21.15.102:0/219249232 >> 172.21.15.102:0/219249232 conn(0x7f60d8067590 msgr2=0x7f60d80d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60e01f4700 1 -- 172.21.15.102:0/219249232 shutdown_connections 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.049+0000 7f60e01f4700 1 -- 172.21.15.102:0/219249232 wait complete. 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60e01f4700 1 Processor -- start 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60e01f4700 1 -- start start 2024-08-17T02:26:08.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60e01f4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60d80cef80 0x7f60d815ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60e01f4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60d80d0dd0 0x7f60d80c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60e01f4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8159810 0x7f60d8142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60e01f4700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d8142d80 con 0x7f60d8159810 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60e01f4700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d80c7560 con 0x7f60d80cef80 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60e01f4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d80c7840 con 0x7f60d80d0dd0 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60de791700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8159810 0x7f60d8142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60de791700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8159810 0x7f60d8142840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44556/0 (socket says 172.21.15.102:44556) 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60de791700 1 -- 172.21.15.102:0/1735911927 learned_addr learned my addr 172.21.15.102:0/1735911927 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60ddf90700 1 --2- 172.21.15.102:0/1735911927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60d80cef80 0x7f60d815ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60dd78f700 1 --2- 172.21.15.102:0/1735911927 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60d80d0dd0 0x7f60d80c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60de791700 1 -- 172.21.15.102:0/1735911927 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60d80d0dd0 msgr2=0x7f60d80c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60de791700 1 --2- 172.21.15.102:0/1735911927 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60d80d0dd0 0x7f60d80c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60de791700 1 -- 172.21.15.102:0/1735911927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60d80cef80 msgr2=0x7f60d815ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60de791700 1 --2- 172.21.15.102:0/1735911927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60d80cef80 0x7f60d815ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60de791700 1 -- 172.21.15.102:0/1735911927 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d40094f0 con 0x7f60d8159810 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60de791700 1 --2- 172.21.15.102:0/1735911927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8159810 0x7f60d8142840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f60cc00c590 tx=0x7f60cc007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60c9ffb700 1 -- 172.21.15.102:0/1735911927 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc011590 con 0x7f60d8159810 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60c9ffb700 1 -- 172.21.15.102:0/1735911927 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc0116f0 con 0x7f60d8159810 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60e01f4700 1 -- 172.21.15.102:0/1735911927 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d815e4b0 con 0x7f60d8159810 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60c9ffb700 1 -- 172.21.15.102:0/1735911927 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc011ab0 con 0x7f60d8159810 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.053+0000 7f60e01f4700 1 -- 172.21.15.102:0/1735911927 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d815ea70 con 0x7f60d8159810 2024-08-17T02:26:08.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.057+0000 7f60e01f4700 1 -- 172.21.15.102:0/1735911927 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d80645c0 con 0x7f60d8159810 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.057+0000 7f60c9ffb700 1 -- 172.21.15.102:0/1735911927 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f60cc01b3b0 con 0x7f60d8159810 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.057+0000 7f60c9ffb700 1 --2- 172.21.15.102:0/1735911927 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f60bc060860 0x7f60bc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.057+0000 7f60c9ffb700 1 -- 172.21.15.102:0/1735911927 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f60cc07be70 con 0x7f60d8159810 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.057+0000 7f60ddf90700 1 --2- 172.21.15.102:0/1735911927 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f60bc060860 0x7f60bc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.057+0000 7f60ddf90700 1 --2- 172.21.15.102:0/1735911927 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f60bc060860 0x7f60bc062d10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f60d806fae0 tx=0x7f60d4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.065+0000 7f60c9ffb700 1 -- 172.21.15.102:0/1735911927 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f60cc04c2c0 con 0x7f60d8159810 2024-08-17T02:26:08.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.229+0000 7f60e01f4700 1 -- 172.21.15.102:0/1735911927 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60d80cf3e0 con 0x7f60d8159810 2024-08-17T02:26:08.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.229+0000 7f60c9ffb700 1 -- 172.21.15.102:0/1735911927 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f60d80cf3e0 con 0x7f60d8159810 2024-08-17T02:26:08.233 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:08.233 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:57.002263+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:53.562223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:54.343618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:08.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.233+0000 7f60e01f4700 1 -- 172.21.15.102:0/1735911927 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f60bc060860 msgr2=0x7f60bc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.233+0000 7f60e01f4700 1 --2- 172.21.15.102:0/1735911927 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f60bc060860 0x7f60bc062d10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f60d806fae0 tx=0x7f60d4017000 comp rx=0 tx=0).stop 2024-08-17T02:26:08.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.233+0000 7f60e01f4700 1 -- 172.21.15.102:0/1735911927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8159810 msgr2=0x7f60d8142840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.233+0000 7f60e01f4700 1 --2- 172.21.15.102:0/1735911927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8159810 0x7f60d8142840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f60cc00c590 tx=0x7f60cc007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.233+0000 7f60e01f4700 1 -- 172.21.15.102:0/1735911927 shutdown_connections 2024-08-17T02:26:08.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.233+0000 7f60e01f4700 1 --2- 172.21.15.102:0/1735911927 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f60bc060860 0x7f60bc062d10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.233+0000 7f60e01f4700 1 --2- 172.21.15.102:0/1735911927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8159810 0x7f60d8142840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.233+0000 7f60e01f4700 1 --2- 172.21.15.102:0/1735911927 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60d80d0dd0 0x7f60d80c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.233+0000 7f60e01f4700 1 --2- 172.21.15.102:0/1735911927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60d80cef80 0x7f60d815ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.233+0000 7f60e01f4700 1 -- 172.21.15.102:0/1735911927 >> 172.21.15.102:0/1735911927 conn(0x7f60d8067590 msgr2=0x7f60d80b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.233+0000 7f60e01f4700 1 -- 172.21.15.102:0/1735911927 shutdown_connections 2024-08-17T02:26:08.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.233+0000 7f60e01f4700 1 -- 172.21.15.102:0/1735911927 wait complete. 2024-08-17T02:26:08.247 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:49.236728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:53.562223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:54.343618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:08.247 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:08.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.353+0000 7f556a5e8700 1 Processor -- start 2024-08-17T02:26:08.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.353+0000 7f556a5e8700 1 -- start start 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f556a5e8700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5564158f90 0x7f556413c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f556a5e8700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5564159360 0x7f55640afc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f556a5e8700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5564069650 con 0x7f55640b0170 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f556a5e8700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55640687a0 con 0x7f5564159360 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f556a5e8700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5564068a40 con 0x7f5564158f90 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f5568de5700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5564159360 0x7f55640afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f5569de7700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f55640b0170 0x7f55640b0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57644/0 (socket says 172.21.15.102:57644) 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f5569de7700 1 -- 172.21.15.102:0/2234073673 learned_addr learned my addr 172.21.15.102:0/2234073673 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:08.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f55695e6700 1 --2- 172.21.15.102:0/2234073673 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5564158f90 0x7f556413c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f5568de5700 1 -- 172.21.15.102:0/2234073673 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5564158f90 msgr2=0x7f556413c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:08.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f5568de5700 1 --2- 172.21.15.102:0/2234073673 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5564158f90 0x7f556413c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f5568de5700 1 -- 172.21.15.102:0/2234073673 >> v1:172.21.15.102:6789/0 conn(0x7f55640b0170 legacy=0x7f55640b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f5557fff700 1 -- 172.21.15.102:0/2234073673 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779333124 0 0) 0x7f5564069650 con 0x7f55640b0170 2024-08-17T02:26:08.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f5568de5700 1 -- 172.21.15.102:0/2234073673 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5564068d20 con 0x7f5564159360 2024-08-17T02:26:08.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f5568de5700 1 --2- 172.21.15.102:0/2234073673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5564159360 0x7f55640afc30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5558009910 tx=0x7f55580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9650d7a651baef5c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f5557fff700 1 -- 172.21.15.102:0/2234073673 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555800b640 con 0x7f5564159360 2024-08-17T02:26:08.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f5557fff700 1 -- 172.21.15.102:0/2234073673 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555800b7a0 con 0x7f5564159360 2024-08-17T02:26:08.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.357+0000 7f5557fff700 1 -- 172.21.15.102:0/2234073673 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555800bb60 con 0x7f5564159360 2024-08-17T02:26:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.361+0000 7f556a5e8700 1 -- 172.21.15.102:0/2234073673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5564159360 msgr2=0x7f55640afc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.361+0000 7f556a5e8700 1 --2- 172.21.15.102:0/2234073673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5564159360 0x7f55640afc30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5558009910 tx=0x7f55580091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.361+0000 7f556a5e8700 1 -- 172.21.15.102:0/2234073673 shutdown_connections 2024-08-17T02:26:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.361+0000 7f556a5e8700 1 --2- 172.21.15.102:0/2234073673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5564159360 0x7f55640afc30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.361+0000 7f556a5e8700 1 --2- 172.21.15.102:0/2234073673 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5564158f90 0x7f556413c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.361+0000 7f556a5e8700 1 -- 172.21.15.102:0/2234073673 >> 172.21.15.102:0/2234073673 conn(0x7f55640ce990 msgr2=0x7f556406c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.361+0000 7f556a5e8700 1 -- 172.21.15.102:0/2234073673 shutdown_connections 2024-08-17T02:26:08.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.361+0000 7f556a5e8700 1 -- 172.21.15.102:0/2234073673 wait complete. 2024-08-17T02:26:08.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.361+0000 7f556a5e8700 1 Processor -- start 2024-08-17T02:26:08.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.361+0000 7f556a5e8700 1 -- start start 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.361+0000 7f556a5e8700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55640b0170 0x7f5564169a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.361+0000 7f556a5e8700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5564158f90 0x7f556415f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.361+0000 7f556a5e8700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5564159360 0x7f556413e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.361+0000 7f556a5e8700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556415f720 con 0x7f55640b0170 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.361+0000 7f556a5e8700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5564069e40 con 0x7f5564158f90 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.361+0000 7f556a5e8700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556413eee0 con 0x7f5564159360 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f55695e6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55640b0170 0x7f5564169a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f55695e6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55640b0170 0x7f5564169a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44570/0 (socket says 172.21.15.102:44570) 2024-08-17T02:26:08.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f55695e6700 1 -- 172.21.15.102:0/3161493261 learned_addr learned my addr 172.21.15.102:0/3161493261 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:08.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f5569de7700 1 --2- 172.21.15.102:0/3161493261 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5564159360 0x7f556413e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f5568de5700 1 --2- 172.21.15.102:0/3161493261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5564158f90 0x7f556415f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f55695e6700 1 -- 172.21.15.102:0/3161493261 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5564159360 msgr2=0x7f556413e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f55695e6700 1 --2- 172.21.15.102:0/3161493261 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5564159360 0x7f556413e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f55695e6700 1 -- 172.21.15.102:0/3161493261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5564158f90 msgr2=0x7f556415f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f55695e6700 1 --2- 172.21.15.102:0/3161493261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5564158f90 0x7f556415f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f55695e6700 1 -- 172.21.15.102:0/3161493261 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5558009420 con 0x7f55640b0170 2024-08-17T02:26:08.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f55695e6700 1 --2- 172.21.15.102:0/3161493261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55640b0170 0x7f5564169a30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f556000ec80 tx=0x7f55600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f55557fa700 1 -- 172.21.15.102:0/3161493261 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556000c850 con 0x7f55640b0170 2024-08-17T02:26:08.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f55557fa700 1 -- 172.21.15.102:0/3161493261 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556000c9b0 con 0x7f55640b0170 2024-08-17T02:26:08.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f556a5e8700 1 -- 172.21.15.102:0/3161493261 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f556415f160 con 0x7f55640b0170 2024-08-17T02:26:08.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f55557fa700 1 -- 172.21.15.102:0/3161493261 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556000cd50 con 0x7f55640b0170 2024-08-17T02:26:08.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f556a5e8700 1 -- 172.21.15.102:0/3161493261 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5564069ad0 con 0x7f55640b0170 2024-08-17T02:26:08.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.365+0000 7f556a5e8700 1 -- 172.21.15.102:0/3161493261 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5564069930 con 0x7f55640b0170 2024-08-17T02:26:08.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.369+0000 7f55557fa700 1 -- 172.21.15.102:0/3161493261 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5560013680 con 0x7f55640b0170 2024-08-17T02:26:08.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.369+0000 7f55557fa700 1 --2- 172.21.15.102:0/3161493261 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5548060890 0x7f5548062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.369+0000 7f55557fa700 1 -- 172.21.15.102:0/3161493261 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f556007ce70 con 0x7f55640b0170 2024-08-17T02:26:08.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.369+0000 7f5568de5700 1 --2- 172.21.15.102:0/3161493261 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5548060890 0x7f5548062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.369+0000 7f5568de5700 1 --2- 172.21.15.102:0/3161493261 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5548060890 0x7f5548062d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f55580091e0 tx=0x7f5558017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.377+0000 7f55557fa700 1 -- 172.21.15.102:0/3161493261 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5564069930 con 0x7f55640b0170 2024-08-17T02:26:08.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.533+0000 7f556a5e8700 1 -- 172.21.15.102:0/3161493261 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5564069930 con 0x7f55640b0170 2024-08-17T02:26:08.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.533+0000 7f55557fa700 1 -- 172.21.15.102:0/3161493261 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5564069930 con 0x7f55640b0170 2024-08-17T02:26:08.535 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-08-17T02:26:08.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.537+0000 7f556a5e8700 1 -- 172.21.15.102:0/3161493261 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5548060890 msgr2=0x7f5548062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.537+0000 7f556a5e8700 1 --2- 172.21.15.102:0/3161493261 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5548060890 0x7f5548062d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f55580091e0 tx=0x7f5558017000 comp rx=0 tx=0).stop 2024-08-17T02:26:08.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.537+0000 7f556a5e8700 1 -- 172.21.15.102:0/3161493261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55640b0170 msgr2=0x7f5564169a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.537+0000 7f556a5e8700 1 --2- 172.21.15.102:0/3161493261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55640b0170 0x7f5564169a30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f556000ec80 tx=0x7f55600091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.537+0000 7f556a5e8700 1 -- 172.21.15.102:0/3161493261 shutdown_connections 2024-08-17T02:26:08.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.537+0000 7f556a5e8700 1 --2- 172.21.15.102:0/3161493261 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5548060890 0x7f5548062d40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.537+0000 7f556a5e8700 1 --2- 172.21.15.102:0/3161493261 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5564159360 0x7f556413e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.537+0000 7f556a5e8700 1 --2- 172.21.15.102:0/3161493261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5564158f90 0x7f556415f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.537+0000 7f556a5e8700 1 --2- 172.21.15.102:0/3161493261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55640b0170 0x7f5564169a30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.537+0000 7f556a5e8700 1 -- 172.21.15.102:0/3161493261 >> 172.21.15.102:0/3161493261 conn(0x7f55640ce990 msgr2=0x7f5564159860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.537+0000 7f556a5e8700 1 -- 172.21.15.102:0/3161493261 shutdown_connections 2024-08-17T02:26:08.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.537+0000 7f556a5e8700 1 -- 172.21.15.102:0/3161493261 wait complete. 2024-08-17T02:26:08.555 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:08.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.661+0000 7fcc1759e700 1 Processor -- start 2024-08-17T02:26:08.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.661+0000 7fcc1759e700 1 -- start start 2024-08-17T02:26:08.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1759e700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcc180b1f70 0x7fcc180686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1759e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcc18068be0 0x7fcc18160b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1759e700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc18068fe0 con 0x7fcc18156fd0 2024-08-17T02:26:08.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1759e700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc180cb250 con 0x7fcc180b1f70 2024-08-17T02:26:08.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1759e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc180cb530 con 0x7fcc18068be0 2024-08-17T02:26:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1659c700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fcc18156fd0 0x7fcc180ca9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57648/0 (socket says 172.21.15.102:57648) 2024-08-17T02:26:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1659c700 1 -- 172.21.15.102:0/2107319935 learned_addr learned my addr 172.21.15.102:0/2107319935 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc15d9b700 1 --2- 172.21.15.102:0/2107319935 >> v2:172.21.15.102:3300/0 conn(0x7fcc180b1f70 0x7fcc180686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc16d9d700 1 --2- 172.21.15.102:0/2107319935 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcc18068be0 0x7fcc18160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1559a700 1 -- 172.21.15.102:0/2107319935 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693630610 0 0) 0x7fcc18068fe0 con 0x7fcc18156fd0 2024-08-17T02:26:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1559a700 1 -- 172.21.15.102:0/2107319935 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc04003570 con 0x7fcc18156fd0 2024-08-17T02:26:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc15d9b700 1 -- 172.21.15.102:0/2107319935 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcc18068be0 msgr2=0x7fcc18160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc15d9b700 1 --2- 172.21.15.102:0/2107319935 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcc18068be0 0x7fcc18160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc15d9b700 1 -- 172.21.15.102:0/2107319935 >> v1:172.21.15.102:6789/0 conn(0x7fcc18156fd0 legacy=0x7fcc180ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc15d9b700 1 -- 172.21.15.102:0/2107319935 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc180cb810 con 0x7fcc180b1f70 2024-08-17T02:26:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc16d9d700 1 --2- 172.21.15.102:0/2107319935 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcc18068be0 0x7fcc18160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc15d9b700 1 --2- 172.21.15.102:0/2107319935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc180b1f70 0x7fcc180686a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcc000098e0 tx=0x7fcc000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2623fe24f175101e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1559a700 1 -- 172.21.15.102:0/2107319935 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00011630 con 0x7fcc180b1f70 2024-08-17T02:26:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1559a700 1 -- 172.21.15.102:0/2107319935 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc00011790 con 0x7fcc180b1f70 2024-08-17T02:26:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1559a700 1 -- 172.21.15.102:0/2107319935 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00011b10 con 0x7fcc180b1f70 2024-08-17T02:26:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1759e700 1 -- 172.21.15.102:0/2107319935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc180b1f70 msgr2=0x7fcc180686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1759e700 1 --2- 172.21.15.102:0/2107319935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc180b1f70 0x7fcc180686a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcc000098e0 tx=0x7fcc000091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1759e700 1 -- 172.21.15.102:0/2107319935 shutdown_connections 2024-08-17T02:26:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1759e700 1 --2- 172.21.15.102:0/2107319935 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcc18068be0 0x7fcc18160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1759e700 1 --2- 172.21.15.102:0/2107319935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc180b1f70 0x7fcc180686a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1759e700 1 -- 172.21.15.102:0/2107319935 >> 172.21.15.102:0/2107319935 conn(0x7fcc1806e310 msgr2=0x7fcc1806b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1759e700 1 -- 172.21.15.102:0/2107319935 shutdown_connections 2024-08-17T02:26:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.665+0000 7fcc1759e700 1 -- 172.21.15.102:0/2107319935 wait complete. 2024-08-17T02:26:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.669+0000 7fcc1759e700 1 Processor -- start 2024-08-17T02:26:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.669+0000 7fcc1759e700 1 -- start start 2024-08-17T02:26:08.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.669+0000 7fcc1759e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc18068be0 0x7fcc18152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.669+0000 7fcc1759e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc180b1f70 0x7fcc1813acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.669+0000 7fcc1759e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcc18156fd0 0x7fcc1813b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc1759e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1813ba30 con 0x7fcc180b1f70 2024-08-17T02:26:08.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc1759e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1813bd10 con 0x7fcc18068be0 2024-08-17T02:26:08.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc1759e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1813bff0 con 0x7fcc18156fd0 2024-08-17T02:26:08.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc15d9b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc180b1f70 0x7fcc1813acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc1659c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc18068be0 0x7fcc18152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc15d9b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc180b1f70 0x7fcc1813acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44578/0 (socket says 172.21.15.102:44578) 2024-08-17T02:26:08.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc15d9b700 1 -- 172.21.15.102:0/1975812833 learned_addr learned my addr 172.21.15.102:0/1975812833 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:08.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc16d9d700 1 --2- 172.21.15.102:0/1975812833 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcc18156fd0 0x7fcc1813b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc15d9b700 1 -- 172.21.15.102:0/1975812833 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcc18156fd0 msgr2=0x7fcc1813b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc15d9b700 1 --2- 172.21.15.102:0/1975812833 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcc18156fd0 0x7fcc1813b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc15d9b700 1 -- 172.21.15.102:0/1975812833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc18068be0 msgr2=0x7fcc18152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc15d9b700 1 --2- 172.21.15.102:0/1975812833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc18068be0 0x7fcc18152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc15d9b700 1 -- 172.21.15.102:0/1975812833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc10009420 con 0x7fcc180b1f70 2024-08-17T02:26:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc15d9b700 1 --2- 172.21.15.102:0/1975812833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc180b1f70 0x7fcc1813acc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcc180693d0 tx=0x7fcc00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc0e7fc700 1 -- 172.21.15.102:0/1975812833 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00011b10 con 0x7fcc180b1f70 2024-08-17T02:26:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc0e7fc700 1 -- 172.21.15.102:0/1975812833 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc00000c90 con 0x7fcc180b1f70 2024-08-17T02:26:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc1759e700 1 -- 172.21.15.102:0/1975812833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc00009420 con 0x7fcc180b1f70 2024-08-17T02:26:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc0e7fc700 1 -- 172.21.15.102:0/1975812833 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0001a660 con 0x7fcc180b1f70 2024-08-17T02:26:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc1759e700 1 -- 172.21.15.102:0/1975812833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1813c5b0 con 0x7fcc180b1f70 2024-08-17T02:26:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc1759e700 1 -- 172.21.15.102:0/1975812833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1813c800 con 0x7fcc180b1f70 2024-08-17T02:26:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.673+0000 7fcc0e7fc700 1 -- 172.21.15.102:0/1975812833 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcc0001aa50 con 0x7fcc180b1f70 2024-08-17T02:26:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.677+0000 7fcc0e7fc700 1 --2- 172.21.15.102:0/1975812833 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcbf8060860 0x7fcbf8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.677+0000 7fcc0e7fc700 1 -- 172.21.15.102:0/1975812833 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc0007e7c0 con 0x7fcc180b1f70 2024-08-17T02:26:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.677+0000 7fcc1659c700 1 --2- 172.21.15.102:0/1975812833 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcbf8060860 0x7fcbf8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.677+0000 7fcc1659c700 1 --2- 172.21.15.102:0/1975812833 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcbf8060860 0x7fcbf8062d10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcc08005c50 tx=0x7fcc08009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.685+0000 7fcc0e7fc700 1 -- 172.21.15.102:0/1975812833 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcc0004ecd0 con 0x7fcc180b1f70 2024-08-17T02:26:08.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.845+0000 7fcc1759e700 1 -- 172.21.15.102:0/1975812833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcc180638f0 con 0x7fcc180b1f70 2024-08-17T02:26:08.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.845+0000 7fcc0e7fc700 1 -- 172.21.15.102:0/1975812833 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcc000522f0 con 0x7fcc180b1f70 2024-08-17T02:26:08.849 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-08-17T02:26:08.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.849+0000 7fcc1759e700 1 -- 172.21.15.102:0/1975812833 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcbf8060860 msgr2=0x7fcbf8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.849+0000 7fcc1759e700 1 --2- 172.21.15.102:0/1975812833 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcbf8060860 0x7fcbf8062d10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcc08005c50 tx=0x7fcc08009040 comp rx=0 tx=0).stop 2024-08-17T02:26:08.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.849+0000 7fcc1759e700 1 -- 172.21.15.102:0/1975812833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc180b1f70 msgr2=0x7fcc1813acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.849+0000 7fcc1759e700 1 --2- 172.21.15.102:0/1975812833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc180b1f70 0x7fcc1813acc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcc180693d0 tx=0x7fcc00017000 comp rx=0 tx=0).stop 2024-08-17T02:26:08.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.849+0000 7fcc1759e700 1 -- 172.21.15.102:0/1975812833 shutdown_connections 2024-08-17T02:26:08.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.849+0000 7fcc1759e700 1 --2- 172.21.15.102:0/1975812833 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcbf8060860 0x7fcbf8062d10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.849+0000 7fcc1759e700 1 --2- 172.21.15.102:0/1975812833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc180b1f70 0x7fcc1813acc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.849+0000 7fcc1759e700 1 --2- 172.21.15.102:0/1975812833 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcc18156fd0 0x7fcc1813b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.849+0000 7fcc1759e700 1 --2- 172.21.15.102:0/1975812833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc18068be0 0x7fcc18152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.849+0000 7fcc1759e700 1 -- 172.21.15.102:0/1975812833 >> 172.21.15.102:0/1975812833 conn(0x7fcc1806e310 msgr2=0x7fcc180ad120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.849+0000 7fcc1759e700 1 -- 172.21.15.102:0/1975812833 shutdown_connections 2024-08-17T02:26:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.849+0000 7fcc1759e700 1 -- 172.21.15.102:0/1975812833 wait complete. 2024-08-17T02:26:08.863 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:08.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.973+0000 7fe8a9b73700 1 Processor -- start 2024-08-17T02:26:08.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.973+0000 7fe8a9b73700 1 -- start start 2024-08-17T02:26:08.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.973+0000 7fe8a9b73700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe8a41596d0 0x7fe8a4066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.973+0000 7fe8a9b73700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe8a415dbc0 0x7fe8a4067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.973+0000 7fe8a9b73700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a40cba90 con 0x7fe8a4159300 2024-08-17T02:26:08.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.973+0000 7fe8a9b73700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a40b2b60 con 0x7fe8a415dbc0 2024-08-17T02:26:08.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.973+0000 7fe8a9b73700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a40b2940 con 0x7fe8a41596d0 2024-08-17T02:26:08.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a3fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe8a415dbc0 0x7fe8a4067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a3fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe8a415dbc0 0x7fe8a4067340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44584/0 (socket says 172.21.15.102:44584) 2024-08-17T02:26:08.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a3fff700 1 -- 172.21.15.102:0/1744073776 learned_addr learned my addr 172.21.15.102:0/1744073776 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:08.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a2ffd700 1 --2- 172.21.15.102:0/1744073776 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe8a41596d0 0x7fe8a4066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a3fff700 1 -- 172.21.15.102:0/1744073776 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe8a41596d0 msgr2=0x7fe8a4066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:08.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a3fff700 1 --2- 172.21.15.102:0/1744073776 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe8a41596d0 0x7fe8a4066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a3fff700 1 -- 172.21.15.102:0/1744073776 >> v1:172.21.15.102:6789/0 conn(0x7fe8a4159300 legacy=0x7fe8a40b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a3fff700 1 -- 172.21.15.102:0/1744073776 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a40cb160 con 0x7fe8a415dbc0 2024-08-17T02:26:08.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a3fff700 1 --2- 172.21.15.102:0/1744073776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8a415dbc0 0x7fe8a4067340 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe89c009f20 tx=0x7fe89c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f53e7f35e2be64 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a27fc700 1 -- 172.21.15.102:0/1744073776 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c00e070 con 0x7fe8a415dbc0 2024-08-17T02:26:08.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a27fc700 1 -- 172.21.15.102:0/1744073776 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c00ba80 con 0x7fe8a415dbc0 2024-08-17T02:26:08.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a27fc700 1 -- 172.21.15.102:0/1744073776 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c0092e0 con 0x7fe8a415dbc0 2024-08-17T02:26:08.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a9b73700 1 -- 172.21.15.102:0/1744073776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8a415dbc0 msgr2=0x7fe8a4067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a9b73700 1 --2- 172.21.15.102:0/1744073776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8a415dbc0 0x7fe8a4067340 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe89c009f20 tx=0x7fe89c009840 comp rx=0 tx=0).stop 2024-08-17T02:26:08.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a9b73700 1 -- 172.21.15.102:0/1744073776 shutdown_connections 2024-08-17T02:26:08.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a9b73700 1 --2- 172.21.15.102:0/1744073776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8a415dbc0 0x7fe8a4067340 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a9b73700 1 --2- 172.21.15.102:0/1744073776 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe8a41596d0 0x7fe8a4066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a9b73700 1 -- 172.21.15.102:0/1744073776 >> 172.21.15.102:0/1744073776 conn(0x7fe8a40682c0 msgr2=0x7fe8a40686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a9b73700 1 -- 172.21.15.102:0/1744073776 shutdown_connections 2024-08-17T02:26:08.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a9b73700 1 -- 172.21.15.102:0/1744073776 wait complete. 2024-08-17T02:26:08.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a9b73700 1 Processor -- start 2024-08-17T02:26:08.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a9b73700 1 -- start start 2024-08-17T02:26:08.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a9b73700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8a4159300 0x7fe8a40a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a9b73700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe8a41596d0 0x7fe8a414a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a9b73700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8a415dbc0 0x7fe8a415b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a9b73700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a416ba90 con 0x7fe8a415dbc0 2024-08-17T02:26:08.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a9b73700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a416ae80 con 0x7fe8a4159300 2024-08-17T02:26:08.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a9b73700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a416b160 con 0x7fe8a41596d0 2024-08-17T02:26:08.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a3fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8a415dbc0 0x7fe8a415b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a3fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8a415dbc0 0x7fe8a415b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44588/0 (socket says 172.21.15.102:44588) 2024-08-17T02:26:08.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.977+0000 7fe8a3fff700 1 -- 172.21.15.102:0/4107612831 learned_addr learned my addr 172.21.15.102:0/4107612831 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:08.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe8a2ffd700 1 --2- 172.21.15.102:0/4107612831 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe8a41596d0 0x7fe8a414a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe8a37fe700 1 --2- 172.21.15.102:0/4107612831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8a4159300 0x7fe8a40a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe8a3fff700 1 -- 172.21.15.102:0/4107612831 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe8a41596d0 msgr2=0x7fe8a414a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe8a3fff700 1 --2- 172.21.15.102:0/4107612831 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe8a41596d0 0x7fe8a414a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe8a3fff700 1 -- 172.21.15.102:0/4107612831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8a4159300 msgr2=0x7fe8a40a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe8a3fff700 1 --2- 172.21.15.102:0/4107612831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8a4159300 0x7fe8a40a6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe8a3fff700 1 -- 172.21.15.102:0/4107612831 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c009ae0 con 0x7fe8a415dbc0 2024-08-17T02:26:08.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe8a37fe700 1 --2- 172.21.15.102:0/4107612831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8a4159300 0x7fe8a40a6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:08.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe8a3fff700 1 --2- 172.21.15.102:0/4107612831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8a415dbc0 0x7fe8a415b5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00b6c0 tx=0x7fe89c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe88b7fe700 1 -- 172.21.15.102:0/4107612831 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c0092e0 con 0x7fe8a415dbc0 2024-08-17T02:26:08.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe88b7fe700 1 -- 172.21.15.102:0/4107612831 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c007ca0 con 0x7fe8a415dbc0 2024-08-17T02:26:08.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe8a9b73700 1 -- 172.21.15.102:0/4107612831 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a416b440 con 0x7fe8a415dbc0 2024-08-17T02:26:08.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe88b7fe700 1 -- 172.21.15.102:0/4107612831 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c01c640 con 0x7fe8a415dbc0 2024-08-17T02:26:08.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe8a9b73700 1 -- 172.21.15.102:0/4107612831 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a4167850 con 0x7fe8a415dbc0 2024-08-17T02:26:08.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe88b7fe700 1 -- 172.21.15.102:0/4107612831 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe89c003050 con 0x7fe8a415dbc0 2024-08-17T02:26:08.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe8a9b73700 1 -- 172.21.15.102:0/4107612831 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a416bc40 con 0x7fe8a415dbc0 2024-08-17T02:26:08.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe88b7fe700 1 --2- 172.21.15.102:0/4107612831 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe890060860 0x7fe890062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe88b7fe700 1 -- 172.21.15.102:0/4107612831 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe89c07e6e0 con 0x7fe8a415dbc0 2024-08-17T02:26:08.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.981+0000 7fe8a37fe700 1 --2- 172.21.15.102:0/4107612831 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe890060860 0x7fe890062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.985+0000 7fe8a37fe700 1 --2- 172.21.15.102:0/4107612831 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe890060860 0x7fe890062d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe898001840 tx=0x7fe898009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:08.989+0000 7fe88b7fe700 1 -- 172.21.15.102:0/4107612831 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe8a416bc40 con 0x7fe8a415dbc0 2024-08-17T02:26:09.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.157+0000 7fe8a9b73700 1 -- 172.21.15.102:0/4107612831 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8a40645c0 con 0x7fe8a415dbc0 2024-08-17T02:26:09.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.157+0000 7fe88b7fe700 1 -- 172.21.15.102:0/4107612831 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe89c04ea90 con 0x7fe8a415dbc0 2024-08-17T02:26:09.159 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-08-17T02:26:09.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.157+0000 7fe8a9b73700 1 -- 172.21.15.102:0/4107612831 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe890060860 msgr2=0x7fe890062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.157+0000 7fe8a9b73700 1 --2- 172.21.15.102:0/4107612831 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe890060860 0x7fe890062d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe898001840 tx=0x7fe898009040 comp rx=0 tx=0).stop 2024-08-17T02:26:09.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.157+0000 7fe8a9b73700 1 -- 172.21.15.102:0/4107612831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8a415dbc0 msgr2=0x7fe8a415b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.157+0000 7fe8a9b73700 1 --2- 172.21.15.102:0/4107612831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8a415dbc0 0x7fe8a415b5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00b6c0 tx=0x7fe89c018000 comp rx=0 tx=0).stop 2024-08-17T02:26:09.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.157+0000 7fe8a9b73700 1 -- 172.21.15.102:0/4107612831 shutdown_connections 2024-08-17T02:26:09.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.157+0000 7fe8a9b73700 1 --2- 172.21.15.102:0/4107612831 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe890060860 0x7fe890062d10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.157+0000 7fe8a9b73700 1 --2- 172.21.15.102:0/4107612831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8a415dbc0 0x7fe8a415b5a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.157+0000 7fe8a9b73700 1 --2- 172.21.15.102:0/4107612831 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe8a41596d0 0x7fe8a414a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.157+0000 7fe8a9b73700 1 --2- 172.21.15.102:0/4107612831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8a4159300 0x7fe8a40a6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.157+0000 7fe8a9b73700 1 -- 172.21.15.102:0/4107612831 >> 172.21.15.102:0/4107612831 conn(0x7fe8a40682c0 msgr2=0x7fe8a415cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.157+0000 7fe8a9b73700 1 -- 172.21.15.102:0/4107612831 shutdown_connections 2024-08-17T02:26:09.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.157+0000 7fe8a9b73700 1 -- 172.21.15.102:0/4107612831 wait complete. 2024-08-17T02:26:09.172 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:09.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.277+0000 7fe60572f700 1 Processor -- start 2024-08-17T02:26:09.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.277+0000 7fe60572f700 1 -- start start 2024-08-17T02:26:09.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.277+0000 7fe60572f700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe60006e620 0x7fe6000ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.277+0000 7fe60572f700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6000af2b0 con 0x7fe600155d20 2024-08-17T02:26:09.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.277+0000 7fe60572f700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6000af590 con 0x7fe6000b0350 2024-08-17T02:26:09.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.277+0000 7fe60572f700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6000b07a0 con 0x7fe60006e620 2024-08-17T02:26:09.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.277+0000 7fe604f2e700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe60006e620 0x7fe6000ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.277+0000 7fe5fffff700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe600155d20 0x7fe6000aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57662/0 (socket says 172.21.15.102:57662) 2024-08-17T02:26:09.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.277+0000 7fe604f2e700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe60006e620 0x7fe6000ad7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44592/0 (socket says 172.21.15.102:44592) 2024-08-17T02:26:09.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.277+0000 7fe5fffff700 1 -- 172.21.15.102:0/2052259747 learned_addr learned my addr 172.21.15.102:0/2052259747 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:09.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe604f2e700 1 -- 172.21.15.102:0/2052259747 >> v1:172.21.15.121:6789/0 conn(0x7fe6000b0350 legacy=0x7fe60006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe604f2e700 1 -- 172.21.15.102:0/2052259747 >> v1:172.21.15.102:6789/0 conn(0x7fe600155d20 legacy=0x7fe6000aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe5feffd700 1 -- 172.21.15.102:0/2052259747 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780551378 0 0) 0x7fe6000af2b0 con 0x7fe600155d20 2024-08-17T02:26:09.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe604f2e700 1 -- 172.21.15.102:0/2052259747 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6000af870 con 0x7fe60006e620 2024-08-17T02:26:09.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe604f2e700 1 --2- 172.21.15.102:0/2052259747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe60006e620 0x7fe6000ad7c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009e60 tx=0x7fe5f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c743b5be3f961fce server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe5feffd700 1 -- 172.21.15.102:0/2052259747 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800e070 con 0x7fe60006e620 2024-08-17T02:26:09.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe5feffd700 1 -- 172.21.15.102:0/2052259747 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f800bc30 con 0x7fe60006e620 2024-08-17T02:26:09.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe5feffd700 1 -- 172.21.15.102:0/2052259747 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8012430 con 0x7fe60006e620 2024-08-17T02:26:09.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe60572f700 1 -- 172.21.15.102:0/2052259747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe60006e620 msgr2=0x7fe6000ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe60572f700 1 --2- 172.21.15.102:0/2052259747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe60006e620 0x7fe6000ad7c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009e60 tx=0x7fe5f8009780 comp rx=0 tx=0).stop 2024-08-17T02:26:09.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe60572f700 1 -- 172.21.15.102:0/2052259747 shutdown_connections 2024-08-17T02:26:09.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe60572f700 1 --2- 172.21.15.102:0/2052259747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe60006e620 0x7fe6000ad7c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe60572f700 1 -- 172.21.15.102:0/2052259747 >> 172.21.15.102:0/2052259747 conn(0x7fe6000678d0 msgr2=0x7fe600067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe60572f700 1 -- 172.21.15.102:0/2052259747 shutdown_connections 2024-08-17T02:26:09.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe60572f700 1 -- 172.21.15.102:0/2052259747 wait complete. 2024-08-17T02:26:09.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe60572f700 1 Processor -- start 2024-08-17T02:26:09.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.281+0000 7fe60572f700 1 -- start start 2024-08-17T02:26:09.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe60572f700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe60006e620 0x7fe600166e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe60572f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6000b0350 0x7fe6001429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe60572f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe600155d20 0x7fe600142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe60572f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600149b40 con 0x7fe600155d20 2024-08-17T02:26:09.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe60572f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600149e20 con 0x7fe6000b0350 2024-08-17T02:26:09.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe60572f700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60014a100 con 0x7fe60006e620 2024-08-17T02:26:09.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe604f2e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe600155d20 0x7fe600142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe604f2e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe600155d20 0x7fe600142f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44604/0 (socket says 172.21.15.102:44604) 2024-08-17T02:26:09.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe604f2e700 1 -- 172.21.15.102:0/2202786813 learned_addr learned my addr 172.21.15.102:0/2202786813 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:09.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe5fffff700 1 --2- 172.21.15.102:0/2202786813 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe60006e620 0x7fe600166e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe5ff7fe700 1 --2- 172.21.15.102:0/2202786813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6000b0350 0x7fe6001429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe604f2e700 1 -- 172.21.15.102:0/2202786813 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe60006e620 msgr2=0x7fe600166e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe604f2e700 1 --2- 172.21.15.102:0/2202786813 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe60006e620 0x7fe600166e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe604f2e700 1 -- 172.21.15.102:0/2202786813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6000b0350 msgr2=0x7fe6001429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe604f2e700 1 --2- 172.21.15.102:0/2202786813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6000b0350 0x7fe6001429d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe604f2e700 1 -- 172.21.15.102:0/2202786813 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8009a20 con 0x7fe600155d20 2024-08-17T02:26:09.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe604f2e700 1 --2- 172.21.15.102:0/2202786813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe600155d20 0x7fe600142f10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80099f0 tx=0x7fe5f8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe5f7fff700 1 -- 172.21.15.102:0/2202786813 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8012e10 con 0x7fe600155d20 2024-08-17T02:26:09.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe5f7fff700 1 -- 172.21.15.102:0/2202786813 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f801d630 con 0x7fe600155d20 2024-08-17T02:26:09.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe60572f700 1 -- 172.21.15.102:0/2202786813 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60014a3e0 con 0x7fe600155d20 2024-08-17T02:26:09.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe5f7fff700 1 -- 172.21.15.102:0/2202786813 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f801d9f0 con 0x7fe600155d20 2024-08-17T02:26:09.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe60572f700 1 -- 172.21.15.102:0/2202786813 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6001673a0 con 0x7fe600155d20 2024-08-17T02:26:09.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe60572f700 1 -- 172.21.15.102:0/2202786813 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60014a8e0 con 0x7fe600155d20 2024-08-17T02:26:09.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.285+0000 7fe5f7fff700 1 -- 172.21.15.102:0/2202786813 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe5f8024070 con 0x7fe600155d20 2024-08-17T02:26:09.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.289+0000 7fe5f7fff700 1 --2- 172.21.15.102:0/2202786813 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe5e4060860 0x7fe5e4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.289+0000 7fe5f7fff700 1 -- 172.21.15.102:0/2202786813 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5f807f4f0 con 0x7fe600155d20 2024-08-17T02:26:09.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.289+0000 7fe5fffff700 1 --2- 172.21.15.102:0/2202786813 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe5e4060860 0x7fe5e4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.289+0000 7fe5fffff700 1 --2- 172.21.15.102:0/2202786813 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe5e4060860 0x7fe5e4062d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0007fd0 tx=0x7fe5f0007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.297+0000 7fe5f7fff700 1 -- 172.21.15.102:0/2202786813 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe5f804f940 con 0x7fe600155d20 2024-08-17T02:26:09.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.497+0000 7fe60572f700 1 -- 172.21.15.102:0/2202786813 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6000643a0 con 0x7fe600155d20 2024-08-17T02:26:09.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.497+0000 7fe5f7fff700 1 -- 172.21.15.102:0/2202786813 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fe5f802c090 con 0x7fe600155d20 2024-08-17T02:26:09.500 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:09.501 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/3384500830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3384500830},{"type":"v1","addr":"172.21.15.121:6833","nonce":3384500830}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1668690087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1668690087},{"type":"v1","addr":"172.21.15.102:6837","nonce":1668690087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/932475255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":932475255},{"type":"v1","addr":"172.21.15.102:6835","nonce":932475255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:55.340445+0000","modified":"2024-08-17T02:25:58.024448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/4026340784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4026340784},{"type":"v1","addr":"172.21.15.121:6835","nonce":4026340784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:09.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.501+0000 7fe60572f700 1 -- 172.21.15.102:0/2202786813 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe5e4060860 msgr2=0x7fe5e4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.501+0000 7fe60572f700 1 --2- 172.21.15.102:0/2202786813 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe5e4060860 0x7fe5e4062d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0007fd0 tx=0x7fe5f0007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:09.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.501+0000 7fe60572f700 1 -- 172.21.15.102:0/2202786813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe600155d20 msgr2=0x7fe600142f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.501+0000 7fe60572f700 1 --2- 172.21.15.102:0/2202786813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe600155d20 0x7fe600142f10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80099f0 tx=0x7fe5f8019000 comp rx=0 tx=0).stop 2024-08-17T02:26:09.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.501+0000 7fe60572f700 1 -- 172.21.15.102:0/2202786813 shutdown_connections 2024-08-17T02:26:09.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.501+0000 7fe60572f700 1 --2- 172.21.15.102:0/2202786813 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe5e4060860 0x7fe5e4062d10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.501+0000 7fe60572f700 1 --2- 172.21.15.102:0/2202786813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe600155d20 0x7fe600142f10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.501+0000 7fe60572f700 1 --2- 172.21.15.102:0/2202786813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6000b0350 0x7fe6001429d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.501+0000 7fe60572f700 1 --2- 172.21.15.102:0/2202786813 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe60006e620 0x7fe600166e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.501+0000 7fe60572f700 1 -- 172.21.15.102:0/2202786813 >> 172.21.15.102:0/2202786813 conn(0x7fe6000678d0 msgr2=0x7fe600069ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.501+0000 7fe60572f700 1 -- 172.21.15.102:0/2202786813 shutdown_connections 2024-08-17T02:26:09.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.501+0000 7fe60572f700 1 -- 172.21.15.102:0/2202786813 wait complete. 2024-08-17T02:26:09.504 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 6 2024-08-17T02:26:09.514 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:09.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdc05774700 1 Processor -- start 2024-08-17T02:26:09.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdc05774700 1 -- start start 2024-08-17T02:26:09.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdc05774700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdc00155380 0x7fdc000a9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdc05774700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdc00159300 0x7fdc00159760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdc05774700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc000a9f60 con 0x7fdc00159ca0 2024-08-17T02:26:09.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdc05774700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0006e4b0 con 0x7fdc00159300 2024-08-17T02:26:09.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdc05774700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0015a0e0 con 0x7fdc00155380 2024-08-17T02:26:09.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdbfe7fc700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdc00159300 0x7fdc00159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdbff7fe700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fdc00159ca0 0x7fdc000af5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57666/0 (socket says 172.21.15.102:57666) 2024-08-17T02:26:09.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdbff7fe700 1 -- 172.21.15.102:0/4218198937 learned_addr learned my addr 172.21.15.102:0/4218198937 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:09.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdbfeffd700 1 --2- 172.21.15.102:0/4218198937 >> v2:172.21.15.121:3300/0 conn(0x7fdc00155380 0x7fdc000a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdbfe7fc700 1 -- 172.21.15.102:0/4218198937 >> v2:172.21.15.121:3300/0 conn(0x7fdc00155380 msgr2=0x7fdc000a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdbfe7fc700 1 --2- 172.21.15.102:0/4218198937 >> v2:172.21.15.121:3300/0 conn(0x7fdc00155380 0x7fdc000a9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdbfe7fc700 1 -- 172.21.15.102:0/4218198937 >> v1:172.21.15.102:6789/0 conn(0x7fdc00159ca0 legacy=0x7fdc000af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdbfe7fc700 1 -- 172.21.15.102:0/4218198937 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0006e6a0 con 0x7fdc00159300 2024-08-17T02:26:09.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdbfdffb700 1 -- 172.21.15.102:0/4218198937 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911197124 0 0) 0x7fdc000a9f60 con 0x7fdc00159ca0 2024-08-17T02:26:09.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdbfe7fc700 1 --2- 172.21.15.102:0/4218198937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc00159300 0x7fdc00159760 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdc0006b2d0 tx=0x7fdbf0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995498d71cacdd9e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdbfdffb700 1 -- 172.21.15.102:0/4218198937 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf000e070 con 0x7fdc00159300 2024-08-17T02:26:09.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdbfdffb700 1 -- 172.21.15.102:0/4218198937 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf000bb60 con 0x7fdc00159300 2024-08-17T02:26:09.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdbfdffb700 1 -- 172.21.15.102:0/4218198937 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0012430 con 0x7fdc00159300 2024-08-17T02:26:09.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdc05774700 1 -- 172.21.15.102:0/4218198937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc00159300 msgr2=0x7fdc00159760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdc05774700 1 --2- 172.21.15.102:0/4218198937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc00159300 0x7fdc00159760 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdc0006b2d0 tx=0x7fdbf0009780 comp rx=0 tx=0).stop 2024-08-17T02:26:09.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdc05774700 1 -- 172.21.15.102:0/4218198937 shutdown_connections 2024-08-17T02:26:09.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdc05774700 1 --2- 172.21.15.102:0/4218198937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc00159300 0x7fdc00159760 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdc05774700 1 --2- 172.21.15.102:0/4218198937 >> v2:172.21.15.121:3300/0 conn(0x7fdc00155380 0x7fdc000a9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdc05774700 1 -- 172.21.15.102:0/4218198937 >> 172.21.15.102:0/4218198937 conn(0x7fdc00066e00 msgr2=0x7fdc00067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdc05774700 1 -- 172.21.15.102:0/4218198937 shutdown_connections 2024-08-17T02:26:09.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.621+0000 7fdc05774700 1 -- 172.21.15.102:0/4218198937 wait complete. 2024-08-17T02:26:09.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdc05774700 1 Processor -- start 2024-08-17T02:26:09.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdc05774700 1 -- start start 2024-08-17T02:26:09.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdc05774700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdc00155380 0x7fdc0014ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdc05774700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc00159300 0x7fdc00154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdc05774700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc00159ca0 0x7fdc001546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdc05774700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc00097ae0 con 0x7fdc00159300 2024-08-17T02:26:09.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdc05774700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0014b150 con 0x7fdc00159ca0 2024-08-17T02:26:09.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdc05774700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc00096ed0 con 0x7fdc00155380 2024-08-17T02:26:09.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdbfe7fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc00159300 0x7fdc00154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdbfe7fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc00159300 0x7fdc00154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44610/0 (socket says 172.21.15.102:44610) 2024-08-17T02:26:09.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdbfe7fc700 1 -- 172.21.15.102:0/3356459226 learned_addr learned my addr 172.21.15.102:0/3356459226 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:09.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdbfeffd700 1 --2- 172.21.15.102:0/3356459226 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdc00155380 0x7fdc0014ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdbff7fe700 1 --2- 172.21.15.102:0/3356459226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc00159ca0 0x7fdc001546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdbfe7fc700 1 -- 172.21.15.102:0/3356459226 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdc00155380 msgr2=0x7fdc0014ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdbfe7fc700 1 --2- 172.21.15.102:0/3356459226 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdc00155380 0x7fdc0014ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdbfe7fc700 1 -- 172.21.15.102:0/3356459226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc00159ca0 msgr2=0x7fdc001546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdbfe7fc700 1 --2- 172.21.15.102:0/3356459226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc00159ca0 0x7fdc001546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdbfe7fc700 1 -- 172.21.15.102:0/3356459226 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf0009a20 con 0x7fdc00159300 2024-08-17T02:26:09.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdbfe7fc700 1 --2- 172.21.15.102:0/3356459226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc00159300 0x7fdc00154160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0009fd0 tx=0x7fdbf0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdbe6ffd700 1 -- 172.21.15.102:0/3356459226 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0012df0 con 0x7fdc00159300 2024-08-17T02:26:09.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdbe6ffd700 1 -- 172.21.15.102:0/3356459226 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf0027470 con 0x7fdc00159300 2024-08-17T02:26:09.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdbe6ffd700 1 -- 172.21.15.102:0/3356459226 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0027830 con 0x7fdc00159300 2024-08-17T02:26:09.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdc05774700 1 -- 172.21.15.102:0/3356459226 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc000971b0 con 0x7fdc00159300 2024-08-17T02:26:09.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.625+0000 7fdc05774700 1 -- 172.21.15.102:0/3356459226 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc00097770 con 0x7fdc00159300 2024-08-17T02:26:09.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.629+0000 7fdc05774700 1 -- 172.21.15.102:0/3356459226 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc000645c0 con 0x7fdc00159300 2024-08-17T02:26:09.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.629+0000 7fdbe6ffd700 1 -- 172.21.15.102:0/3356459226 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fdbf0024070 con 0x7fdc00159300 2024-08-17T02:26:09.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.629+0000 7fdbe6ffd700 1 --2- 172.21.15.102:0/3356459226 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fdbec060860 0x7fdbec062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.629+0000 7fdbe6ffd700 1 -- 172.21.15.102:0/3356459226 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdbf007f560 con 0x7fdc00159300 2024-08-17T02:26:09.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.629+0000 7fdbfeffd700 1 --2- 172.21.15.102:0/3356459226 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fdbec060860 0x7fdbec062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.629+0000 7fdbfeffd700 1 --2- 172.21.15.102:0/3356459226 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fdbec060860 0x7fdbec062d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009ca0 tx=0x7fdbf4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.637+0000 7fdbe6ffd700 1 -- 172.21.15.102:0/3356459226 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fdbf004f9b0 con 0x7fdc00159300 2024-08-17T02:26:09.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.801+0000 7fdc05774700 1 -- 172.21.15.102:0/3356459226 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc00070a00 con 0x7fdc00159300 2024-08-17T02:26:09.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.801+0000 7fdbe6ffd700 1 -- 172.21.15.102:0/3356459226 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fdbf0052fd0 con 0x7fdc00159300 2024-08-17T02:26:09.804 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:09.804 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:57.002263+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:53.562223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:54.343618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:09.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.805+0000 7fdc05774700 1 -- 172.21.15.102:0/3356459226 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fdbec060860 msgr2=0x7fdbec062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.805+0000 7fdc05774700 1 --2- 172.21.15.102:0/3356459226 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fdbec060860 0x7fdbec062d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009ca0 tx=0x7fdbf4008040 comp rx=0 tx=0).stop 2024-08-17T02:26:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.805+0000 7fdc05774700 1 -- 172.21.15.102:0/3356459226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc00159300 msgr2=0x7fdc00154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.805+0000 7fdc05774700 1 --2- 172.21.15.102:0/3356459226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc00159300 0x7fdc00154160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0009fd0 tx=0x7fdbf0019000 comp rx=0 tx=0).stop 2024-08-17T02:26:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.805+0000 7fdc05774700 1 -- 172.21.15.102:0/3356459226 shutdown_connections 2024-08-17T02:26:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.805+0000 7fdc05774700 1 --2- 172.21.15.102:0/3356459226 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fdbec060860 0x7fdbec062d10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.805+0000 7fdc05774700 1 --2- 172.21.15.102:0/3356459226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc00159300 0x7fdc00154160 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.805+0000 7fdc05774700 1 --2- 172.21.15.102:0/3356459226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc00159ca0 0x7fdc001546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.805+0000 7fdc05774700 1 --2- 172.21.15.102:0/3356459226 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdc00155380 0x7fdc0014ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.805+0000 7fdc05774700 1 -- 172.21.15.102:0/3356459226 >> 172.21.15.102:0/3356459226 conn(0x7fdc00066e00 msgr2=0x7fdc000ae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.805+0000 7fdc05774700 1 -- 172.21.15.102:0/3356459226 shutdown_connections 2024-08-17T02:26:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.805+0000 7fdc05774700 1 -- 172.21.15.102:0/3356459226 wait complete. 2024-08-17T02:26:09.818 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:09.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.921+0000 7f6573664700 1 Processor -- start 2024-08-17T02:26:09.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.921+0000 7f6573664700 1 -- start start 2024-08-17T02:26:09.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6573664700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f656c0ace80 0x7f656c157350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6573664700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f656c157890 0x7f656c0aab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6573664700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656c0adf50 con 0x7f656c156f80 2024-08-17T02:26:09.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6573664700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f656c0ad340 con 0x7f656c0ace80 2024-08-17T02:26:09.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6573664700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656c0ad620 con 0x7f656c157890 2024-08-17T02:26:09.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6570bff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f656c0ace80 0x7f656c157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6570bff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f656c0ace80 0x7f656c157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44624/0 (socket says 172.21.15.102:44624) 2024-08-17T02:26:09.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6570bff700 1 -- 172.21.15.102:0/159345656 learned_addr learned my addr 172.21.15.102:0/159345656 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:09.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6571c01700 1 --2- 172.21.15.102:0/159345656 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f656c157890 0x7f656c0aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6570bff700 1 -- 172.21.15.102:0/159345656 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f656c157890 msgr2=0x7f656c0aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6570bff700 1 --2- 172.21.15.102:0/159345656 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f656c157890 0x7f656c0aab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6570bff700 1 -- 172.21.15.102:0/159345656 >> v1:172.21.15.121:6789/0 conn(0x7f656c156f80 legacy=0x7f656c0ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6570bff700 1 -- 172.21.15.102:0/159345656 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c0ad900 con 0x7f656c0ace80 2024-08-17T02:26:09.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6570bff700 1 --2- 172.21.15.102:0/159345656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f656c0ace80 0x7f656c157350 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f65680099e0 tx=0x7f6568009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443cc78353ab0175 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6563fff700 1 -- 172.21.15.102:0/159345656 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800b820 con 0x7f656c0ace80 2024-08-17T02:26:09.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6563fff700 1 -- 172.21.15.102:0/159345656 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656800b980 con 0x7f656c0ace80 2024-08-17T02:26:09.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6563fff700 1 -- 172.21.15.102:0/159345656 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800bd20 con 0x7f656c0ace80 2024-08-17T02:26:09.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6573664700 1 -- 172.21.15.102:0/159345656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f656c0ace80 msgr2=0x7f656c157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6573664700 1 --2- 172.21.15.102:0/159345656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f656c0ace80 0x7f656c157350 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f65680099e0 tx=0x7f6568009250 comp rx=0 tx=0).stop 2024-08-17T02:26:09.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6573664700 1 -- 172.21.15.102:0/159345656 shutdown_connections 2024-08-17T02:26:09.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6573664700 1 --2- 172.21.15.102:0/159345656 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f656c157890 0x7f656c0aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6573664700 1 --2- 172.21.15.102:0/159345656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f656c0ace80 0x7f656c157350 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6573664700 1 -- 172.21.15.102:0/159345656 >> 172.21.15.102:0/159345656 conn(0x7f656c066e00 msgr2=0x7f656c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6573664700 1 -- 172.21.15.102:0/159345656 shutdown_connections 2024-08-17T02:26:09.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.925+0000 7f6573664700 1 -- 172.21.15.102:0/159345656 wait complete. 2024-08-17T02:26:09.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6573664700 1 Processor -- start 2024-08-17T02:26:09.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6573664700 1 -- start start 2024-08-17T02:26:09.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6573664700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f656c0ace80 0x7f656c14e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6573664700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f656c156f80 0x7f656c14f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6573664700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f656c157890 0x7f656c06a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6573664700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c14d070 con 0x7f656c156f80 2024-08-17T02:26:09.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6573664700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c14e970 con 0x7f656c0ace80 2024-08-17T02:26:09.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6573664700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656c096fb0 con 0x7f656c157890 2024-08-17T02:26:09.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6570bff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f656c156f80 0x7f656c14f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6570bff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f656c156f80 0x7f656c14f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44626/0 (socket says 172.21.15.102:44626) 2024-08-17T02:26:09.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6570bff700 1 -- 172.21.15.102:0/876557937 learned_addr learned my addr 172.21.15.102:0/876557937 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:09.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6571c01700 1 --2- 172.21.15.102:0/876557937 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f656c157890 0x7f656c06a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6571400700 1 --2- 172.21.15.102:0/876557937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f656c0ace80 0x7f656c14e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6570bff700 1 -- 172.21.15.102:0/876557937 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f656c157890 msgr2=0x7f656c06a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6570bff700 1 --2- 172.21.15.102:0/876557937 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f656c157890 0x7f656c06a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6570bff700 1 -- 172.21.15.102:0/876557937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f656c0ace80 msgr2=0x7f656c14e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6570bff700 1 --2- 172.21.15.102:0/876557937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f656c0ace80 0x7f656c14e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6570bff700 1 -- 172.21.15.102:0/876557937 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65680094f0 con 0x7f656c156f80 2024-08-17T02:26:09.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6571400700 1 --2- 172.21.15.102:0/876557937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f656c0ace80 0x7f656c14e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:09.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6570bff700 1 --2- 172.21.15.102:0/876557937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f656c156f80 0x7f656c14f0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6568006fd0 tx=0x7f6568017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f65617fa700 1 -- 172.21.15.102:0/876557937 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568011de0 con 0x7f656c156f80 2024-08-17T02:26:09.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f65617fa700 1 -- 172.21.15.102:0/876557937 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6568024440 con 0x7f656c156f80 2024-08-17T02:26:09.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f65617fa700 1 -- 172.21.15.102:0/876557937 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568024800 con 0x7f656c156f80 2024-08-17T02:26:09.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6573664700 1 -- 172.21.15.102:0/876557937 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f656c097290 con 0x7f656c156f80 2024-08-17T02:26:09.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.929+0000 7f6573664700 1 -- 172.21.15.102:0/876557937 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656c097850 con 0x7f656c156f80 2024-08-17T02:26:09.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.933+0000 7f6573664700 1 -- 172.21.15.102:0/876557937 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f656c0645c0 con 0x7f656c156f80 2024-08-17T02:26:09.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.933+0000 7f65617fa700 1 -- 172.21.15.102:0/876557937 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f656801a420 con 0x7f656c156f80 2024-08-17T02:26:09.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.933+0000 7f65617fa700 1 --2- 172.21.15.102:0/876557937 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6550060860 0x7f6550062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.933+0000 7f65617fa700 1 -- 172.21.15.102:0/876557937 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f656807e990 con 0x7f656c156f80 2024-08-17T02:26:09.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.933+0000 7f6571400700 1 --2- 172.21.15.102:0/876557937 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6550060860 0x7f6550062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.933+0000 7f6571400700 1 --2- 172.21.15.102:0/876557937 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6550060860 0x7f6550062d10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f655c007fd0 tx=0x7f655c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:09.941+0000 7f65617fa700 1 -- 172.21.15.102:0/876557937 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f656804ed40 con 0x7f656c156f80 2024-08-17T02:26:10.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.137+0000 7f6573664700 1 -- 172.21.15.102:0/876557937 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f656c158810 con 0x7f656c156f80 2024-08-17T02:26:10.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.137+0000 7f65617fa700 1 -- 172.21.15.102:0/876557937 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f6568015090 con 0x7f656c156f80 2024-08-17T02:26:10.141 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:10.141 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/3384500830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3384500830},{"type":"v1","addr":"172.21.15.121:6833","nonce":3384500830}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1668690087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1668690087},{"type":"v1","addr":"172.21.15.102:6837","nonce":1668690087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/932475255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":932475255},{"type":"v1","addr":"172.21.15.102:6835","nonce":932475255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:55.340445+0000","modified":"2024-08-17T02:25:58.024448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/4026340784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4026340784},{"type":"v1","addr":"172.21.15.121:6835","nonce":4026340784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.141+0000 7f6573664700 1 -- 172.21.15.102:0/876557937 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6550060860 msgr2=0x7f6550062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.141+0000 7f6573664700 1 --2- 172.21.15.102:0/876557937 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6550060860 0x7f6550062d10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f655c007fd0 tx=0x7f655c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.141+0000 7f6573664700 1 -- 172.21.15.102:0/876557937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f656c156f80 msgr2=0x7f656c14f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.141+0000 7f6573664700 1 --2- 172.21.15.102:0/876557937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f656c156f80 0x7f656c14f0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6568006fd0 tx=0x7f6568017000 comp rx=0 tx=0).stop 2024-08-17T02:26:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.141+0000 7f6573664700 1 -- 172.21.15.102:0/876557937 shutdown_connections 2024-08-17T02:26:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.141+0000 7f6573664700 1 --2- 172.21.15.102:0/876557937 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6550060860 0x7f6550062d10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.141+0000 7f6573664700 1 --2- 172.21.15.102:0/876557937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f656c156f80 0x7f656c14f0a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.141+0000 7f6573664700 1 --2- 172.21.15.102:0/876557937 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f656c157890 0x7f656c06a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.141+0000 7f6573664700 1 --2- 172.21.15.102:0/876557937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f656c0ace80 0x7f656c14e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.141+0000 7f6573664700 1 -- 172.21.15.102:0/876557937 >> 172.21.15.102:0/876557937 conn(0x7f656c066e00 msgr2=0x7f656c0a95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.141+0000 7f6573664700 1 -- 172.21.15.102:0/876557937 shutdown_connections 2024-08-17T02:26:10.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.141+0000 7f6573664700 1 -- 172.21.15.102:0/876557937 wait complete. 2024-08-17T02:26:10.145 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 6 2024-08-17T02:26:10.558 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:25:55.340445+0000', 'modified': '2024-08-17T02:25:58.024448+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6835/4026340784', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 4026340784}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 4026340784}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:26:10.558 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:26:10.559 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-17T02:26:10.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.673+0000 7f9b9a49c700 1 Processor -- start 2024-08-17T02:26:10.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.673+0000 7f9b9a49c700 1 -- start start 2024-08-17T02:26:10.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.673+0000 7f9b9a49c700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9b94155d20 0x7f9b940b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.673+0000 7f9b9a49c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9b940ad7c0 0x7f9b940aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.673+0000 7f9b9a49c700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b9406df10 0x7f9b9406e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.673+0000 7f9b9a49c700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b940adc10 con 0x7f9b94155d20 2024-08-17T02:26:10.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.673+0000 7f9b9a49c700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9406e8b0 con 0x7f9b940ad7c0 2024-08-17T02:26:10.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.673+0000 7f9b9a49c700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b940af2b0 con 0x7f9b9406df10 2024-08-17T02:26:10.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9949a700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9b94155d20 0x7f9b940b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9949a700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9b94155d20 0x7f9b940b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44638/0 (socket says 172.21.15.102:44638) 2024-08-17T02:26:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9949a700 1 -- 172.21.15.102:0/1260617436 learned_addr learned my addr 172.21.15.102:0/1260617436 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b99c9b700 1 --2- 172.21.15.102:0/1260617436 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b9406df10 0x7f9b9406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b98c99700 1 --2- 172.21.15.102:0/1260617436 >> v2:172.21.15.121:3300/0 conn(0x7f9b940ad7c0 0x7f9b940aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9949a700 1 -- 172.21.15.102:0/1260617436 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b9406df10 msgr2=0x7f9b9406e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9949a700 1 --2- 172.21.15.102:0/1260617436 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b9406df10 0x7f9b9406e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9949a700 1 -- 172.21.15.102:0/1260617436 >> v2:172.21.15.121:3300/0 conn(0x7f9b940ad7c0 msgr2=0x7f9b940aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9949a700 1 --2- 172.21.15.102:0/1260617436 >> v2:172.21.15.121:3300/0 conn(0x7f9b940ad7c0 0x7f9b940aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9949a700 1 -- 172.21.15.102:0/1260617436 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b940af590 con 0x7f9b94155d20 2024-08-17T02:26:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9949a700 1 --2- 172.21.15.102:0/1260617436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b94155d20 0x7f9b940b0350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9b9406fb30 tx=0x7f9b88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3694a2a65632f2ea server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b87fff700 1 -- 172.21.15.102:0/1260617436 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8800b640 con 0x7f9b94155d20 2024-08-17T02:26:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b87fff700 1 -- 172.21.15.102:0/1260617436 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8800b7a0 con 0x7f9b94155d20 2024-08-17T02:26:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b87fff700 1 -- 172.21.15.102:0/1260617436 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8800bb60 con 0x7f9b94155d20 2024-08-17T02:26:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9a49c700 1 -- 172.21.15.102:0/1260617436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b94155d20 msgr2=0x7f9b940b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9a49c700 1 --2- 172.21.15.102:0/1260617436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b94155d20 0x7f9b940b0350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9b9406fb30 tx=0x7f9b88009250 comp rx=0 tx=0).stop 2024-08-17T02:26:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9a49c700 1 -- 172.21.15.102:0/1260617436 shutdown_connections 2024-08-17T02:26:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9a49c700 1 --2- 172.21.15.102:0/1260617436 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b9406df10 0x7f9b9406e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9a49c700 1 --2- 172.21.15.102:0/1260617436 >> v2:172.21.15.121:3300/0 conn(0x7f9b940ad7c0 0x7f9b940aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9a49c700 1 --2- 172.21.15.102:0/1260617436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b94155d20 0x7f9b940b0350 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9a49c700 1 -- 172.21.15.102:0/1260617436 >> 172.21.15.102:0/1260617436 conn(0x7f9b940678d0 msgr2=0x7f9b94067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9a49c700 1 -- 172.21.15.102:0/1260617436 shutdown_connections 2024-08-17T02:26:10.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9a49c700 1 -- 172.21.15.102:0/1260617436 wait complete. 2024-08-17T02:26:10.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.677+0000 7f9b9a49c700 1 Processor -- start 2024-08-17T02:26:10.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b9a49c700 1 -- start start 2024-08-17T02:26:10.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b9a49c700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b9406df10 0x7f9b94158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b9a49c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b940ad7c0 0x7f9b94150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b9a49c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b94155d20 0x7f9b94151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b9a49c700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b94158220 con 0x7f9b940ad7c0 2024-08-17T02:26:10.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b9a49c700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b941575a0 con 0x7f9b94155d20 2024-08-17T02:26:10.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b9a49c700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b94157880 con 0x7f9b9406df10 2024-08-17T02:26:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b98c99700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b940ad7c0 0x7f9b94150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b9949a700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b9406df10 0x7f9b94158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b98c99700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b940ad7c0 0x7f9b94150c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44654/0 (socket says 172.21.15.102:44654) 2024-08-17T02:26:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b9949a700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b9406df10 0x7f9b94158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:49618/0 (socket says 172.21.15.102:49618) 2024-08-17T02:26:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b98c99700 1 -- 172.21.15.102:0/724568412 learned_addr learned my addr 172.21.15.102:0/724568412 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b99c9b700 1 --2- 172.21.15.102:0/724568412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b94155d20 0x7f9b94151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b98c99700 1 -- 172.21.15.102:0/724568412 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b9406df10 msgr2=0x7f9b94158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b98c99700 1 --2- 172.21.15.102:0/724568412 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b9406df10 0x7f9b94158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b98c99700 1 -- 172.21.15.102:0/724568412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b94155d20 msgr2=0x7f9b94151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b98c99700 1 --2- 172.21.15.102:0/724568412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b94155d20 0x7f9b94151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b98c99700 1 -- 172.21.15.102:0/724568412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b880094f0 con 0x7f9b940ad7c0 2024-08-17T02:26:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b98c99700 1 --2- 172.21.15.102:0/724568412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b940ad7c0 0x7f9b94150c30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000ec80 tx=0x7f9b900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b857fa700 1 -- 172.21.15.102:0/724568412 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9000c850 con 0x7f9b940ad7c0 2024-08-17T02:26:10.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b857fa700 1 -- 172.21.15.102:0/724568412 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9000c9b0 con 0x7f9b940ad7c0 2024-08-17T02:26:10.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b9a49c700 1 -- 172.21.15.102:0/724568412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b94157b60 con 0x7f9b940ad7c0 2024-08-17T02:26:10.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b857fa700 1 -- 172.21.15.102:0/724568412 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9000cd50 con 0x7f9b940ad7c0 2024-08-17T02:26:10.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.681+0000 7f9b9a49c700 1 -- 172.21.15.102:0/724568412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b94158d60 con 0x7f9b940ad7c0 2024-08-17T02:26:10.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.685+0000 7f9b857fa700 1 -- 172.21.15.102:0/724568412 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9b90013680 con 0x7f9b940ad7c0 2024-08-17T02:26:10.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.685+0000 7f9b857fa700 1 --2- 172.21.15.102:0/724568412 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9b78060860 0x7f9b78062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.685+0000 7f9b9949a700 1 --2- 172.21.15.102:0/724568412 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9b78060860 0x7f9b78062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.685+0000 7f9b857fa700 1 -- 172.21.15.102:0/724568412 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9b9007d230 con 0x7f9b940ad7c0 2024-08-17T02:26:10.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.685+0000 7f9b9949a700 1 --2- 172.21.15.102:0/724568412 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9b78060860 0x7f9b78062d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9b9406fb30 tx=0x7f9b88017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 Processor -- start 2024-08-17T02:26:10.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 -- start start 2024-08-17T02:26:10.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x146dae0 0x16a11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x146d710 0x16a1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x14b8790 0x16a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x1619ba0 con 0x14b8790 2024-08-17T02:26:10.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x1615b40 con 0x146dae0 2024-08-17T02:26:10.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x15db0a0 con 0x146d710 2024-08-17T02:26:10.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b99c9b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x14b8790 0x16a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b99c9b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x14b8790 0x16a4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44668/0 (socket says 172.21.15.102:44668) 2024-08-17T02:26:10.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b99c9b700 1 -- 172.21.15.102:0/540291992 learned_addr learned my addr 172.21.15.102:0/540291992 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:10.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9949a700 1 --2- 172.21.15.102:0/540291992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x146dae0 0x16a11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b98c99700 1 --2- 172.21.15.102:0/540291992 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x146d710 0x16a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b99c9b700 1 -- 172.21.15.102:0/540291992 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x146d710 msgr2=0x16a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b99c9b700 1 --2- 172.21.15.102:0/540291992 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x146d710 0x16a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b99c9b700 1 -- 172.21.15.102:0/540291992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x146dae0 msgr2=0x16a11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b99c9b700 1 --2- 172.21.15.102:0/540291992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x146dae0 0x16a11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b99c9b700 1 -- 172.21.15.102:0/540291992 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x14b99e0 con 0x14b8790 2024-08-17T02:26:10.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b99c9b700 1 --2- 172.21.15.102:0/540291992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x14b8790 0x16a4c60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0114d0 tx=0x7f9b8c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b323c24114d328c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b7e7fc700 1 -- 172.21.15.102:0/540291992 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00e040 con 0x14b8790 2024-08-17T02:26:10.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b7e7fc700 1 -- 172.21.15.102:0/540291992 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c00f040 con 0x14b8790 2024-08-17T02:26:10.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b7e7fc700 1 -- 172.21.15.102:0/540291992 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c015640 con 0x14b8790 2024-08-17T02:26:10.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/540291992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x14b8790 msgr2=0x16a4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/540291992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x14b8790 0x16a4c60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0114d0 tx=0x7f9b8c00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:10.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/540291992 shutdown_connections 2024-08-17T02:26:10.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/540291992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x14b8790 0x16a4c60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/540291992 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x146d710 0x16a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/540291992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x146dae0 0x16a11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/540291992 >> 172.21.15.102:0/540291992 conn(0x146deb0 msgr2=0x16a70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/540291992 shutdown_connections 2024-08-17T02:26:10.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.689+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/540291992 wait complete. 2024-08-17T02:26:10.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b9d9ad740 1 -- start start 2024-08-17T02:26:10.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b9d9ad740 1 Processor -- start 2024-08-17T02:26:10.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b9d9ad740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x146d710 0x16eeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b9d9ad740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x16eefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b9d9ad740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14b8790 0x16a8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b9d9ad740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x15dad40 con 0x146dae0 2024-08-17T02:26:10.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b9d9ad740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x15b3970 con 0x14b8790 2024-08-17T02:26:10.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b9d9ad740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x15e6690 con 0x146d710 2024-08-17T02:26:10.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b9d9ad740 10 client.0 _ll_register_callbacks cb 0x15b7f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:26:10.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b98c99700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x16eefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b98c99700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x16eefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44672/0 (socket says 172.21.15.102:44672) 2024-08-17T02:26:10.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b98c99700 1 -- 172.21.15.102:0/2921601011 learned_addr learned my addr 172.21.15.102:0/2921601011 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:10.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b9949a700 1 --2- 172.21.15.102:0/2921601011 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x146d710 0x16eeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b99c9b700 1 --2- 172.21.15.102:0/2921601011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14b8790 0x16a8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b98c99700 1 -- 172.21.15.102:0/2921601011 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x146d710 msgr2=0x16eeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b98c99700 1 --2- 172.21.15.102:0/2921601011 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x146d710 0x16eeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b98c99700 1 -- 172.21.15.102:0/2921601011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14b8790 msgr2=0x16a8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b98c99700 1 --2- 172.21.15.102:0/2921601011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14b8790 0x16a8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b98c99700 1 -- 172.21.15.102:0/2921601011 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8c011230 con 0x146dae0 2024-08-17T02:26:10.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b99c9b700 1 --2- 172.21.15.102:0/2921601011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14b8790 0x16a8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:10.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b98c99700 1 --2- 172.21.15.102:0/2921601011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x16eefe0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9b9004d7a0 tx=0x7f9b9007d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4de0df6c958e9a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b737fe700 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-08-17T02:26:10.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b737fe700 1 -- 172.21.15.102:0/2921601011 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90054590 con 0x146dae0 2024-08-17T02:26:10.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b737fe700 1 -- 172.21.15.102:0/2921601011 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9b90058280 con 0x146dae0 2024-08-17T02:26:10.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/2921601011 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x147b260 con 0x146dae0 2024-08-17T02:26:10.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b737fe700 1 -- 172.21.15.102:0/2921601011 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b90050790 con 0x146dae0 2024-08-17T02:26:10.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b9d9ad740 10 client.4653 fetch_fsmap learned FSMap version 6 2024-08-17T02:26:10.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/2921601011 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x15e3370 con 0x146dae0 2024-08-17T02:26:10.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.693+0000 7f9b737fe700 1 -- 172.21.15.102:0/2921601011 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9006f080 con 0x146dae0 2024-08-17T02:26:10.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b737fe700 1 -- 172.21.15.102:0/2921601011 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9b90057df0 con 0x146dae0 2024-08-17T02:26:10.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 10 client.4653 fetch_fsmap finished waiting for FSMap version 6 2024-08-17T02:26:10.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 10 client.4653 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:26:10.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 20 client.4653 populate_metadata read hostname 'smithi102' 2024-08-17T02:26:10.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/2921601011 >> [v2:172.21.15.121:6834/4026340784,v1:172.21.15.121:6835/4026340784] conn(0x16aa650 0x16fa130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 4 client.4653 mds_command: new command op to 4282 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:26:10.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/2921601011 --> [v2:172.21.15.121:6834/4026340784,v1:172.21.15.121:6835/4026340784] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x14c54e0 con 0x16aa650 2024-08-17T02:26:10.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9949a700 1 --2- 172.21.15.102:0/2921601011 >> [v2:172.21.15.121:6834/4026340784,v1:172.21.15.121:6835/4026340784] conn(0x16aa650 0x16fa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b737fe700 10 client.4653 ms_handle_connect on v2:172.21.15.121:6834/4026340784 2024-08-17T02:26:10.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9949a700 1 --2- 172.21.15.102:0/2921601011 >> [v2:172.21.15.121:6834/4026340784,v1:172.21.15.121:6835/4026340784] conn(0x16aa650 0x16fa130 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4e9f29942c817c2 server_cookie=3c06c4f950c15d7e in_seq=0 out_seq=0 2024-08-17T02:26:10.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b737fe700 1 -- 172.21.15.102:0/2921601011 <== mds.0 v2:172.21.15.121:6834/4026340784 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x14c54e0 con 0x16aa650 2024-08-17T02:26:10.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b737fe700 10 client.4653 handle_command_reply: tid=0 2024-08-17T02:26:10.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 1 client.4653 shutdown 2024-08-17T02:26:10.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/2921601011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 msgr2=0x16eefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/2921601011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x16eefe0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9b9004d7a0 tx=0x7f9b9007d040 comp rx=0 tx=0).stop 2024-08-17T02:26:10.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/2921601011 shutdown_connections 2024-08-17T02:26:10.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/2921601011 >> [v2:172.21.15.121:6834/4026340784,v1:172.21.15.121:6835/4026340784] conn(0x16aa650 0x16fa130 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/2921601011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x16eefe0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/2921601011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14b8790 0x16a8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/2921601011 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x146d710 0x16eeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/2921601011 >> 172.21.15.102:0/2921601011 conn(0x146deb0 msgr2=0x16a6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b737fe700 0 client.4653 ms_handle_reset on v2:172.21.15.121:6834/4026340784 2024-08-17T02:26:10.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/2921601011 shutdown_connections 2024-08-17T02:26:10.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/2921601011 wait complete. 2024-08-17T02:26:10.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.697+0000 7f9b9d9ad740 20 client.4653 trim_cache size 0 max 16384 2024-08-17T02:26:10.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b9d9ad740 1 Processor -- start 2024-08-17T02:26:10.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b9d9ad740 1 -- start start 2024-08-17T02:26:10.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b9d9ad740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x146d710 0x16a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b9d9ad740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x16a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b9d9ad740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14b8790 0x16f8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b9d9ad740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x15c4140 con 0x146dae0 2024-08-17T02:26:10.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b9d9ad740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x1613500 con 0x14b8790 2024-08-17T02:26:10.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b9d9ad740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x1611650 con 0x146d710 2024-08-17T02:26:10.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b98c99700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x16a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b98c99700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x16a61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44680/0 (socket says 172.21.15.102:44680) 2024-08-17T02:26:10.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b98c99700 1 -- 172.21.15.102:0/3572371916 learned_addr learned my addr 172.21.15.102:0/3572371916 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:10.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b99c9b700 1 --2- 172.21.15.102:0/3572371916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14b8790 0x16f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b9949a700 1 --2- 172.21.15.102:0/3572371916 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x146d710 0x16a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b98c99700 1 -- 172.21.15.102:0/3572371916 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x146d710 msgr2=0x16a5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b98c99700 1 --2- 172.21.15.102:0/3572371916 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x146d710 0x16a5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b98c99700 1 -- 172.21.15.102:0/3572371916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14b8790 msgr2=0x16f8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b98c99700 1 --2- 172.21.15.102:0/3572371916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14b8790 0x16f8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b98c99700 1 -- 172.21.15.102:0/3572371916 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x15c9d80 con 0x146dae0 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b9949a700 1 --2- 172.21.15.102:0/3572371916 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x146d710 0x16a5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b98c99700 1 --2- 172.21.15.102:0/3572371916 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x16a61b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9b90050fa0 tx=0x7f9b90069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b68598691fa749d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b7effd700 1 -- 172.21.15.102:0/3572371916 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90050790 con 0x146dae0 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b7effd700 1 -- 172.21.15.102:0/3572371916 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x147b260 con 0x146dae0 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b7effd700 1 -- 172.21.15.102:0/3572371916 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9007d030 con 0x146dae0 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/3572371916 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 msgr2=0x16a61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.721+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/3572371916 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x16a61b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9b90050fa0 tx=0x7f9b90069000 comp rx=0 tx=0).stop 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/3572371916 shutdown_connections 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/3572371916 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x16a61b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/3572371916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x14b8790 0x16f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/3572371916 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x146d710 0x16a5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/3572371916 >> 172.21.15.102:0/3572371916 conn(0x146deb0 msgr2=0x16ed570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/3572371916 shutdown_connections 2024-08-17T02:26:10.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/3572371916 wait complete. 2024-08-17T02:26:10.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 -- start start 2024-08-17T02:26:10.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 Processor -- start 2024-08-17T02:26:10.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x146d710 0x16fabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x1702fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x14b8790 0x17034f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x1619640 con 0x146dae0 2024-08-17T02:26:10.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x1613500 con 0x146d710 2024-08-17T02:26:10.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x15e6990 con 0x14b8790 2024-08-17T02:26:10.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 10 client.0 _ll_register_callbacks cb 0x14399d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:26:10.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b98c99700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x1702fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b98c99700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x1702fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44682/0 (socket says 172.21.15.102:44682) 2024-08-17T02:26:10.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b98c99700 1 -- 172.21.15.102:0/168486275 learned_addr learned my addr 172.21.15.102:0/168486275 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:10.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9949a700 1 --2- 172.21.15.102:0/168486275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x146d710 0x16fabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b99c9b700 1 --2- 172.21.15.102:0/168486275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x14b8790 0x17034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b98c99700 1 -- 172.21.15.102:0/168486275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x14b8790 msgr2=0x17034f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b98c99700 1 --2- 172.21.15.102:0/168486275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x14b8790 0x17034f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b98c99700 1 -- 172.21.15.102:0/168486275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x146d710 msgr2=0x16fabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b98c99700 1 --2- 172.21.15.102:0/168486275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x146d710 0x16fabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b98c99700 1 -- 172.21.15.102:0/168486275 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x15e3370 con 0x146dae0 2024-08-17T02:26:10.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9949a700 1 --2- 172.21.15.102:0/168486275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x146d710 0x16fabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:10.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b98c99700 1 --2- 172.21.15.102:0/168486275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x1702fb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9b90051b90 tx=0x7f9b9000e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df256deea81fc4d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b737fe700 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-08-17T02:26:10.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b737fe700 1 -- 172.21.15.102:0/168486275 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90050790 con 0x146dae0 2024-08-17T02:26:10.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/168486275 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b8c00f040 con 0x146dae0 2024-08-17T02:26:10.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b737fe700 1 -- 172.21.15.102:0/168486275 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9b90058280 con 0x146dae0 2024-08-17T02:26:10.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b737fe700 1 -- 172.21.15.102:0/168486275 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b9007d030 con 0x146dae0 2024-08-17T02:26:10.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 10 client.4659 fetch_fsmap learned FSMap version 6 2024-08-17T02:26:10.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/168486275 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x15be130 con 0x146dae0 2024-08-17T02:26:10.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b737fe700 1 -- 172.21.15.102:0/168486275 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c00f040 con 0x146dae0 2024-08-17T02:26:10.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b737fe700 1 -- 172.21.15.102:0/168486275 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9b90057df0 con 0x146dae0 2024-08-17T02:26:10.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 10 client.4659 fetch_fsmap finished waiting for FSMap version 6 2024-08-17T02:26:10.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 10 client.4659 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:26:10.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 20 client.4659 populate_metadata read hostname 'smithi102' 2024-08-17T02:26:10.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/168486275 >> [v2:172.21.15.121:6834/4026340784,v1:172.21.15.121:6835/4026340784] conn(0x1703a30 0x1746a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.725+0000 7f9b9d9ad740 4 client.4659 mds_command: new command op to 4282 tid=0[{"prefix": "status"}] 2024-08-17T02:26:10.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/168486275 --> [v2:172.21.15.121:6834/4026340784,v1:172.21.15.121:6835/4026340784] -- command(tid 0: {"prefix": "status"}) v1 -- 0x14ea260 con 0x1703a30 2024-08-17T02:26:10.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9949a700 1 --2- 172.21.15.102:0/168486275 >> [v2:172.21.15.121:6834/4026340784,v1:172.21.15.121:6835/4026340784] conn(0x1703a30 0x1746a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9949a700 1 --2- 172.21.15.102:0/168486275 >> [v2:172.21.15.121:6834/4026340784,v1:172.21.15.121:6835/4026340784] conn(0x1703a30 0x1746a10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=297fa24dcef340c4 server_cookie=9a81fcca2df11c11 in_seq=0 out_seq=0 2024-08-17T02:26:10.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b737fe700 10 client.4659 ms_handle_connect on v2:172.21.15.121:6834/4026340784 2024-08-17T02:26:10.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b737fe700 1 -- 172.21.15.102:0/168486275 <== mds.0 v2:172.21.15.121:6834/4026340784 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x14ea260 con 0x1703a30 2024-08-17T02:26:10.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b737fe700 10 client.4659 handle_command_reply: tid=0 2024-08-17T02:26:10.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9d9ad740 1 client.4659 shutdown 2024-08-17T02:26:10.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/168486275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 msgr2=0x1702fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/168486275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x1702fb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9b90051b90 tx=0x7f9b9000e050 comp rx=0 tx=0).stop 2024-08-17T02:26:10.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/168486275 shutdown_connections 2024-08-17T02:26:10.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/168486275 >> [v2:172.21.15.121:6834/4026340784,v1:172.21.15.121:6835/4026340784] conn(0x1703a30 0x1746a10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/168486275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x146dae0 0x1702fb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b737fe700 0 client.4659 ms_handle_reset on v2:172.21.15.121:6834/4026340784 2024-08-17T02:26:10.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/168486275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x14b8790 0x17034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9d9ad740 1 --2- 172.21.15.102:0/168486275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x146d710 0x16fabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/168486275 >> 172.21.15.102:0/168486275 conn(0x146deb0 msgr2=0x16a1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/168486275 shutdown_connections 2024-08-17T02:26:10.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9d9ad740 1 -- 172.21.15.102:0/168486275 wait complete. 2024-08-17T02:26:10.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9d9ad740 20 client.4659 trim_cache size 0 max 16384 2024-08-17T02:26:10.736 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-08-17T02:26:10.736 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "0c0c2578-b641-472b-9b35-bef011c543fd", 2024-08-17T02:26:10.737 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 0, 2024-08-17T02:26:10.737 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4282, 2024-08-17T02:26:10.737 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2024-08-17T02:26:10.737 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2024-08-17T02:26:10.737 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2024-08-17T02:26:10.737 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 14.712473280999999, 2024-08-17T02:26:10.737 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 6, 2024-08-17T02:26:10.737 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 21, 2024-08-17T02:26:10.737 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 21, 2024-08-17T02:26:10.737 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 21.387003963000002 2024-08-17T02:26:10.737 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-08-17T02:26:10.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9a49c700 1 -- 172.21.15.102:0/724568412 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9b78060860 msgr2=0x7f9b78062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9a49c700 1 --2- 172.21.15.102:0/724568412 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9b78060860 0x7f9b78062d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9b9406fb30 tx=0x7f9b88017000 comp rx=0 tx=0).stop 2024-08-17T02:26:10.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9a49c700 1 -- 172.21.15.102:0/724568412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b940ad7c0 msgr2=0x7f9b94150c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9a49c700 1 --2- 172.21.15.102:0/724568412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b940ad7c0 0x7f9b94150c30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000ec80 tx=0x7f9b900091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9a49c700 1 -- 172.21.15.102:0/724568412 shutdown_connections 2024-08-17T02:26:10.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9a49c700 1 --2- 172.21.15.102:0/724568412 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9b78060860 0x7f9b78062d10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9a49c700 1 --2- 172.21.15.102:0/724568412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b940ad7c0 0x7f9b94150c30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9a49c700 1 --2- 172.21.15.102:0/724568412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b94155d20 0x7f9b94151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9a49c700 1 --2- 172.21.15.102:0/724568412 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9b9406df10 0x7f9b94158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9a49c700 1 -- 172.21.15.102:0/724568412 >> 172.21.15.102:0/724568412 conn(0x7f9b940678d0 msgr2=0x7f9b9414c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9a49c700 1 -- 172.21.15.102:0/724568412 shutdown_connections 2024-08-17T02:26:10.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.729+0000 7f9b9a49c700 1 -- 172.21.15.102:0/724568412 wait complete. 2024-08-17T02:26:10.749 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-08-17T02:26:10.774 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-08-17T02:26:10.774 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:26:10.774 INFO:tasks.ceph_fuse:client.0 config is {} 2024-08-17T02:26:10.774 INFO:tasks.ceph_fuse:client.2 config is {} 2024-08-17T02:26:10.774 INFO:tasks.ceph_fuse:client.1 config is {} 2024-08-17T02:26:10.774 INFO:tasks.ceph_fuse:client.3 config is {} 2024-08-17T02:26:10.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:10.775 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-08-17T02:26:10.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:10.783 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-08-17T02:26:10.802 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2024-08-17T02:26:10.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:10.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:10.804 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-08-17T02:26:10.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:10.812 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2024-08-17T02:26:10.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:10.835 INFO:teuthology.orchestra.run.smithi121.stderr:Cannot find device "ceph-brx" 2024-08-17T02:26:10.835 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-08-17T02:26:10.835 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:10.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.957+0000 7f35a8fd4700 1 Processor -- start 2024-08-17T02:26:10.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.957+0000 7f35a8fd4700 1 -- start start 2024-08-17T02:26:10.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.957+0000 7f35a8fd4700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f35a4158eb0 0x7f35a40aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.957+0000 7f35a8fd4700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f35a40aecc0 0x7f35a406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.957+0000 7f35a8fd4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35a4159280 0x7f35a406e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.957+0000 7f35a8fd4700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a40ac000 con 0x7f35a40aecc0 2024-08-17T02:26:10.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.957+0000 7f35a8fd4700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a40ab3f0 con 0x7f35a4158eb0 2024-08-17T02:26:10.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.957+0000 7f35a8fd4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40ab6d0 con 0x7f35a4159280 2024-08-17T02:26:10.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f359affd700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f35a40aecc0 0x7f35a406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f359affd700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f35a40aecc0 0x7f35a406df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44698/0 (socket says 172.21.15.102:44698) 2024-08-17T02:26:10.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f359affd700 1 -- 172.21.15.102:0/3971155393 learned_addr learned my addr 172.21.15.102:0/3971155393 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:10.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f35a37fe700 1 --2- 172.21.15.102:0/3971155393 >> v2:172.21.15.121:3300/0 conn(0x7f35a4158eb0 0x7f35a40aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f35a3fff700 1 --2- 172.21.15.102:0/3971155393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35a4159280 0x7f35a406e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f359affd700 1 -- 172.21.15.102:0/3971155393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35a4159280 msgr2=0x7f35a406e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f359affd700 1 --2- 172.21.15.102:0/3971155393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35a4159280 0x7f35a406e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f359affd700 1 -- 172.21.15.102:0/3971155393 >> v2:172.21.15.121:3300/0 conn(0x7f35a4158eb0 msgr2=0x7f35a40aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f359affd700 1 --2- 172.21.15.102:0/3971155393 >> v2:172.21.15.121:3300/0 conn(0x7f35a4158eb0 0x7f35a40aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f359affd700 1 -- 172.21.15.102:0/3971155393 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a40ab9b0 con 0x7f35a40aecc0 2024-08-17T02:26:10.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f359affd700 1 --2- 172.21.15.102:0/3971155393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a40aecc0 0x7f35a406df10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f35a406c630 tx=0x7f358c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481218e297f8697f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f35a2ffd700 1 -- 172.21.15.102:0/3971155393 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c00b860 con 0x7f35a40aecc0 2024-08-17T02:26:10.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f35a2ffd700 1 -- 172.21.15.102:0/3971155393 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c00b9c0 con 0x7f35a40aecc0 2024-08-17T02:26:10.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f35a2ffd700 1 -- 172.21.15.102:0/3971155393 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c00bd60 con 0x7f35a40aecc0 2024-08-17T02:26:10.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f35a8fd4700 1 -- 172.21.15.102:0/3971155393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a40aecc0 msgr2=0x7f35a406df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f35a8fd4700 1 --2- 172.21.15.102:0/3971155393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a40aecc0 0x7f35a406df10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f35a406c630 tx=0x7f358c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:10.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f35a8fd4700 1 -- 172.21.15.102:0/3971155393 shutdown_connections 2024-08-17T02:26:10.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f35a8fd4700 1 --2- 172.21.15.102:0/3971155393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35a4159280 0x7f35a406e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f35a8fd4700 1 --2- 172.21.15.102:0/3971155393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a40aecc0 0x7f35a406df10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f35a8fd4700 1 --2- 172.21.15.102:0/3971155393 >> v2:172.21.15.121:3300/0 conn(0x7f35a4158eb0 0x7f35a40aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f35a8fd4700 1 -- 172.21.15.102:0/3971155393 >> 172.21.15.102:0/3971155393 conn(0x7f35a40678d0 msgr2=0x7f35a4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f35a8fd4700 1 -- 172.21.15.102:0/3971155393 shutdown_connections 2024-08-17T02:26:10.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.961+0000 7f35a8fd4700 1 -- 172.21.15.102:0/3971155393 wait complete. 2024-08-17T02:26:10.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f35a8fd4700 1 Processor -- start 2024-08-17T02:26:10.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f35a8fd4700 1 -- start start 2024-08-17T02:26:10.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f35a8fd4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35a40aecc0 0x7f35a413fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f35a8fd4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4158eb0 0x7f35a4156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f35a8fd4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35a4159280 0x7f35a4156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f35a8fd4700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4158020 con 0x7f35a4158eb0 2024-08-17T02:26:10.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f35a8fd4700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4151aa0 con 0x7f35a4159280 2024-08-17T02:26:10.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f35a8fd4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4157410 con 0x7f35a40aecc0 2024-08-17T02:26:10.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f359affd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4158eb0 0x7f35a4156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f359affd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4158eb0 0x7f35a4156870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44708/0 (socket says 172.21.15.102:44708) 2024-08-17T02:26:10.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f359affd700 1 -- 172.21.15.102:0/412075289 learned_addr learned my addr 172.21.15.102:0/412075289 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:10.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f35a37fe700 1 --2- 172.21.15.102:0/412075289 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35a40aecc0 0x7f35a413fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f35a3fff700 1 --2- 172.21.15.102:0/412075289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35a4159280 0x7f35a4156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f359affd700 1 -- 172.21.15.102:0/412075289 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35a40aecc0 msgr2=0x7f35a413fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f359affd700 1 --2- 172.21.15.102:0/412075289 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35a40aecc0 0x7f35a413fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f359affd700 1 -- 172.21.15.102:0/412075289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35a4159280 msgr2=0x7f35a4156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f359affd700 1 --2- 172.21.15.102:0/412075289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35a4159280 0x7f35a4156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f359affd700 1 -- 172.21.15.102:0/412075289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c0094f0 con 0x7f35a4158eb0 2024-08-17T02:26:10.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f35a37fe700 1 --2- 172.21.15.102:0/412075289 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35a40aecc0 0x7f35a413fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:10.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f359affd700 1 --2- 172.21.15.102:0/412075289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4158eb0 0x7f35a4156870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f35a406c2d0 tx=0x7f358c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f359bfff700 1 -- 172.21.15.102:0/412075289 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c024440 con 0x7f35a4158eb0 2024-08-17T02:26:10.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f359bfff700 1 -- 172.21.15.102:0/412075289 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c0245a0 con 0x7f35a4158eb0 2024-08-17T02:26:10.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f35a8fd4700 1 -- 172.21.15.102:0/412075289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a41576f0 con 0x7f35a4158eb0 2024-08-17T02:26:10.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f359bfff700 1 -- 172.21.15.102:0/412075289 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c024960 con 0x7f35a4158eb0 2024-08-17T02:26:10.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.965+0000 7f35a8fd4700 1 -- 172.21.15.102:0/412075289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a4157cb0 con 0x7f35a4158eb0 2024-08-17T02:26:10.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.969+0000 7f35a8fd4700 1 -- 172.21.15.102:0/412075289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a40643a0 con 0x7f35a4158eb0 2024-08-17T02:26:10.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.969+0000 7f359bfff700 1 -- 172.21.15.102:0/412075289 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f358c01a420 con 0x7f35a4158eb0 2024-08-17T02:26:10.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.969+0000 7f359bfff700 1 --2- 172.21.15.102:0/412075289 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3584060860 0x7f3584062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.969+0000 7f359bfff700 1 -- 172.21.15.102:0/412075289 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f358c07ec70 con 0x7f35a4158eb0 2024-08-17T02:26:10.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.969+0000 7f35a37fe700 1 --2- 172.21.15.102:0/412075289 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3584060860 0x7f3584062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.969+0000 7f35a37fe700 1 --2- 172.21.15.102:0/412075289 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3584060860 0x7f3584062d10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3594006fd0 tx=0x7f3594008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:10.973+0000 7f359bfff700 1 -- 172.21.15.102:0/412075289 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f358c04f0c0 con 0x7f35a4158eb0 2024-08-17T02:26:11.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:11.181+0000 7f35a8fd4700 1 -- 172.21.15.102:0/412075289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f35a406f5f0 con 0x7f35a4158eb0 2024-08-17T02:26:11.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:11.181+0000 7f359bfff700 1 -- 172.21.15.102:0/412075289 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f358c0526e0 con 0x7f35a4158eb0 2024-08-17T02:26:11.183 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:11.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:11.181+0000 7f35a8fd4700 1 -- 172.21.15.102:0/412075289 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3584060860 msgr2=0x7f3584062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:11.185+0000 7f35a8fd4700 1 --2- 172.21.15.102:0/412075289 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3584060860 0x7f3584062d10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3594006fd0 tx=0x7f3594008040 comp rx=0 tx=0).stop 2024-08-17T02:26:11.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:11.185+0000 7f35a8fd4700 1 -- 172.21.15.102:0/412075289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4158eb0 msgr2=0x7f35a4156870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:11.185+0000 7f35a8fd4700 1 --2- 172.21.15.102:0/412075289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4158eb0 0x7f35a4156870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f35a406c2d0 tx=0x7f358c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:11.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:11.185+0000 7f35a8fd4700 1 -- 172.21.15.102:0/412075289 shutdown_connections 2024-08-17T02:26:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:11.185+0000 7f35a8fd4700 1 --2- 172.21.15.102:0/412075289 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3584060860 0x7f3584062d10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:11.185+0000 7f35a8fd4700 1 --2- 172.21.15.102:0/412075289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35a4158eb0 0x7f35a4156870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:11.185+0000 7f35a8fd4700 1 --2- 172.21.15.102:0/412075289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35a4159280 0x7f35a4156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:11.185+0000 7f35a8fd4700 1 --2- 172.21.15.102:0/412075289 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35a40aecc0 0x7f35a413fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:11.185+0000 7f35a8fd4700 1 -- 172.21.15.102:0/412075289 >> 172.21.15.102:0/412075289 conn(0x7f35a40678d0 msgr2=0x7f35a4152870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:11.185+0000 7f35a8fd4700 1 -- 172.21.15.102:0/412075289 shutdown_connections 2024-08-17T02:26:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:11.185+0000 7f35a8fd4700 1 -- 172.21.15.102:0/412075289 wait complete. 2024-08-17T02:26:11.198 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:11.198 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:11.198 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-08-17T02:26:11.198 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:26:11.198 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:11.198 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:11.198 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:11.198 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:11.198 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:11.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:11.199 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-08-17T02:26:11.206 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:11.206 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:11.206 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:11.206 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:11.207 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:11.207 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:11.207 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:11.207 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:11.207 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:11.207 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:11.207 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:11.207 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:11.207 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:11.207 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:11.207 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:26:11.207 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42592sec preferred_lft 42592sec 2024-08-17T02:26:11.208 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2024-08-17T02:26:11.208 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:11.208 INFO:teuthology.orchestra.run.smithi102.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:26:11.208 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 02:42:f1:69:1c:f7 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:11.208 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:26:11.208 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:11.209 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:26:11.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:11.209 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-08-17T02:26:11.209 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-08-17T02:26:11.209 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:26:11.209 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr flush dev ceph-brx 2024-08-17T02:26:11.209 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set ceph-brx up 2024-08-17T02:26:11.209 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:26:11.209 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-08-17T02:26:11.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:11.290 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:11.299 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-08-17T02:26:11.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:11.301 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-08-17T02:26:11.328 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-08-17T02:26:11.329 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:11.329 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:26:11.329 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:11.329 INFO:teuthology.orchestra.run.smithi102.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:26:11.330 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:26:11.330 INFO:teuthology.orchestra.run.smithi102.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:26:11.330 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:11.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:11.330 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-08-17T02:26:11.330 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-08-17T02:26:11.330 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:11.331 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:11.331 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:11.331 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-08-17T02:26:11.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:11.368 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-08-17T02:26:11.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:11.417 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2024-08-17T02:26:11.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:11.423 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-08-17T02:26:11.423 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-08-17T02:26:11.423 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:26:11.423 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:26:11.423 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-08-17T02:26:11.455 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:26:11.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:11.455 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-08-17T02:26:11.455 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-08-17T02:26:11.455 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:26:11.455 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:11.455 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:26:11.455 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:26:11.455 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:26:11.455 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-08-17T02:26:11.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:11.564 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-08-17T02:26:11.564 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-08-17T02:26:11.564 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-08-17T02:26:11.564 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:26:11.564 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-08-17T02:26:11.590 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-17T02:26:11.591 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:11.591 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:11.596 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:11.597 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:11.597 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:11.603 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2024-08-17T02:26:11.664 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:11.665 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:11.676 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:11.676 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:11.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:11.677 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2024-08-17T02:26:11.683 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:26:11.684 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-17T02:26:11.727 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2024-08-17T02:26:11.743 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:11.743 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:11.757 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:11.758 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:11.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:11.759 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2024-08-17T02:26:11.814 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2024-08-17T02:26:11.813+0000 7fb5f1102380 -1 init, newargv = 0x5593e55a63e0 newargc=15 2024-08-17T02:26:11.814 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[31179]: starting ceph client 2024-08-17T02:26:11.822 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[31179]: starting fuse 2024-08-17T02:26:12.909 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2024-08-17T02:26:12.928 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:12.928 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:12.942 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:12.943 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:12.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:12.944 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi102.stdout:52 2024-08-17T02:26:12.950 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:26:12.950 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:26:12.950 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2024-08-17T02:26:12.950 DEBUG:teuthology.orchestra.run.smithi102:> import re 2024-08-17T02:26:12.950 DEBUG:teuthology.orchestra.run.smithi102:> import os 2024-08-17T02:26:12.951 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2024-08-17T02:26:12.951 DEBUG:teuthology.orchestra.run.smithi102:> 2024-08-17T02:26:12.951 DEBUG:teuthology.orchestra.run.smithi102:> def _find_admin_socket(client_name): 2024-08-17T02:26:12.951 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-17T02:26:12.951 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2024-08-17T02:26:12.951 DEBUG:teuthology.orchestra.run.smithi102:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-17T02:26:12.951 DEBUG:teuthology.orchestra.run.smithi102:> 2024-08-17T02:26:12.951 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2024-08-17T02:26:12.951 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2024-08-17T02:26:12.951 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2024-08-17T02:26:12.951 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2024-08-17T02:26:12.951 DEBUG:teuthology.orchestra.run.smithi102:> 2024-08-17T02:26:12.951 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2024-08-17T02:26:12.951 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:26:12.951 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:26:12.952 DEBUG:teuthology.orchestra.run.smithi102:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:26:12.952 DEBUG:teuthology.orchestra.run.smithi102:> contents = proc_f.read() 2024-08-17T02:26:12.952 DEBUG:teuthology.orchestra.run.smithi102:> if mountpoint in contents: 2024-08-17T02:26:12.952 DEBUG:teuthology.orchestra.run.smithi102:> return f 2024-08-17T02:26:12.952 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:26:12.952 DEBUG:teuthology.orchestra.run.smithi102:> 2024-08-17T02:26:12.952 DEBUG:teuthology.orchestra.run.smithi102:> print(_find_admin_socket("client.0")) 2024-08-17T02:26:12.952 DEBUG:teuthology.orchestra.run.smithi102:> ' 2024-08-17T02:26:13.036 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.31179.asok 2024-08-17T02:26:13.219 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.31179.asok 2024-08-17T02:26:13.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:13.220 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.31179.asok status 2024-08-17T02:26:13.356 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-08-17T02:26:13.357 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2024-08-17T02:26:13.357 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:26:13.357 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:26:13.357 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2024-08-17T02:26:13.357 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2024-08-17T02:26:13.357 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-17T02:26:13.357 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "31179", 2024-08-17T02:26:13.357 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2024-08-17T02:26:13.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:13.357 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2024-08-17T02:26:13.357 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2024-08-17T02:26:13.357 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4671, 2024-08-17T02:26:13.358 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2024-08-17T02:26:13.358 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2024-08-17T02:26:13.358 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2024-08-17T02:26:13.358 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 4671 2024-08-17T02:26:13.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:13.358 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2024-08-17T02:26:13.358 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-08-17T02:26:13.358 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:26:13.358 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 225589378 2024-08-17T02:26:13.358 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:13.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:13.358 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2024-08-17T02:26:13.358 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-08-17T02:26:13.359 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:26:13.359 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 225589378 2024-08-17T02:26:13.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:13.359 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.4671 192.168.0.1:0/225589378", 2024-08-17T02:26:13.359 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "192.168.0.1:0/225589378", 2024-08-17T02:26:13.359 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2024-08-17T02:26:13.359 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 6, 2024-08-17T02:26:13.359 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 21, 2024-08-17T02:26:13.359 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:26:13.359 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklisted": false, 2024-08-17T02:26:13.359 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2024-08-17T02:26:13.359 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-08-17T02:26:13.366 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:13.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.473+0000 7f0648fe4700 1 Processor -- start 2024-08-17T02:26:13.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.473+0000 7f0648fe4700 1 -- start start 2024-08-17T02:26:13.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0648fe4700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f064406e130 0x7f06440686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0648fe4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0644068be0 0x7f0644160c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0648fe4700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06440c36f0 con 0x7f0644157060 2024-08-17T02:26:13.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0648fe4700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06440caec0 con 0x7f064406e130 2024-08-17T02:26:13.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0648fe4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0644069000 con 0x7f0644068be0 2024-08-17T02:26:13.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0641d9b700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f064406e130 0x7f06440686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0641d9b700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f064406e130 0x7f06440686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43602/0 (socket says 172.21.15.102:43602) 2024-08-17T02:26:13.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0641d9b700 1 -- 172.21.15.102:0/547559983 learned_addr learned my addr 172.21.15.102:0/547559983 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:13.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0642d9d700 1 --2- 172.21.15.102:0/547559983 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0644068be0 0x7f0644160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f064159a700 1 -- 172.21.15.102:0/547559983 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876152070 0 0) 0x7f06440c36f0 con 0x7f0644157060 2024-08-17T02:26:13.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f064159a700 1 -- 172.21.15.102:0/547559983 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f062c003570 con 0x7f0644157060 2024-08-17T02:26:13.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0641d9b700 1 -- 172.21.15.102:0/547559983 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0644068be0 msgr2=0x7f0644160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0641d9b700 1 --2- 172.21.15.102:0/547559983 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0644068be0 0x7f0644160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0641d9b700 1 -- 172.21.15.102:0/547559983 >> v1:172.21.15.121:6789/0 conn(0x7f0644157060 legacy=0x7f064406a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0641d9b700 1 -- 172.21.15.102:0/547559983 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064406e590 con 0x7f064406e130 2024-08-17T02:26:13.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0641d9b700 1 --2- 172.21.15.102:0/547559983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064406e130 0x7f06440686a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f06380099b0 tx=0x7f0638009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578ab05b46572d58 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f064159a700 1 -- 172.21.15.102:0/547559983 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063800b680 con 0x7f064406e130 2024-08-17T02:26:13.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f064159a700 1 -- 172.21.15.102:0/547559983 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063800b7e0 con 0x7f064406e130 2024-08-17T02:26:13.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f064159a700 1 -- 172.21.15.102:0/547559983 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063800bb80 con 0x7f064406e130 2024-08-17T02:26:13.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0648fe4700 1 -- 172.21.15.102:0/547559983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064406e130 msgr2=0x7f06440686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0648fe4700 1 --2- 172.21.15.102:0/547559983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064406e130 0x7f06440686a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f06380099b0 tx=0x7f0638009250 comp rx=0 tx=0).stop 2024-08-17T02:26:13.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0648fe4700 1 -- 172.21.15.102:0/547559983 shutdown_connections 2024-08-17T02:26:13.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0648fe4700 1 --2- 172.21.15.102:0/547559983 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0644068be0 0x7f0644160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0648fe4700 1 --2- 172.21.15.102:0/547559983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064406e130 0x7f06440686a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0648fe4700 1 -- 172.21.15.102:0/547559983 >> 172.21.15.102:0/547559983 conn(0x7f06440c9c20 msgr2=0x7f064406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.477+0000 7f0648fe4700 1 -- 172.21.15.102:0/547559983 shutdown_connections 2024-08-17T02:26:13.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0648fe4700 1 -- 172.21.15.102:0/547559983 wait complete. 2024-08-17T02:26:13.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0648fe4700 1 Processor -- start 2024-08-17T02:26:13.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0648fe4700 1 -- start start 2024-08-17T02:26:13.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0648fe4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0644068be0 0x7f0644169ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0648fe4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f064406e130 0x7f06440c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0648fe4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0644157060 0x7f06440af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0648fe4700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064416a3e0 con 0x7f0644157060 2024-08-17T02:26:13.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0648fe4700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064416c6b0 con 0x7f0644068be0 2024-08-17T02:26:13.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0648fe4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064416c990 con 0x7f064406e130 2024-08-17T02:26:13.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0642d9d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0644157060 0x7f06440af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0642d9d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0644157060 0x7f06440af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43606/0 (socket says 172.21.15.102:43606) 2024-08-17T02:26:13.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0642d9d700 1 -- 172.21.15.102:0/1856738571 learned_addr learned my addr 172.21.15.102:0/1856738571 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:13.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f064259c700 1 --2- 172.21.15.102:0/1856738571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0644068be0 0x7f0644169ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0641d9b700 1 --2- 172.21.15.102:0/1856738571 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f064406e130 0x7f06440c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0642d9d700 1 -- 172.21.15.102:0/1856738571 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f064406e130 msgr2=0x7f06440c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0642d9d700 1 --2- 172.21.15.102:0/1856738571 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f064406e130 0x7f06440c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0642d9d700 1 -- 172.21.15.102:0/1856738571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0644068be0 msgr2=0x7f0644169ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0642d9d700 1 --2- 172.21.15.102:0/1856738571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0644068be0 0x7f0644169ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0642d9d700 1 -- 172.21.15.102:0/1856738571 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06380094f0 con 0x7f0644157060 2024-08-17T02:26:13.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0641d9b700 1 --2- 172.21.15.102:0/1856738571 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f064406e130 0x7f06440c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:13.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f0642d9d700 1 --2- 172.21.15.102:0/1856738571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0644157060 0x7f06440af900 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f063c009df0 tx=0x7f063c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.481+0000 7f06327fc700 1 -- 172.21.15.102:0/1856738571 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c00cb50 con 0x7f0644157060 2024-08-17T02:26:13.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.485+0000 7f0648fe4700 1 -- 172.21.15.102:0/1856738571 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064416cc70 con 0x7f0644157060 2024-08-17T02:26:13.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.485+0000 7f06327fc700 1 -- 172.21.15.102:0/1856738571 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c00f040 con 0x7f0644157060 2024-08-17T02:26:13.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.485+0000 7f06327fc700 1 -- 172.21.15.102:0/1856738571 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c014480 con 0x7f0644157060 2024-08-17T02:26:13.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.485+0000 7f0648fe4700 1 -- 172.21.15.102:0/1856738571 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064416c2d0 con 0x7f0644157060 2024-08-17T02:26:13.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.485+0000 7f0648fe4700 1 -- 172.21.15.102:0/1856738571 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06440645c0 con 0x7f0644157060 2024-08-17T02:26:13.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.489+0000 7f06327fc700 1 -- 172.21.15.102:0/1856738571 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f063c014830 con 0x7f0644157060 2024-08-17T02:26:13.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.489+0000 7f06327fc700 1 --2- 172.21.15.102:0/1856738571 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0624060860 0x7f0624062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.489+0000 7f06327fc700 1 -- 172.21.15.102:0/1856738571 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f063c07dc80 con 0x7f0644157060 2024-08-17T02:26:13.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.489+0000 7f064259c700 1 --2- 172.21.15.102:0/1856738571 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0624060860 0x7f0624062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.489+0000 7f064259c700 1 --2- 172.21.15.102:0/1856738571 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0624060860 0x7f0624062d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0634007fd0 tx=0x7f0634007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.493+0000 7f06327fc700 1 -- 172.21.15.102:0/1856738571 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f063c04e0d0 con 0x7f0644157060 2024-08-17T02:26:13.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.693+0000 7f0648fe4700 1 -- 172.21.15.102:0/1856738571 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f06440708e0 con 0x7f0644157060 2024-08-17T02:26:13.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.693+0000 7f06327fc700 1 -- 172.21.15.102:0/1856738571 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f063c0516f0 con 0x7f0644157060 2024-08-17T02:26:13.698 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:13.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.697+0000 7f0648fe4700 1 -- 172.21.15.102:0/1856738571 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0624060860 msgr2=0x7f0624062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.697+0000 7f0648fe4700 1 --2- 172.21.15.102:0/1856738571 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0624060860 0x7f0624062d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0634007fd0 tx=0x7f0634007d50 comp rx=0 tx=0).stop 2024-08-17T02:26:13.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.697+0000 7f0648fe4700 1 -- 172.21.15.102:0/1856738571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0644157060 msgr2=0x7f06440af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.697+0000 7f0648fe4700 1 --2- 172.21.15.102:0/1856738571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0644157060 0x7f06440af900 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f063c009df0 tx=0x7f063c00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:13.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.697+0000 7f0648fe4700 1 -- 172.21.15.102:0/1856738571 shutdown_connections 2024-08-17T02:26:13.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.697+0000 7f0648fe4700 1 --2- 172.21.15.102:0/1856738571 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0624060860 0x7f0624062d10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.697+0000 7f0648fe4700 1 --2- 172.21.15.102:0/1856738571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0644157060 0x7f06440af900 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.697+0000 7f0648fe4700 1 --2- 172.21.15.102:0/1856738571 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f064406e130 0x7f06440c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.697+0000 7f0648fe4700 1 --2- 172.21.15.102:0/1856738571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0644068be0 0x7f0644169ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.697+0000 7f0648fe4700 1 -- 172.21.15.102:0/1856738571 >> 172.21.15.102:0/1856738571 conn(0x7f06440c9c20 msgr2=0x7f06440c36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.697+0000 7f0648fe4700 1 -- 172.21.15.102:0/1856738571 shutdown_connections 2024-08-17T02:26:13.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:13.697+0000 7f0648fe4700 1 -- 172.21.15.102:0/1856738571 wait complete. 2024-08-17T02:26:13.711 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:13.711 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:13.711 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-08-17T02:26:13.711 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:26:13.711 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:13.711 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:13.712 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:13.712 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:13.712 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:26:13.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:13.712 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-08-17T02:26:13.717 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:13.717 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:13.717 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:13.718 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.718 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:13.718 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.718 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:13.718 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:13.719 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:13.719 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:13.719 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:13.719 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:13.719 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:13.720 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:13.720 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:26:13.720 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42589sec preferred_lft 42589sec 2024-08-17T02:26:13.720 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2024-08-17T02:26:13.720 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.720 INFO:teuthology.orchestra.run.smithi102.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:26:13.720 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 02:42:f1:69:1c:f7 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:13.720 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:26:13.720 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.720 INFO:teuthology.orchestra.run.smithi102.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:13.720 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether d2:25:78:af:04:17 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:13.720 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:26:13.721 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.721 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::20f8:9bff:fee0:c586/64 scope link 2024-08-17T02:26:13.721 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.721 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:13.721 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether d2:25:78:af:04:17 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:26:13.721 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::d025:78ff:feaf:417/64 scope link 2024-08-17T02:26:13.721 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:13.721 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:13.775 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-08-17T02:26:13.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:13.777 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-08-17T02:26:13.785 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-08-17T02:26:13.785 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:13.785 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:26:13.785 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:13.785 INFO:teuthology.orchestra.run.smithi102.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:26:13.786 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:26:13.786 INFO:teuthology.orchestra.run.smithi102.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:26:13.786 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:13.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:13.786 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-08-17T02:26:13.786 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-08-17T02:26:13.786 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:13.786 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:13.786 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:13.787 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-08-17T02:26:13.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:13.824 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-08-17T02:26:13.873 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:26:13.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:13.874 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2024-08-17T02:26:13.881 INFO:teuthology.orchestra.run.smithi102.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:26:13.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:13.881 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-08-17T02:26:13.881 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-08-17T02:26:13.882 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:26:13.882 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:26:13.882 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-08-17T02:26:13.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:13.955 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:26:13.968 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:13.968 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:13.968 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:13.968 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.968 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:13.968 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.968 INFO:teuthology.orchestra.run.smithi102.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:13.968 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 9e:4c:63:e3:88:0e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:13.969 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:13.969 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.969 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::9c4c:63ff:fee3:880e/64 scope link 2024-08-17T02:26:13.969 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:13.970 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:26:13.982 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:13.982 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.983 INFO:teuthology.orchestra.run.smithi102.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 9e:4c:63:e3:88:0e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::9c4c:63ff:fee3:880e/64 scope link 2024-08-17T02:26:13.983 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.984 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:26:13.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:13.985 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-08-17T02:26:13.985 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-08-17T02:26:13.985 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:26:13.985 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:13.985 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:26:13.985 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:26:13.985 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:26:13.985 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-08-17T02:26:14.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:14.086 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-08-17T02:26:14.086 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-08-17T02:26:14.087 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.1 up 2024-08-17T02:26:14.087 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:26:14.087 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-08-17T02:26:14.114 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-08-17T02:26:14.114 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:14.114 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:14.120 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:26:14.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:14.120 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:14.167 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2024-08-17T02:26:14.182 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:14.182 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:14.192 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:14.193 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:14.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:14.194 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2024-08-17T02:26:14.199 INFO:teuthology.orchestra.run.smithi102.stdout:52 2024-08-17T02:26:14.199 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-08-17T02:26:14.199 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-08-17T02:26:14.201 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2024-08-17T02:26:14.216 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:14.216 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:14.274 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:14.275 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:14.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:14.275 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2024-08-17T02:26:14.276 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi102.stderr:2024-08-17T02:26:14.273+0000 7f3f52b02380 -1 init, newargv = 0x55b1deb479a0 newargc=15 2024-08-17T02:26:14.277 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi102.stderr:ceph-fuse[31320]: starting ceph client 2024-08-17T02:26:14.281 INFO:teuthology.orchestra.run.smithi102.stdout:52 2024-08-17T02:26:14.285 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi102.stderr:ceph-fuse[31320]: starting fuse 2024-08-17T02:26:15.382 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2024-08-17T02:26:15.401 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:15.402 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:15.461 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:15.462 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:15.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:15.463 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2024-08-17T02:26:15.470 INFO:teuthology.orchestra.run.smithi102.stdout:52 2024-08-17T02:26:15.470 INFO:teuthology.orchestra.run.smithi102.stdout:53 2024-08-17T02:26:15.470 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-08-17T02:26:15.471 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:26:15.471 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2024-08-17T02:26:15.471 DEBUG:teuthology.orchestra.run.smithi102:> import re 2024-08-17T02:26:15.471 DEBUG:teuthology.orchestra.run.smithi102:> import os 2024-08-17T02:26:15.471 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2024-08-17T02:26:15.471 DEBUG:teuthology.orchestra.run.smithi102:> 2024-08-17T02:26:15.471 DEBUG:teuthology.orchestra.run.smithi102:> def _find_admin_socket(client_name): 2024-08-17T02:26:15.471 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-08-17T02:26:15.471 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2024-08-17T02:26:15.471 DEBUG:teuthology.orchestra.run.smithi102:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-08-17T02:26:15.471 DEBUG:teuthology.orchestra.run.smithi102:> 2024-08-17T02:26:15.471 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2024-08-17T02:26:15.471 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2024-08-17T02:26:15.472 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2024-08-17T02:26:15.472 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2024-08-17T02:26:15.472 DEBUG:teuthology.orchestra.run.smithi102:> 2024-08-17T02:26:15.472 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2024-08-17T02:26:15.472 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:26:15.472 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:26:15.472 DEBUG:teuthology.orchestra.run.smithi102:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:26:15.472 DEBUG:teuthology.orchestra.run.smithi102:> contents = proc_f.read() 2024-08-17T02:26:15.472 DEBUG:teuthology.orchestra.run.smithi102:> if mountpoint in contents: 2024-08-17T02:26:15.472 DEBUG:teuthology.orchestra.run.smithi102:> return f 2024-08-17T02:26:15.472 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:26:15.472 DEBUG:teuthology.orchestra.run.smithi102:> 2024-08-17T02:26:15.473 DEBUG:teuthology.orchestra.run.smithi102:> print(_find_admin_socket("client.2")) 2024-08-17T02:26:15.473 DEBUG:teuthology.orchestra.run.smithi102:> ' 2024-08-17T02:26:15.551 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.2.31320.asok 2024-08-17T02:26:15.737 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.31320.asok 2024-08-17T02:26:15.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:15.737 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.31320.asok status 2024-08-17T02:26:15.879 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "2", 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "31320", 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4683, 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 4683 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3562424479 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3562424479 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.4683 192.168.0.2:0/3562424479", 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "192.168.0.2:0/3562424479", 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 6, 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 21, 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklisted": false, 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-08-17T02:26:15.888 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:15.997+0000 7fe811e82700 1 Processor -- start 2024-08-17T02:26:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811e82700 1 -- start start 2024-08-17T02:26:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811e82700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe80c06e9d0 0x7fe80c06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811e82700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe80c155720 0x7fe80c0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811e82700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c0aba70 con 0x7fe80c0ab540 2024-08-17T02:26:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811e82700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c0abd50 con 0x7fe80c155720 2024-08-17T02:26:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811e82700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c0ac030 con 0x7fe80c06e9d0 2024-08-17T02:26:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe80bfff700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe80c0ab540 0x7fe80c155010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47470/0 (socket says 172.21.15.102:47470) 2024-08-17T02:26:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811681700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe80c155720 0x7fe80c0b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe80bfff700 1 -- 172.21.15.102:0/3243128196 learned_addr learned my addr 172.21.15.102:0/3243128196 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:16.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe810e80700 1 --2- 172.21.15.102:0/3243128196 >> v2:172.21.15.121:3300/0 conn(0x7fe80c06e9d0 0x7fe80c06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe80b7fe700 1 -- 172.21.15.102:0/3243128196 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519641521 0 0) 0x7fe80c0aba70 con 0x7fe80c0ab540 2024-08-17T02:26:16.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe80b7fe700 1 -- 172.21.15.102:0/3243128196 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7f8003570 con 0x7fe80c0ab540 2024-08-17T02:26:16.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811681700 1 -- 172.21.15.102:0/3243128196 >> v2:172.21.15.121:3300/0 conn(0x7fe80c06e9d0 msgr2=0x7fe80c06eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:16.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811681700 1 --2- 172.21.15.102:0/3243128196 >> v2:172.21.15.121:3300/0 conn(0x7fe80c06e9d0 0x7fe80c06eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811681700 1 -- 172.21.15.102:0/3243128196 >> v1:172.21.15.102:6789/0 conn(0x7fe80c0ab540 legacy=0x7fe80c155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811681700 1 -- 172.21.15.102:0/3243128196 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c0ac310 con 0x7fe80c155720 2024-08-17T02:26:16.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe810e80700 1 --2- 172.21.15.102:0/3243128196 >> v2:172.21.15.121:3300/0 conn(0x7fe80c06e9d0 0x7fe80c06eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:16.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811681700 1 --2- 172.21.15.102:0/3243128196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe80c155720 0x7fe80c0b1320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe80c06c910 tx=0x7fe804009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77520bd379fdcc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe80b7fe700 1 -- 172.21.15.102:0/3243128196 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80400e070 con 0x7fe80c155720 2024-08-17T02:26:16.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe80b7fe700 1 -- 172.21.15.102:0/3243128196 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80400bb60 con 0x7fe80c155720 2024-08-17T02:26:16.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe80b7fe700 1 -- 172.21.15.102:0/3243128196 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804012430 con 0x7fe80c155720 2024-08-17T02:26:16.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811e82700 1 -- 172.21.15.102:0/3243128196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe80c155720 msgr2=0x7fe80c0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811e82700 1 --2- 172.21.15.102:0/3243128196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe80c155720 0x7fe80c0b1320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe80c06c910 tx=0x7fe804009780 comp rx=0 tx=0).stop 2024-08-17T02:26:16.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811e82700 1 -- 172.21.15.102:0/3243128196 shutdown_connections 2024-08-17T02:26:16.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811e82700 1 --2- 172.21.15.102:0/3243128196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe80c155720 0x7fe80c0b1320 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811e82700 1 --2- 172.21.15.102:0/3243128196 >> v2:172.21.15.121:3300/0 conn(0x7fe80c06e9d0 0x7fe80c06eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811e82700 1 -- 172.21.15.102:0/3243128196 >> 172.21.15.102:0/3243128196 conn(0x7fe80c0678d0 msgr2=0x7fe80c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811e82700 1 -- 172.21.15.102:0/3243128196 shutdown_connections 2024-08-17T02:26:16.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.001+0000 7fe811e82700 1 -- 172.21.15.102:0/3243128196 wait complete. 2024-08-17T02:26:16.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.005+0000 7fe811e82700 1 Processor -- start 2024-08-17T02:26:16.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.005+0000 7fe811e82700 1 -- start start 2024-08-17T02:26:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.005+0000 7fe811e82700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe80c06e9d0 0x7fe80c155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.005+0000 7fe811e82700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe80c0ab540 0x7fe80c1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.005+0000 7fe811e82700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe80c155720 0x7fe80c15af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.005+0000 7fe811e82700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c153da0 con 0x7fe80c06e9d0 2024-08-17T02:26:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.005+0000 7fe810e80700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe80c06e9d0 0x7fe80c155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.005+0000 7fe810e80700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe80c06e9d0 0x7fe80c155f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43614/0 (socket says 172.21.15.102:43614) 2024-08-17T02:26:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.005+0000 7fe810e80700 1 -- 172.21.15.102:0/1985874641 learned_addr learned my addr 172.21.15.102:0/1985874641 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.005+0000 7fe811e82700 1 -- 172.21.15.102:0/1985874641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c152f10 con 0x7fe80c155720 2024-08-17T02:26:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.005+0000 7fe811e82700 1 -- 172.21.15.102:0/1985874641 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c153190 con 0x7fe80c0ab540 2024-08-17T02:26:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.005+0000 7fe80bfff700 1 --2- 172.21.15.102:0/1985874641 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe80c0ab540 0x7fe80c1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.005+0000 7fe811681700 1 --2- 172.21.15.102:0/1985874641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe80c155720 0x7fe80c15af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe810e80700 1 -- 172.21.15.102:0/1985874641 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe80c0ab540 msgr2=0x7fe80c1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe810e80700 1 --2- 172.21.15.102:0/1985874641 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe80c0ab540 0x7fe80c1529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe810e80700 1 -- 172.21.15.102:0/1985874641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe80c155720 msgr2=0x7fe80c15af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe810e80700 1 --2- 172.21.15.102:0/1985874641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe80c155720 0x7fe80c15af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe810e80700 1 -- 172.21.15.102:0/1985874641 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804009a20 con 0x7fe80c06e9d0 2024-08-17T02:26:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe811681700 1 --2- 172.21.15.102:0/1985874641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe80c155720 0x7fe80c15af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe810e80700 1 --2- 172.21.15.102:0/1985874641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe80c06e9d0 0x7fe80c155f10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400e900 tx=0x7fe7f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe808ff9700 1 -- 172.21.15.102:0/1985874641 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4013410 con 0x7fe80c06e9d0 2024-08-17T02:26:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe808ff9700 1 -- 172.21.15.102:0/1985874641 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f4013570 con 0x7fe80c06e9d0 2024-08-17T02:26:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe811e82700 1 -- 172.21.15.102:0/1985874641 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c153470 con 0x7fe80c06e9d0 2024-08-17T02:26:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe808ff9700 1 -- 172.21.15.102:0/1985874641 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4013910 con 0x7fe80c06e9d0 2024-08-17T02:26:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe811e82700 1 -- 172.21.15.102:0/1985874641 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c153a30 con 0x7fe80c06e9d0 2024-08-17T02:26:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe811e82700 1 -- 172.21.15.102:0/1985874641 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c0643a0 con 0x7fe80c06e9d0 2024-08-17T02:26:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe808ff9700 1 -- 172.21.15.102:0/1985874641 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe7f4013cc0 con 0x7fe80c06e9d0 2024-08-17T02:26:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe808ff9700 1 --2- 172.21.15.102:0/1985874641 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe7ec060860 0x7fe7ec062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe808ff9700 1 -- 172.21.15.102:0/1985874641 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe7f407c830 con 0x7fe80c06e9d0 2024-08-17T02:26:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.009+0000 7fe80bfff700 1 --2- 172.21.15.102:0/1985874641 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe7ec060860 0x7fe7ec062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.013+0000 7fe80bfff700 1 --2- 172.21.15.102:0/1985874641 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe7ec060860 0x7fe7ec062d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe80c06e100 tx=0x7fe7fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.017+0000 7fe808ff9700 1 -- 172.21.15.102:0/1985874641 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe7f4050710 con 0x7fe80c06e9d0 2024-08-17T02:26:16.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.217+0000 7fe811e82700 1 -- 172.21.15.102:0/1985874641 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe80c06f5f0 con 0x7fe80c06e9d0 2024-08-17T02:26:16.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.217+0000 7fe808ff9700 1 -- 172.21.15.102:0/1985874641 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe7f4020070 con 0x7fe80c06e9d0 2024-08-17T02:26:16.221 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:16.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.221+0000 7fe811e82700 1 -- 172.21.15.102:0/1985874641 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe7ec060860 msgr2=0x7fe7ec062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.221+0000 7fe811e82700 1 --2- 172.21.15.102:0/1985874641 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe7ec060860 0x7fe7ec062d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe80c06e100 tx=0x7fe7fc009040 comp rx=0 tx=0).stop 2024-08-17T02:26:16.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.221+0000 7fe811e82700 1 -- 172.21.15.102:0/1985874641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe80c06e9d0 msgr2=0x7fe80c155f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.221+0000 7fe811e82700 1 --2- 172.21.15.102:0/1985874641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe80c06e9d0 0x7fe80c155f10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400e900 tx=0x7fe7f4008040 comp rx=0 tx=0).stop 2024-08-17T02:26:16.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.221+0000 7fe811e82700 1 -- 172.21.15.102:0/1985874641 shutdown_connections 2024-08-17T02:26:16.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.221+0000 7fe811e82700 1 --2- 172.21.15.102:0/1985874641 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe7ec060860 0x7fe7ec062d10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.221+0000 7fe811e82700 1 --2- 172.21.15.102:0/1985874641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe80c155720 0x7fe80c15af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.221+0000 7fe811e82700 1 --2- 172.21.15.102:0/1985874641 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe80c0ab540 0x7fe80c1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.221+0000 7fe811e82700 1 --2- 172.21.15.102:0/1985874641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe80c06e9d0 0x7fe80c155f10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.221+0000 7fe811e82700 1 -- 172.21.15.102:0/1985874641 >> 172.21.15.102:0/1985874641 conn(0x7fe80c0678d0 msgr2=0x7fe80c06cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.221+0000 7fe811e82700 1 -- 172.21.15.102:0/1985874641 shutdown_connections 2024-08-17T02:26:16.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:16.221+0000 7fe811e82700 1 -- 172.21.15.102:0/1985874641 wait complete. 2024-08-17T02:26:16.239 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:16.239 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:16.239 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-08-17T02:26:16.239 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:26:16.239 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:16.239 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:16.239 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:16.239 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:16.239 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:26:16.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:16.240 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-08-17T02:26:16.248 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:16.248 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:16.248 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:16.248 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:16.248 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:16.248 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:16.248 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:16.248 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:16.248 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:16.248 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:16.248 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:16.249 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:16.249 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:16.249 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:16.249 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:26:16.249 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42596sec preferred_lft 42596sec 2024-08-17T02:26:16.249 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link 2024-08-17T02:26:16.249 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:16.249 INFO:teuthology.orchestra.run.smithi121.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:26:16.249 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 02:42:b7:03:fd:58 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:16.249 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:26:16.249 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:16.249 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:26:16.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:16.250 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2024-08-17T02:26:16.250 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-08-17T02:26:16.250 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:26:16.250 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr flush dev ceph-brx 2024-08-17T02:26:16.250 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set ceph-brx up 2024-08-17T02:26:16.250 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:26:16.250 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-08-17T02:26:16.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:16.298 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:16.308 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-08-17T02:26:16.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:16.309 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-08-17T02:26:16.333 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-08-17T02:26:16.333 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:16.333 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:26:16.333 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:16.333 INFO:teuthology.orchestra.run.smithi121.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:26:16.334 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:26:16.334 INFO:teuthology.orchestra.run.smithi121.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:26:16.334 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:16.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:16.334 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2024-08-17T02:26:16.334 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-08-17T02:26:16.334 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:16.334 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:16.334 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:16.334 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-08-17T02:26:16.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:16.375 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-08-17T02:26:16.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:16.424 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list-id 2024-08-17T02:26:16.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:16.431 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2024-08-17T02:26:16.431 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-08-17T02:26:16.431 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:26:16.431 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:26:16.431 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-08-17T02:26:16.461 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:26:16.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:16.461 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2024-08-17T02:26:16.462 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-08-17T02:26:16.462 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:26:16.462 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:16.462 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:26:16.462 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:26:16.462 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:26:16.462 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-08-17T02:26:16.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:16.539 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2024-08-17T02:26:16.539 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-08-17T02:26:16.539 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-08-17T02:26:16.539 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:26:16.539 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-08-17T02:26:16.565 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-17T02:26:16.565 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:16.565 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:16.572 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:26:16.572 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:16.572 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:16.577 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-08-17T02:26:16.591 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:16.591 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:16.647 INFO:teuthology.orchestra.run.smithi121.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:16.647 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:16.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:16.649 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-08-17T02:26:16.654 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:26:16.655 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-17T02:26:16.657 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-08-17T02:26:16.672 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:16.672 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:16.727 INFO:teuthology.orchestra.run.smithi121.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:16.728 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:16.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:16.729 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-08-17T02:26:16.740 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:2024-08-17T02:26:16.736+0000 7f3c08028380 -1 init, newargv = 0x55bcefdce500 newargc=15 2024-08-17T02:26:16.741 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[29226]: starting ceph client 2024-08-17T02:26:16.749 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[29226]: starting fuse 2024-08-17T02:26:17.835 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-08-17T02:26:17.854 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:17.854 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:17.912 INFO:teuthology.orchestra.run.smithi121.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:17.913 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:17.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:17.914 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-08-17T02:26:17.921 INFO:teuthology.orchestra.run.smithi121.stdout:52 2024-08-17T02:26:17.921 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:26:17.921 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:26:17.921 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-08-17T02:26:17.921 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-08-17T02:26:17.921 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-08-17T02:26:17.922 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-08-17T02:26:17.922 DEBUG:teuthology.orchestra.run.smithi121:> 2024-08-17T02:26:17.922 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-08-17T02:26:17.922 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-17T02:26:17.922 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-08-17T02:26:17.922 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-17T02:26:17.922 DEBUG:teuthology.orchestra.run.smithi121:> 2024-08-17T02:26:17.922 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-08-17T02:26:17.922 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-08-17T02:26:17.922 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-08-17T02:26:17.922 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-08-17T02:26:17.922 DEBUG:teuthology.orchestra.run.smithi121:> 2024-08-17T02:26:17.922 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-08-17T02:26:17.922 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:26:17.923 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:26:17.923 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:26:17.923 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-08-17T02:26:17.923 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-08-17T02:26:17.923 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-08-17T02:26:17.923 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:26:17.923 DEBUG:teuthology.orchestra.run.smithi121:> 2024-08-17T02:26:17.923 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-08-17T02:26:17.923 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-08-17T02:26:18.002 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.29226.asok 2024-08-17T02:26:18.185 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.29226.asok 2024-08-17T02:26:18.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:18.186 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.29226.asok status 2024-08-17T02:26:18.276 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-17T02:26:18.276 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-08-17T02:26:18.276 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:26:18.276 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:26:18.277 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "1", 2024-08-17T02:26:18.277 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-08-17T02:26:18.277 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-17T02:26:18.277 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "29226", 2024-08-17T02:26:18.277 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-08-17T02:26:18.277 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-17T02:26:18.277 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-08-17T02:26:18.277 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-08-17T02:26:18.277 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4508, 2024-08-17T02:26:18.277 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-08-17T02:26:18.277 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-08-17T02:26:18.277 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-08-17T02:26:18.277 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4508 2024-08-17T02:26:18.277 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-17T02:26:18.278 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-08-17T02:26:18.278 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-08-17T02:26:18.278 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:26:18.278 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 2148349067 2024-08-17T02:26:18.278 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-17T02:26:18.278 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-17T02:26:18.278 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-08-17T02:26:18.278 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-08-17T02:26:18.278 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:26:18.278 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 2148349067 2024-08-17T02:26:18.278 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-17T02:26:18.278 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4508 192.168.0.1:0/2148349067", 2024-08-17T02:26:18.278 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.1:0/2148349067", 2024-08-17T02:26:18.279 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-08-17T02:26:18.279 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 6, 2024-08-17T02:26:18.279 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 21, 2024-08-17T02:26:18.279 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:26:18.279 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-08-17T02:26:18.279 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2024-08-17T02:26:18.279 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-17T02:26:18.285 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:18.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.397+0000 7f9940779700 1 Processor -- start 2024-08-17T02:26:18.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.397+0000 7f9940779700 1 -- start start 2024-08-17T02:26:18.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f9940779700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9938068ca0 0x7f99380cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f9940779700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f993806a470 0x7f993806a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f9940779700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99380c7750 con 0x7f99380688d0 2024-08-17T02:26:18.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f9940779700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99380cb220 con 0x7f993806a470 2024-08-17T02:26:18.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f9940779700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99380c6e20 con 0x7f9938068ca0 2024-08-17T02:26:18.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f993e515700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f99380688d0 0x7f99380caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47484/0 (socket says 172.21.15.102:47484) 2024-08-17T02:26:18.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f993e515700 1 -- 172.21.15.102:0/2366617307 learned_addr learned my addr 172.21.15.102:0/2366617307 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:18.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f993ed16700 1 --2- 172.21.15.102:0/2366617307 >> v2:172.21.15.102:3300/0 conn(0x7f993806a470 0x7f993806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f993dd14700 1 --2- 172.21.15.102:0/2366617307 >> v2:172.21.15.121:3300/0 conn(0x7f9938068ca0 0x7f99380cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f993d513700 1 -- 172.21.15.102:0/2366617307 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809109285 0 0) 0x7f99380c7750 con 0x7f99380688d0 2024-08-17T02:26:18.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f993d513700 1 -- 172.21.15.102:0/2366617307 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9928003570 con 0x7f99380688d0 2024-08-17T02:26:18.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f993ed16700 1 -- 172.21.15.102:0/2366617307 >> v2:172.21.15.121:3300/0 conn(0x7f9938068ca0 msgr2=0x7f99380cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:18.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f993ed16700 1 --2- 172.21.15.102:0/2366617307 >> v2:172.21.15.121:3300/0 conn(0x7f9938068ca0 0x7f99380cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f993ed16700 1 -- 172.21.15.102:0/2366617307 >> v1:172.21.15.102:6789/0 conn(0x7f99380688d0 legacy=0x7f99380caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f993ed16700 1 -- 172.21.15.102:0/2366617307 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99380c7100 con 0x7f993806a470 2024-08-17T02:26:18.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f993ed16700 1 --2- 172.21.15.102:0/2366617307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f993806a470 0x7f993806a870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9938159380 tx=0x7f993000a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae2342d4618240 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:18.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f993d513700 1 -- 172.21.15.102:0/2366617307 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993000aea0 con 0x7f993806a470 2024-08-17T02:26:18.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f993d513700 1 -- 172.21.15.102:0/2366617307 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993000c970 con 0x7f993806a470 2024-08-17T02:26:18.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f993d513700 1 -- 172.21.15.102:0/2366617307 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993000cd10 con 0x7f993806a470 2024-08-17T02:26:18.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f9940779700 1 -- 172.21.15.102:0/2366617307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f993806a470 msgr2=0x7f993806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f9940779700 1 --2- 172.21.15.102:0/2366617307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f993806a470 0x7f993806a870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9938159380 tx=0x7f993000a330 comp rx=0 tx=0).stop 2024-08-17T02:26:18.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f9940779700 1 -- 172.21.15.102:0/2366617307 shutdown_connections 2024-08-17T02:26:18.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f9940779700 1 --2- 172.21.15.102:0/2366617307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f993806a470 0x7f993806a870 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f9940779700 1 --2- 172.21.15.102:0/2366617307 >> v2:172.21.15.121:3300/0 conn(0x7f9938068ca0 0x7f99380cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f9940779700 1 -- 172.21.15.102:0/2366617307 >> 172.21.15.102:0/2366617307 conn(0x7f99380c9c20 msgr2=0x7f993806d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:18.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f9940779700 1 -- 172.21.15.102:0/2366617307 shutdown_connections 2024-08-17T02:26:18.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.401+0000 7f9940779700 1 -- 172.21.15.102:0/2366617307 wait complete. 2024-08-17T02:26:18.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f9940779700 1 Processor -- start 2024-08-17T02:26:18.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f9940779700 1 -- start start 2024-08-17T02:26:18.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f9940779700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99380688d0 0x7f9938148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f9940779700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9938068ca0 0x7f99380ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f9940779700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f993806a470 0x7f99380adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f9940779700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9938148750 con 0x7f993806a470 2024-08-17T02:26:18.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f9940779700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99380ac490 con 0x7f9938068ca0 2024-08-17T02:26:18.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f9940779700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9938165880 con 0x7f99380688d0 2024-08-17T02:26:18.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f993ed16700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f993806a470 0x7f99380adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f993e515700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99380688d0 0x7f9938148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f993e515700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99380688d0 0x7f9938148210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:41430/0 (socket says 172.21.15.102:41430) 2024-08-17T02:26:18.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f993e515700 1 -- 172.21.15.102:0/932001535 learned_addr learned my addr 172.21.15.102:0/932001535 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:18.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f993dd14700 1 --2- 172.21.15.102:0/932001535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9938068ca0 0x7f99380ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f993ed16700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f993806a470 0x7f99380adb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43636/0 (socket says 172.21.15.102:43636) 2024-08-17T02:26:18.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f993ed16700 1 -- 172.21.15.102:0/932001535 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99380688d0 msgr2=0x7f9938148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f993ed16700 1 --2- 172.21.15.102:0/932001535 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99380688d0 0x7f9938148210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f993ed16700 1 -- 172.21.15.102:0/932001535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9938068ca0 msgr2=0x7f99380ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f993ed16700 1 --2- 172.21.15.102:0/932001535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9938068ca0 0x7f99380ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f993ed16700 1 -- 172.21.15.102:0/932001535 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993000a5d0 con 0x7f993806a470 2024-08-17T02:26:18.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.405+0000 7f993ed16700 1 --2- 172.21.15.102:0/932001535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f993806a470 0x7f99380adb70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9930017000 tx=0x7f993001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:18.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.409+0000 7f99367fc700 1 -- 172.21.15.102:0/932001535 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9930019e90 con 0x7f993806a470 2024-08-17T02:26:18.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.409+0000 7f99367fc700 1 -- 172.21.15.102:0/932001535 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9930010600 con 0x7f993806a470 2024-08-17T02:26:18.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.409+0000 7f9940779700 1 -- 172.21.15.102:0/932001535 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99380abb60 con 0x7f993806a470 2024-08-17T02:26:18.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.409+0000 7f99367fc700 1 -- 172.21.15.102:0/932001535 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99300109e0 con 0x7f993806a470 2024-08-17T02:26:18.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.409+0000 7f9940779700 1 -- 172.21.15.102:0/932001535 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99380ac120 con 0x7f993806a470 2024-08-17T02:26:18.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.409+0000 7f9940779700 1 -- 172.21.15.102:0/932001535 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99380645c0 con 0x7f993806a470 2024-08-17T02:26:18.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.409+0000 7f99367fc700 1 -- 172.21.15.102:0/932001535 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9930022400 con 0x7f993806a470 2024-08-17T02:26:18.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.409+0000 7f99367fc700 1 --2- 172.21.15.102:0/932001535 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f991c060860 0x7f991c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.409+0000 7f993e515700 1 --2- 172.21.15.102:0/932001535 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f991c060860 0x7f991c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.409+0000 7f99367fc700 1 -- 172.21.15.102:0/932001535 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f993007dc20 con 0x7f993806a470 2024-08-17T02:26:18.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.413+0000 7f993e515700 1 --2- 172.21.15.102:0/932001535 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f991c060860 0x7f991c062d10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f992c002250 tx=0x7f992c001ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:18.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.417+0000 7f99367fc700 1 -- 172.21.15.102:0/932001535 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f993004e120 con 0x7f993806a470 2024-08-17T02:26:18.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.617+0000 7f9940779700 1 -- 172.21.15.102:0/932001535 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f99380ac5d0 con 0x7f993806a470 2024-08-17T02:26:18.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.617+0000 7f99367fc700 1 -- 172.21.15.102:0/932001535 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9930051740 con 0x7f993806a470 2024-08-17T02:26:18.619 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:18.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.617+0000 7f9940779700 1 -- 172.21.15.102:0/932001535 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f991c060860 msgr2=0x7f991c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.617+0000 7f9940779700 1 --2- 172.21.15.102:0/932001535 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f991c060860 0x7f991c062d10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f992c002250 tx=0x7f992c001ba0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.617+0000 7f9940779700 1 -- 172.21.15.102:0/932001535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f993806a470 msgr2=0x7f99380adb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.617+0000 7f9940779700 1 --2- 172.21.15.102:0/932001535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f993806a470 0x7f99380adb70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9930017000 tx=0x7f993001a000 comp rx=0 tx=0).stop 2024-08-17T02:26:18.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.617+0000 7f9940779700 1 -- 172.21.15.102:0/932001535 shutdown_connections 2024-08-17T02:26:18.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.617+0000 7f9940779700 1 --2- 172.21.15.102:0/932001535 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f991c060860 0x7f991c062d10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.617+0000 7f9940779700 1 --2- 172.21.15.102:0/932001535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f993806a470 0x7f99380adb70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.617+0000 7f9940779700 1 --2- 172.21.15.102:0/932001535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9938068ca0 0x7f99380ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.617+0000 7f9940779700 1 --2- 172.21.15.102:0/932001535 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f99380688d0 0x7f9938148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.617+0000 7f9940779700 1 -- 172.21.15.102:0/932001535 >> 172.21.15.102:0/932001535 conn(0x7f99380c9c20 msgr2=0x7f99380677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:18.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.621+0000 7f9940779700 1 -- 172.21.15.102:0/932001535 shutdown_connections 2024-08-17T02:26:18.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:18.621+0000 7f9940779700 1 -- 172.21.15.102:0/932001535 wait complete. 2024-08-17T02:26:18.633 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:18.633 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:18.633 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-08-17T02:26:18.633 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:26:18.633 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:18.633 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:18.633 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:18.633 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:18.633 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:26:18.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.634 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-08-17T02:26:18.642 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:18.642 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:18.642 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:18.642 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:18.642 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:18.643 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:18.643 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:18.643 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:18.643 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:18.643 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:18.643 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:18.643 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:18.643 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:18.643 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:18.643 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:26:18.643 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42594sec preferred_lft 42594sec 2024-08-17T02:26:18.643 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link 2024-08-17T02:26:18.643 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:18.644 INFO:teuthology.orchestra.run.smithi121.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:26:18.644 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 02:42:b7:03:fd:58 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:18.644 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:26:18.644 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:18.644 INFO:teuthology.orchestra.run.smithi121.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:18.644 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether da:87:b7:be:45:fe brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:18.644 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:26:18.644 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:18.644 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::f487:1dff:fe5e:1539/64 scope link 2024-08-17T02:26:18.645 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:18.645 INFO:teuthology.orchestra.run.smithi121.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:18.645 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether da:87:b7:be:45:fe brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:26:18.645 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::d887:b7ff:febe:45fe/64 scope link 2024-08-17T02:26:18.645 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:18.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.645 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:18.660 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-08-17T02:26:18.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.662 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-08-17T02:26:18.713 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-08-17T02:26:18.714 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:18.714 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:26:18.714 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:18.714 INFO:teuthology.orchestra.run.smithi121.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:26:18.714 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:26:18.714 INFO:teuthology.orchestra.run.smithi121.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:26:18.714 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:18.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.715 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2024-08-17T02:26:18.715 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-08-17T02:26:18.715 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:18.715 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:18.715 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:18.715 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-08-17T02:26:18.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.753 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-08-17T02:26:18.759 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:26:18.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.759 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list-id 2024-08-17T02:26:18.766 INFO:teuthology.orchestra.run.smithi121.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:26:18.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.766 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2024-08-17T02:26:18.766 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-08-17T02:26:18.766 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:26:18.766 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:26:18.766 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-08-17T02:26:18.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.796 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:26:18.854 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:18.854 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:18.854 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:18.854 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:18.854 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:18.854 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:18.855 INFO:teuthology.orchestra.run.smithi121.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:18.855 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether a6:ab:e3:e6:dc:b3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:18.855 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:18.855 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:18.855 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::a4ab:e3ff:fee6:dcb3/64 scope link 2024-08-17T02:26:18.855 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:18.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.856 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:26:18.869 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:18.869 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:18.869 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:18.869 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:18.869 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:18.869 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:18.869 INFO:teuthology.orchestra.run.smithi121.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:18.870 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether a6:ab:e3:e6:dc:b3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:18.870 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:18.870 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:18.870 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::a4ab:e3ff:fee6:dcb3/64 scope link 2024-08-17T02:26:18.870 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:18.871 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:26:18.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.871 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2024-08-17T02:26:18.871 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-08-17T02:26:18.871 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:26:18.871 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:18.871 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:26:18.871 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:26:18.872 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:26:18.872 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-08-17T02:26:18.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.923 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2024-08-17T02:26:18.923 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-08-17T02:26:18.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.1 up 2024-08-17T02:26:18.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:26:18.924 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-08-17T02:26:18.950 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-08-17T02:26:18.950 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:18.950 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:18.957 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:26:18.957 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:18.957 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:18.964 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-08-17T02:26:19.019 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:19.019 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:19.034 INFO:teuthology.orchestra.run.smithi121.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:19.034 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:19.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:19.035 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-08-17T02:26:19.041 INFO:teuthology.orchestra.run.smithi121.stdout:52 2024-08-17T02:26:19.041 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-08-17T02:26:19.041 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-08-17T02:26:19.044 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-08-17T02:26:19.057 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:19.058 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:19.116 INFO:teuthology.orchestra.run.smithi121.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:19.116 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:19.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:19.117 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-08-17T02:26:19.124 INFO:teuthology.orchestra.run.smithi121.stdout:52 2024-08-17T02:26:19.124 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi121.stderr:2024-08-17T02:26:19.120+0000 7f1e6d37d380 -1 init, newargv = 0x55643f4e9ce0 newargc=15 2024-08-17T02:26:19.124 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi121.stderr:ceph-fuse[29339]: starting ceph client 2024-08-17T02:26:19.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi121.stderr:ceph-fuse[29339]: starting fuse 2024-08-17T02:26:20.225 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-08-17T02:26:20.246 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:20.246 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:20.303 INFO:teuthology.orchestra.run.smithi121.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:20.304 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:20.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:20.304 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-08-17T02:26:20.309 INFO:teuthology.orchestra.run.smithi121.stdout:52 2024-08-17T02:26:20.309 INFO:teuthology.orchestra.run.smithi121.stdout:53 2024-08-17T02:26:20.309 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-08-17T02:26:20.309 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:26:20.309 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-08-17T02:26:20.310 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-08-17T02:26:20.310 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-08-17T02:26:20.310 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-08-17T02:26:20.310 DEBUG:teuthology.orchestra.run.smithi121:> 2024-08-17T02:26:20.310 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-08-17T02:26:20.310 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-08-17T02:26:20.310 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-08-17T02:26:20.310 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-08-17T02:26:20.310 DEBUG:teuthology.orchestra.run.smithi121:> 2024-08-17T02:26:20.310 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-08-17T02:26:20.310 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-08-17T02:26:20.310 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-08-17T02:26:20.310 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-08-17T02:26:20.310 DEBUG:teuthology.orchestra.run.smithi121:> 2024-08-17T02:26:20.311 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-08-17T02:26:20.311 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:26:20.311 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:26:20.311 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:26:20.311 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-08-17T02:26:20.311 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-08-17T02:26:20.311 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-08-17T02:26:20.311 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:26:20.311 DEBUG:teuthology.orchestra.run.smithi121:> 2024-08-17T02:26:20.311 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.3")) 2024-08-17T02:26:20.311 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-08-17T02:26:20.389 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.3.29339.asok 2024-08-17T02:26:20.575 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.29339.asok 2024-08-17T02:26:20.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:20.575 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.29339.asok status 2024-08-17T02:26:20.714 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-17T02:26:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-08-17T02:26:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:26:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:26:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "3", 2024-08-17T02:26:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-08-17T02:26:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-08-17T02:26:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "29339", 2024-08-17T02:26:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-08-17T02:26:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-17T02:26:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-08-17T02:26:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-08-17T02:26:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4514, 2024-08-17T02:26:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-08-17T02:26:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-08-17T02:26:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-08-17T02:26:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4514 2024-08-17T02:26:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-17T02:26:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-08-17T02:26:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-08-17T02:26:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:26:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 1972243717 2024-08-17T02:26:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-17T02:26:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-17T02:26:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-08-17T02:26:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-08-17T02:26:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:26:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 1972243717 2024-08-17T02:26:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-17T02:26:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4514 192.168.0.2:0/1972243717", 2024-08-17T02:26:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.2:0/1972243717", 2024-08-17T02:26:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-08-17T02:26:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 6, 2024-08-17T02:26:20.717 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 21, 2024-08-17T02:26:20.717 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:26:20.717 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-08-17T02:26:20.717 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2024-08-17T02:26:20.717 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-17T02:26:20.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:20.723 DEBUG:teuthology.orchestra.run.smithi102:> stat --file-system '--printf=%T 2024-08-17T02:26:20.723 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:20.731 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2024-08-17T02:26:20.732 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:20.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:20.732 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:20.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:20.793 DEBUG:teuthology.orchestra.run.smithi102:> stat --file-system '--printf=%T 2024-08-17T02:26:20.793 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:20.799 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2024-08-17T02:26:20.800 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:20.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:20.800 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:20.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:20.820 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-08-17T02:26:20.820 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:20.828 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-08-17T02:26:20.828 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:20.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:20.829 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:20.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:20.844 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-08-17T02:26:20.845 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:20.892 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-08-17T02:26:20.892 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:20.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:20.893 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:20.907 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:26:20.924 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:21.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbedd92f700 1 Processor -- start 2024-08-17T02:26:21.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbedd92f700 1 -- start start 2024-08-17T02:26:21.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbedd92f700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbed815d540 0x7fbed80af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbedd92f700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbed806e830 0x7fbed80a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbedd92f700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed80b0270 con 0x7fbed80a9260 2024-08-17T02:26:21.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbedd92f700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed80af660 con 0x7fbed815d540 2024-08-17T02:26:21.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbedd92f700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed80af940 con 0x7fbed806e830 2024-08-17T02:26:21.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbed6ffd700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbed815d540 0x7fbed80af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbed6ffd700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbed815d540 0x7fbed80af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43648/0 (socket says 172.21.15.102:43648) 2024-08-17T02:26:21.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbed6ffd700 1 -- 172.21.15.102:0/501381826 learned_addr learned my addr 172.21.15.102:0/501381826 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:21.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbed67fc700 1 --2- 172.21.15.102:0/501381826 >> v2:172.21.15.121:3300/0 conn(0x7fbed806e830 0x7fbed80a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbed6ffd700 1 -- 172.21.15.102:0/501381826 >> v2:172.21.15.121:3300/0 conn(0x7fbed806e830 msgr2=0x7fbed80a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbed6ffd700 1 --2- 172.21.15.102:0/501381826 >> v2:172.21.15.121:3300/0 conn(0x7fbed806e830 0x7fbed80a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbed6ffd700 1 -- 172.21.15.102:0/501381826 >> v1:172.21.15.121:6789/0 conn(0x7fbed80a9260 legacy=0x7fbed80b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbed6ffd700 1 -- 172.21.15.102:0/501381826 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed80afc20 con 0x7fbed815d540 2024-08-17T02:26:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbed6ffd700 1 --2- 172.21.15.102:0/501381826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbed815d540 0x7fbed80af030 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbed806c970 tx=0x7fbecc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c29be46806f726b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbed5ffb700 1 -- 172.21.15.102:0/501381826 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc009e70 con 0x7fbed815d540 2024-08-17T02:26:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbed5ffb700 1 -- 172.21.15.102:0/501381826 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc00b860 con 0x7fbed815d540 2024-08-17T02:26:21.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbed5ffb700 1 -- 172.21.15.102:0/501381826 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00bc00 con 0x7fbed815d540 2024-08-17T02:26:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbedd92f700 1 -- 172.21.15.102:0/501381826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbed815d540 msgr2=0x7fbed80af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbedd92f700 1 --2- 172.21.15.102:0/501381826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbed815d540 0x7fbed80af030 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbed806c970 tx=0x7fbecc009250 comp rx=0 tx=0).stop 2024-08-17T02:26:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbedd92f700 1 -- 172.21.15.102:0/501381826 shutdown_connections 2024-08-17T02:26:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbedd92f700 1 --2- 172.21.15.102:0/501381826 >> v2:172.21.15.121:3300/0 conn(0x7fbed806e830 0x7fbed80a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbedd92f700 1 --2- 172.21.15.102:0/501381826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbed815d540 0x7fbed80af030 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbedd92f700 1 -- 172.21.15.102:0/501381826 >> 172.21.15.102:0/501381826 conn(0x7fbed8066e00 msgr2=0x7fbed8067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbedd92f700 1 -- 172.21.15.102:0/501381826 shutdown_connections 2024-08-17T02:26:21.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.037+0000 7fbedd92f700 1 -- 172.21.15.102:0/501381826 wait complete. 2024-08-17T02:26:21.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbedd92f700 1 Processor -- start 2024-08-17T02:26:21.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbedd92f700 1 -- start start 2024-08-17T02:26:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbedd92f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbed806e830 0x7fbed8157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbedd92f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbed80a9260 0x7fbed8098980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbedd92f700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbed815d540 0x7fbed8159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbedd92f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed81583d0 con 0x7fbed806e830 2024-08-17T02:26:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbedd92f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed8096e40 con 0x7fbed80a9260 2024-08-17T02:26:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbedd92f700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed8097120 con 0x7fbed815d540 2024-08-17T02:26:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbed6ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbed806e830 0x7fbed8157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbed6ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbed806e830 0x7fbed8157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43652/0 (socket says 172.21.15.102:43652) 2024-08-17T02:26:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbed6ffd700 1 -- 172.21.15.102:0/1382619026 learned_addr learned my addr 172.21.15.102:0/1382619026 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbed67fc700 1 --2- 172.21.15.102:0/1382619026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbed80a9260 0x7fbed8098980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbed6ffd700 1 -- 172.21.15.102:0/1382619026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbed815d540 msgr2=0x7fbed8159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbed77fe700 1 --2- 172.21.15.102:0/1382619026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbed815d540 0x7fbed8159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbed6ffd700 1 --2- 172.21.15.102:0/1382619026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbed815d540 0x7fbed8159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbed6ffd700 1 -- 172.21.15.102:0/1382619026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbed80a9260 msgr2=0x7fbed8098980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbed6ffd700 1 --2- 172.21.15.102:0/1382619026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbed80a9260 0x7fbed8098980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbed6ffd700 1 -- 172.21.15.102:0/1382619026 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc0094f0 con 0x7fbed806e830 2024-08-17T02:26:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbed67fc700 1 --2- 172.21.15.102:0/1382619026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbed80a9260 0x7fbed8098980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbed77fe700 1 --2- 172.21.15.102:0/1382619026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbed815d540 0x7fbed8159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbed6ffd700 1 --2- 172.21.15.102:0/1382619026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbed806e830 0x7fbed8157e90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbed806f870 tx=0x7fbecc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.041+0000 7fbebeffd700 1 -- 172.21.15.102:0/1382619026 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc011420 con 0x7fbed806e830 2024-08-17T02:26:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.045+0000 7fbebeffd700 1 -- 172.21.15.102:0/1382619026 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc011580 con 0x7fbed806e830 2024-08-17T02:26:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.045+0000 7fbedd92f700 1 -- 172.21.15.102:0/1382619026 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed8097400 con 0x7fbed806e830 2024-08-17T02:26:21.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.045+0000 7fbebeffd700 1 -- 172.21.15.102:0/1382619026 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc011940 con 0x7fbed806e830 2024-08-17T02:26:21.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.045+0000 7fbedd92f700 1 -- 172.21.15.102:0/1382619026 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed80979c0 con 0x7fbed806e830 2024-08-17T02:26:21.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.045+0000 7fbedd92f700 1 -- 172.21.15.102:0/1382619026 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed80ab8f0 con 0x7fbed806e830 2024-08-17T02:26:21.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.045+0000 7fbebeffd700 1 -- 172.21.15.102:0/1382619026 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbecc011d30 con 0x7fbed806e830 2024-08-17T02:26:21.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.049+0000 7fbebeffd700 1 --2- 172.21.15.102:0/1382619026 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbec4060860 0x7fbec4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.049+0000 7fbebeffd700 1 -- 172.21.15.102:0/1382619026 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbecc07e2b0 con 0x7fbed806e830 2024-08-17T02:26:21.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.049+0000 7fbed67fc700 1 --2- 172.21.15.102:0/1382619026 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbec4060860 0x7fbec4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.049+0000 7fbed67fc700 1 --2- 172.21.15.102:0/1382619026 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbec4060860 0x7fbec4062d10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbed806a160 tx=0x7fbec8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.057+0000 7fbebeffd700 1 -- 172.21.15.102:0/1382619026 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbecc04e660 con 0x7fbed806e830 2024-08-17T02:26:21.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.221+0000 7fbedd92f700 1 -- 172.21.15.102:0/1382619026 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbed80645c0 con 0x7fbed806e830 2024-08-17T02:26:21.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.225+0000 7fbebeffd700 1 -- 172.21.15.102:0/1382619026 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fbecc051c80 con 0x7fbed806e830 2024-08-17T02:26:21.227 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:21.227 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:57.002263+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:53.562223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:54.343618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:21.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.225+0000 7fbedd92f700 1 -- 172.21.15.102:0/1382619026 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbec4060860 msgr2=0x7fbec4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.225+0000 7fbedd92f700 1 --2- 172.21.15.102:0/1382619026 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbec4060860 0x7fbec4062d10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbed806a160 tx=0x7fbec8008040 comp rx=0 tx=0).stop 2024-08-17T02:26:21.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.225+0000 7fbedd92f700 1 -- 172.21.15.102:0/1382619026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbed806e830 msgr2=0x7fbed8157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.225+0000 7fbedd92f700 1 --2- 172.21.15.102:0/1382619026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbed806e830 0x7fbed8157e90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbed806f870 tx=0x7fbecc017000 comp rx=0 tx=0).stop 2024-08-17T02:26:21.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.225+0000 7fbedd92f700 1 -- 172.21.15.102:0/1382619026 shutdown_connections 2024-08-17T02:26:21.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.225+0000 7fbedd92f700 1 --2- 172.21.15.102:0/1382619026 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbec4060860 0x7fbec4062d10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.225+0000 7fbedd92f700 1 --2- 172.21.15.102:0/1382619026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbed815d540 0x7fbed8159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.225+0000 7fbedd92f700 1 --2- 172.21.15.102:0/1382619026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbed80a9260 0x7fbed8098980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.225+0000 7fbedd92f700 1 --2- 172.21.15.102:0/1382619026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbed806e830 0x7fbed8157e90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.225+0000 7fbedd92f700 1 -- 172.21.15.102:0/1382619026 >> 172.21.15.102:0/1382619026 conn(0x7fbed8066e00 msgr2=0x7fbed815ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.225+0000 7fbedd92f700 1 -- 172.21.15.102:0/1382619026 shutdown_connections 2024-08-17T02:26:21.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.225+0000 7fbedd92f700 1 -- 172.21.15.102:0/1382619026 wait complete. 2024-08-17T02:26:21.241 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:49.236728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:53.562223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:54.343618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:21.241 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:21.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c3a2a700 1 Processor -- start 2024-08-17T02:26:21.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c3a2a700 1 -- start start 2024-08-17T02:26:21.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c3a2a700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd3bc0b22d0 0x7fd3bc0cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c3a2a700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd3bc0b26a0 0x7fd3bc0cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c3a2a700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3bc0cb5b0 0x7fd3bc15cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c3a2a700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3bc15b870 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c3a2a700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3bc15a990 con 0x7fd3bc0b26a0 2024-08-17T02:26:21.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c3a2a700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc15ac60 con 0x7fd3bc0cb5b0 2024-08-17T02:26:21.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c17c6700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd3bc0b22d0 0x7fd3bc0cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c17c6700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd3bc0b22d0 0x7fd3bc0cd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43664/0 (socket says 172.21.15.102:43664) 2024-08-17T02:26:21.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c17c6700 1 -- 172.21.15.102:0/675364403 learned_addr learned my addr 172.21.15.102:0/675364403 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:21.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c0fc5700 1 --2- 172.21.15.102:0/675364403 >> v2:172.21.15.121:3300/0 conn(0x7fd3bc0b26a0 0x7fd3bc0cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c1fc7700 1 --2- 172.21.15.102:0/675364403 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3bc0cb5b0 0x7fd3bc15cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c17c6700 1 -- 172.21.15.102:0/675364403 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3bc0cb5b0 msgr2=0x7fd3bc15cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:21.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c17c6700 1 --2- 172.21.15.102:0/675364403 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3bc0cb5b0 0x7fd3bc15cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c17c6700 1 -- 172.21.15.102:0/675364403 >> v2:172.21.15.121:3300/0 conn(0x7fd3bc0b26a0 msgr2=0x7fd3bc0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:21.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c17c6700 1 --2- 172.21.15.102:0/675364403 >> v2:172.21.15.121:3300/0 conn(0x7fd3bc0b26a0 0x7fd3bc0cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c17c6700 1 -- 172.21.15.102:0/675364403 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc15af40 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c0fc5700 1 --2- 172.21.15.102:0/675364403 >> v2:172.21.15.121:3300/0 conn(0x7fd3bc0b26a0 0x7fd3bc0cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:21.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c17c6700 1 --2- 172.21.15.102:0/675364403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3bc0b22d0 0x7fd3bc0cd4d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0ca860 tx=0x7fd3b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545a793bae31dad2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3b3fff700 1 -- 172.21.15.102:0/675364403 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b800b860 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3b3fff700 1 -- 172.21.15.102:0/675364403 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b800b9c0 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3b3fff700 1 -- 172.21.15.102:0/675364403 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b800bd60 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c3a2a700 1 -- 172.21.15.102:0/675364403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3bc0b22d0 msgr2=0x7fd3bc0cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c3a2a700 1 --2- 172.21.15.102:0/675364403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3bc0b22d0 0x7fd3bc0cd4d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0ca860 tx=0x7fd3b8009250 comp rx=0 tx=0).stop 2024-08-17T02:26:21.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c3a2a700 1 -- 172.21.15.102:0/675364403 shutdown_connections 2024-08-17T02:26:21.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c3a2a700 1 --2- 172.21.15.102:0/675364403 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3bc0cb5b0 0x7fd3bc15cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c3a2a700 1 --2- 172.21.15.102:0/675364403 >> v2:172.21.15.121:3300/0 conn(0x7fd3bc0b26a0 0x7fd3bc0cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c3a2a700 1 --2- 172.21.15.102:0/675364403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3bc0b22d0 0x7fd3bc0cd4d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c3a2a700 1 -- 172.21.15.102:0/675364403 >> 172.21.15.102:0/675364403 conn(0x7fd3bc06a4a0 msgr2=0x7fd3bc066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.357+0000 7fd3c3a2a700 1 -- 172.21.15.102:0/675364403 shutdown_connections 2024-08-17T02:26:21.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.361+0000 7fd3c3a2a700 1 -- 172.21.15.102:0/675364403 wait complete. 2024-08-17T02:26:21.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.361+0000 7fd3c3a2a700 1 Processor -- start 2024-08-17T02:26:21.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.361+0000 7fd3c3a2a700 1 -- start start 2024-08-17T02:26:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.361+0000 7fd3c3a2a700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3bc0b22d0 0x7fd3bc0b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.361+0000 7fd3c3a2a700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3bc0b26a0 0x7fd3bc147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.361+0000 7fd3c3a2a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3bc0cb5b0 0x7fd3bc0c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.361+0000 7fd3c3a2a700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0b5e90 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.361+0000 7fd3c3a2a700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0b5280 con 0x7fd3bc0cb5b0 2024-08-17T02:26:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.361+0000 7fd3c3a2a700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0b5560 con 0x7fd3bc0b26a0 2024-08-17T02:26:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3c17c6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3bc0b22d0 0x7fd3bc0b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3c17c6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3bc0b22d0 0x7fd3bc0b4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43672/0 (socket says 172.21.15.102:43672) 2024-08-17T02:26:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3c17c6700 1 -- 172.21.15.102:0/1657466636 learned_addr learned my addr 172.21.15.102:0/1657466636 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3c1fc7700 1 --2- 172.21.15.102:0/1657466636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3bc0cb5b0 0x7fd3bc0c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3c0fc5700 1 --2- 172.21.15.102:0/1657466636 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3bc0b26a0 0x7fd3bc147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3c17c6700 1 -- 172.21.15.102:0/1657466636 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3bc0b26a0 msgr2=0x7fd3bc147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3c17c6700 1 --2- 172.21.15.102:0/1657466636 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3bc0b26a0 0x7fd3bc147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3c17c6700 1 -- 172.21.15.102:0/1657466636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3bc0cb5b0 msgr2=0x7fd3bc0c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3c17c6700 1 --2- 172.21.15.102:0/1657466636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3bc0cb5b0 0x7fd3bc0c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3c17c6700 1 -- 172.21.15.102:0/1657466636 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b80094f0 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3c1fc7700 1 --2- 172.21.15.102:0/1657466636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3bc0cb5b0 0x7fd3bc0c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3c17c6700 1 --2- 172.21.15.102:0/1657466636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3bc0b22d0 0x7fd3bc0b4c30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8009290 tx=0x7fd3b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3b17fa700 1 -- 172.21.15.102:0/1657466636 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b801a450 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3b17fa700 1 -- 172.21.15.102:0/1657466636 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b801a5b0 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3c3a2a700 1 -- 172.21.15.102:0/1657466636 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3bc0b5840 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3b17fa700 1 -- 172.21.15.102:0/1657466636 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b801a970 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3c3a2a700 1 -- 172.21.15.102:0/1657466636 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3bc153630 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.365+0000 7fd3c3a2a700 1 -- 172.21.15.102:0/1657466636 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3bc0645c0 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.369+0000 7fd3b17fa700 1 -- 172.21.15.102:0/1657466636 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd3b801ad20 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.369+0000 7fd3b17fa700 1 --2- 172.21.15.102:0/1657466636 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd3a0060890 0x7fd3a0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.369+0000 7fd3c0fc5700 1 --2- 172.21.15.102:0/1657466636 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd3a0060890 0x7fd3a0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.369+0000 7fd3b17fa700 1 -- 172.21.15.102:0/1657466636 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3b807e250 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.369+0000 7fd3c0fc5700 1 --2- 172.21.15.102:0/1657466636 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd3a0060890 0x7fd3a0062d40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac006f00 tx=0x7fd3ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.377+0000 7fd3b17fa700 1 -- 172.21.15.102:0/1657466636 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd3b804e6a0 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.537+0000 7fd3c3a2a700 1 -- 172.21.15.102:0/1657466636 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3bc0ce080 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.541+0000 7fd3b17fa700 1 -- 172.21.15.102:0/1657466636 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3b8051cc0 con 0x7fd3bc0b22d0 2024-08-17T02:26:21.542 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-08-17T02:26:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.541+0000 7fd3c3a2a700 1 -- 172.21.15.102:0/1657466636 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd3a0060890 msgr2=0x7fd3a0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.541+0000 7fd3c3a2a700 1 --2- 172.21.15.102:0/1657466636 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd3a0060890 0x7fd3a0062d40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac006f00 tx=0x7fd3ac008040 comp rx=0 tx=0).stop 2024-08-17T02:26:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.541+0000 7fd3c3a2a700 1 -- 172.21.15.102:0/1657466636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3bc0b22d0 msgr2=0x7fd3bc0b4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.541+0000 7fd3c3a2a700 1 --2- 172.21.15.102:0/1657466636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3bc0b22d0 0x7fd3bc0b4c30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8009290 tx=0x7fd3b8017000 comp rx=0 tx=0).stop 2024-08-17T02:26:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.541+0000 7fd3c3a2a700 1 -- 172.21.15.102:0/1657466636 shutdown_connections 2024-08-17T02:26:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.541+0000 7fd3c3a2a700 1 --2- 172.21.15.102:0/1657466636 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd3a0060890 0x7fd3a0062d40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.541+0000 7fd3c3a2a700 1 --2- 172.21.15.102:0/1657466636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3bc0cb5b0 0x7fd3bc0c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.541+0000 7fd3c3a2a700 1 --2- 172.21.15.102:0/1657466636 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3bc0b26a0 0x7fd3bc147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.541+0000 7fd3c3a2a700 1 --2- 172.21.15.102:0/1657466636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3bc0b22d0 0x7fd3bc0b4c30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.541+0000 7fd3c3a2a700 1 -- 172.21.15.102:0/1657466636 >> 172.21.15.102:0/1657466636 conn(0x7fd3bc06a4a0 msgr2=0x7fd3bc0b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.541+0000 7fd3c3a2a700 1 -- 172.21.15.102:0/1657466636 shutdown_connections 2024-08-17T02:26:21.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.541+0000 7fd3c3a2a700 1 -- 172.21.15.102:0/1657466636 wait complete. 2024-08-17T02:26:21.556 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:21.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3eb77700 1 Processor -- start 2024-08-17T02:26:21.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3eb77700 1 -- start start 2024-08-17T02:26:21.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3eb77700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe38067510 0x7fbe380ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3eb77700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe380ce210 con 0x7fbe381590b0 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3eb77700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe380cb440 con 0x7fbe38159480 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3eb77700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380cba00 con 0x7fbe38067510 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3db75700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fbe381590b0 0x7fbe38066e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60028/0 (socket says 172.21.15.102:60028) 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3db75700 1 -- 172.21.15.102:0/3875180164 learned_addr learned my addr 172.21.15.102:0/3875180164 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3d374700 1 --2- 172.21.15.102:0/3875180164 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe38067510 0x7fbe380ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 -- 172.21.15.102:0/3875180164 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303501299 0 0) 0x7fbe380ce210 con 0x7fbe381590b0 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 -- 172.21.15.102:0/3875180164 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe24003570 con 0x7fbe381590b0 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 -- 172.21.15.102:0/3875180164 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183927407 0 0) 0x7fbe380cb440 con 0x7fbe38159480 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 -- 172.21.15.102:0/3875180164 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe380ce210 con 0x7fbe38159480 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 -- 172.21.15.102:0/3875180164 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 121846774 0 0) 0x7fbe24003570 con 0x7fbe381590b0 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 -- 172.21.15.102:0/3875180164 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe38067510 msgr2=0x7fbe380ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 --2- 172.21.15.102:0/3875180164 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe38067510 0x7fbe380ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 -- 172.21.15.102:0/3875180164 >> v1:172.21.15.121:6789/0 conn(0x7fbe38159480 legacy=0x7fbe380cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 -- 172.21.15.102:0/3875180164 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe380cb720 con 0x7fbe381590b0 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 -- 172.21.15.102:0/3875180164 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7fbe34001470 con 0x7fbe381590b0 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 -- 172.21.15.102:0/3875180164 >> v1:172.21.15.102:6789/0 conn(0x7fbe381590b0 legacy=0x7fbe38066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 --2- 172.21.15.102:0/3875180164 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe38067510 0x7fbe24003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 --2- 172.21.15.102:0/3875180164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe240041d0 0x7fbe24004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 --2- 172.21.15.102:0/3875180164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe24004d50 0x7fbe240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 -- 172.21.15.102:0/3875180164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2400bbf0 con 0x7fbe24004d50 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 -- 172.21.15.102:0/3875180164 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2400bd30 con 0x7fbe240041d0 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3cb73700 1 -- 172.21.15.102:0/3875180164 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2400bef0 con 0x7fbe38067510 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3e376700 1 --2- 172.21.15.102:0/3875180164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe24004d50 0x7fbe240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3db75700 1 --2- 172.21.15.102:0/3875180164 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe38067510 0x7fbe24003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.669+0000 7fbe3d374700 1 --2- 172.21.15.102:0/3875180164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe240041d0 0x7fbe24004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3db75700 1 -- 172.21.15.102:0/3875180164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe240041d0 msgr2=0x7fbe24004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3db75700 1 --2- 172.21.15.102:0/3875180164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe240041d0 0x7fbe24004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3db75700 1 -- 172.21.15.102:0/3875180164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe24004d50 msgr2=0x7fbe240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3db75700 1 --2- 172.21.15.102:0/3875180164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe24004d50 0x7fbe240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3db75700 1 -- 172.21.15.102:0/3875180164 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe24003570 con 0x7fbe38067510 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3e376700 1 --2- 172.21.15.102:0/3875180164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe24004d50 0x7fbe240051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3d374700 1 --2- 172.21.15.102:0/3875180164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe240041d0 0x7fbe24004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3db75700 1 --2- 172.21.15.102:0/3875180164 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe38067510 0x7fbe24003c20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400c210 tx=0x7fbe34001d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9fbf84432e7b7b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3cb73700 1 -- 172.21.15.102:0/3875180164 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3400cc10 con 0x7fbe38067510 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3cb73700 1 -- 172.21.15.102:0/3875180164 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3400cd70 con 0x7fbe38067510 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3cb73700 1 -- 172.21.15.102:0/3875180164 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34005b70 con 0x7fbe38067510 2024-08-17T02:26:21.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3eb77700 1 -- 172.21.15.102:0/3875180164 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe38067510 msgr2=0x7fbe24003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3eb77700 1 --2- 172.21.15.102:0/3875180164 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe38067510 0x7fbe24003c20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400c210 tx=0x7fbe34001d20 comp rx=0 tx=0).stop 2024-08-17T02:26:21.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3e376700 1 -- 172.21.15.102:0/3875180164 reap_dead start 2024-08-17T02:26:21.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3eb77700 1 -- 172.21.15.102:0/3875180164 shutdown_connections 2024-08-17T02:26:21.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3eb77700 1 -- 172.21.15.102:0/3875180164 >> 172.21.15.102:0/3875180164 conn(0x7fbe380d0b90 msgr2=0x7fbe380ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3eb77700 1 -- 172.21.15.102:0/3875180164 shutdown_connections 2024-08-17T02:26:21.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3eb77700 1 -- 172.21.15.102:0/3875180164 wait complete. 2024-08-17T02:26:21.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3eb77700 1 Processor -- start 2024-08-17T02:26:21.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.673+0000 7fbe3eb77700 1 -- start start 2024-08-17T02:26:21.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3eb77700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe38067510 0x7fbe3806d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3eb77700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe3806adf0 0x7fbe38146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3eb77700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe380b0590 0x7fbe380b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3eb77700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe381475b0 con 0x7fbe3806adf0 2024-08-17T02:26:21.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3eb77700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380b0f40 con 0x7fbe38067510 2024-08-17T02:26:21.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3eb77700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3806ea50 con 0x7fbe380b0590 2024-08-17T02:26:21.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3d374700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe3806adf0 0x7fbe38146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3d374700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe3806adf0 0x7fbe38146a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43420/0 (socket says 172.21.15.102:43420) 2024-08-17T02:26:21.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3d374700 1 -- 172.21.15.102:0/2397033564 learned_addr learned my addr 172.21.15.102:0/2397033564 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:21.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3db75700 1 --2- 172.21.15.102:0/2397033564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe38067510 0x7fbe3806d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3e376700 1 --2- 172.21.15.102:0/2397033564 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe380b0590 0x7fbe380b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3d374700 1 -- 172.21.15.102:0/2397033564 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe380b0590 msgr2=0x7fbe380b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3d374700 1 --2- 172.21.15.102:0/2397033564 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe380b0590 0x7fbe380b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3d374700 1 -- 172.21.15.102:0/2397033564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe38067510 msgr2=0x7fbe3806d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3d374700 1 --2- 172.21.15.102:0/2397033564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe38067510 0x7fbe3806d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3d374700 1 -- 172.21.15.102:0/2397033564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3806ded0 con 0x7fbe3806adf0 2024-08-17T02:26:21.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3db75700 1 --2- 172.21.15.102:0/2397033564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe38067510 0x7fbe3806d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:21.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3d374700 1 --2- 172.21.15.102:0/2397033564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe3806adf0 0x7fbe38146a30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c011d30 tx=0x7fbe2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe29ffb700 1 -- 172.21.15.102:0/2397033564 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c00fcd0 con 0x7fbe3806adf0 2024-08-17T02:26:21.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe29ffb700 1 -- 172.21.15.102:0/2397033564 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2c00fe30 con 0x7fbe3806adf0 2024-08-17T02:26:21.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3eb77700 1 -- 172.21.15.102:0/2397033564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3806e1b0 con 0x7fbe3806adf0 2024-08-17T02:26:21.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe29ffb700 1 -- 172.21.15.102:0/2397033564 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c01d6b0 con 0x7fbe3806adf0 2024-08-17T02:26:21.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.677+0000 7fbe3eb77700 1 -- 172.21.15.102:0/2397033564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3806e770 con 0x7fbe3806adf0 2024-08-17T02:26:21.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.681+0000 7fbe29ffb700 1 -- 172.21.15.102:0/2397033564 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbe2c01daa0 con 0x7fbe3806adf0 2024-08-17T02:26:21.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.681+0000 7fbe3eb77700 1 -- 172.21.15.102:0/2397033564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe38064330 con 0x7fbe3806adf0 2024-08-17T02:26:21.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.681+0000 7fbe29ffb700 1 --2- 172.21.15.102:0/2397033564 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbe1c060860 0x7fbe1c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.681+0000 7fbe29ffb700 1 -- 172.21.15.102:0/2397033564 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe2c018070 con 0x7fbe3806adf0 2024-08-17T02:26:21.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.681+0000 7fbe3db75700 1 --2- 172.21.15.102:0/2397033564 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbe1c060860 0x7fbe1c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.681+0000 7fbe3db75700 1 --2- 172.21.15.102:0/2397033564 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbe1c060860 0x7fbe1c062d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbe34007ec0 tx=0x7fbe34015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.689+0000 7fbe29ffb700 1 -- 172.21.15.102:0/2397033564 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbe2c04e170 con 0x7fbe3806adf0 2024-08-17T02:26:21.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.853+0000 7fbe3eb77700 1 -- 172.21.15.102:0/2397033564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe38070cf0 con 0x7fbe3806adf0 2024-08-17T02:26:21.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.853+0000 7fbe29ffb700 1 -- 172.21.15.102:0/2397033564 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbe2c051790 con 0x7fbe3806adf0 2024-08-17T02:26:21.856 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-08-17T02:26:21.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.857+0000 7fbe3eb77700 1 -- 172.21.15.102:0/2397033564 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbe1c060860 msgr2=0x7fbe1c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.857+0000 7fbe3eb77700 1 --2- 172.21.15.102:0/2397033564 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbe1c060860 0x7fbe1c062d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbe34007ec0 tx=0x7fbe34015000 comp rx=0 tx=0).stop 2024-08-17T02:26:21.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.857+0000 7fbe3eb77700 1 -- 172.21.15.102:0/2397033564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe3806adf0 msgr2=0x7fbe38146a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.857+0000 7fbe3eb77700 1 --2- 172.21.15.102:0/2397033564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe3806adf0 0x7fbe38146a30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c011d30 tx=0x7fbe2c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.857+0000 7fbe3eb77700 1 -- 172.21.15.102:0/2397033564 shutdown_connections 2024-08-17T02:26:21.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.857+0000 7fbe3eb77700 1 --2- 172.21.15.102:0/2397033564 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbe1c060860 0x7fbe1c062d10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.857+0000 7fbe3eb77700 1 --2- 172.21.15.102:0/2397033564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe3806adf0 0x7fbe38146a30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.857+0000 7fbe3eb77700 1 --2- 172.21.15.102:0/2397033564 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe380b0590 0x7fbe380b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.857+0000 7fbe3eb77700 1 --2- 172.21.15.102:0/2397033564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe38067510 0x7fbe3806d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.857+0000 7fbe3eb77700 1 -- 172.21.15.102:0/2397033564 >> 172.21.15.102:0/2397033564 conn(0x7fbe380d0b90 msgr2=0x7fbe38155fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.857+0000 7fbe3eb77700 1 -- 172.21.15.102:0/2397033564 shutdown_connections 2024-08-17T02:26:21.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.857+0000 7fbe3eb77700 1 -- 172.21.15.102:0/2397033564 wait complete. 2024-08-17T02:26:21.869 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:21.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.977+0000 7f6af7fff700 1 Processor -- start 2024-08-17T02:26:21.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.977+0000 7f6af7fff700 1 -- start start 2024-08-17T02:26:21.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.977+0000 7f6af7fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af806ead0 0x7f6af806eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.977+0000 7f6af7fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6af80b1830 0x7f6af8155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.977+0000 7f6af7fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6af8152bd0 0x7f6af8153010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.977+0000 7f6af7fff700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af80b1c80 con 0x7f6af80b1830 2024-08-17T02:26:21.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.977+0000 7f6af7fff700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af80ace30 con 0x7f6af8152bd0 2024-08-17T02:26:21.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.977+0000 7f6af7fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af80ae6b0 con 0x7f6af806ead0 2024-08-17T02:26:21.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af67fc700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6af80b1830 0x7f6af8155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af77fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6af8152bd0 0x7f6af8153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af6ffd700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af806ead0 0x7f6af806eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af67fc700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6af80b1830 0x7f6af8155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43428/0 (socket says 172.21.15.102:43428) 2024-08-17T02:26:21.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af67fc700 1 -- 172.21.15.102:0/893759409 learned_addr learned my addr 172.21.15.102:0/893759409 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:21.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af77fe700 1 -- 172.21.15.102:0/893759409 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af806ead0 msgr2=0x7f6af806eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:21.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af77fe700 1 --2- 172.21.15.102:0/893759409 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af806ead0 0x7f6af806eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af77fe700 1 -- 172.21.15.102:0/893759409 >> v2:172.21.15.102:3300/0 conn(0x7f6af80b1830 msgr2=0x7f6af8155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:21.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af77fe700 1 --2- 172.21.15.102:0/893759409 >> v2:172.21.15.102:3300/0 conn(0x7f6af80b1830 0x7f6af8155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af77fe700 1 -- 172.21.15.102:0/893759409 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af8156dd0 con 0x7f6af8152bd0 2024-08-17T02:26:21.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af77fe700 1 --2- 172.21.15.102:0/893759409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6af8152bd0 0x7f6af8153010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6af806b3d0 tx=0x7f6af0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3669b3d45194740a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af5ffb700 1 -- 172.21.15.102:0/893759409 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af000e070 con 0x7f6af8152bd0 2024-08-17T02:26:21.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af5ffb700 1 -- 172.21.15.102:0/893759409 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af000ba70 con 0x7f6af8152bd0 2024-08-17T02:26:21.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af5ffb700 1 -- 172.21.15.102:0/893759409 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af000be30 con 0x7f6af8152bd0 2024-08-17T02:26:21.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af7fff700 1 -- 172.21.15.102:0/893759409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6af8152bd0 msgr2=0x7f6af8153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af7fff700 1 --2- 172.21.15.102:0/893759409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6af8152bd0 0x7f6af8153010 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6af806b3d0 tx=0x7f6af0009780 comp rx=0 tx=0).stop 2024-08-17T02:26:21.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af7fff700 1 -- 172.21.15.102:0/893759409 shutdown_connections 2024-08-17T02:26:21.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af7fff700 1 --2- 172.21.15.102:0/893759409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6af8152bd0 0x7f6af8153010 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af7fff700 1 --2- 172.21.15.102:0/893759409 >> v2:172.21.15.102:3300/0 conn(0x7f6af80b1830 0x7f6af8155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af7fff700 1 --2- 172.21.15.102:0/893759409 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af806ead0 0x7f6af806eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af7fff700 1 -- 172.21.15.102:0/893759409 >> 172.21.15.102:0/893759409 conn(0x7f6af80678a0 msgr2=0x7f6af8067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af7fff700 1 -- 172.21.15.102:0/893759409 shutdown_connections 2024-08-17T02:26:21.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af7fff700 1 -- 172.21.15.102:0/893759409 wait complete. 2024-08-17T02:26:21.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af7fff700 1 Processor -- start 2024-08-17T02:26:21.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.981+0000 7f6af7fff700 1 -- start start 2024-08-17T02:26:21.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af7fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af806ead0 0x7f6af8145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af7fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6af80b1830 0x7f6af8169630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af7fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6af8152bd0 0x7f6af8149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af7fff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af81476c0 con 0x7f6af8152bd0 2024-08-17T02:26:21.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af7fff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af8146ab0 con 0x7f6af80b1830 2024-08-17T02:26:21.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af7fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af8146d90 con 0x7f6af806ead0 2024-08-17T02:26:21.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af77fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6af8152bd0 0x7f6af8149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af77fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6af8152bd0 0x7f6af8149160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43430/0 (socket says 172.21.15.102:43430) 2024-08-17T02:26:21.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af6ffd700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af806ead0 0x7f6af8145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af77fe700 1 -- 172.21.15.102:0/1387777511 learned_addr learned my addr 172.21.15.102:0/1387777511 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:21.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af67fc700 1 --2- 172.21.15.102:0/1387777511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6af80b1830 0x7f6af8169630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af77fe700 1 -- 172.21.15.102:0/1387777511 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af806ead0 msgr2=0x7f6af8145990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af77fe700 1 --2- 172.21.15.102:0/1387777511 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af806ead0 0x7f6af8145990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af77fe700 1 -- 172.21.15.102:0/1387777511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6af80b1830 msgr2=0x7f6af8169630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af77fe700 1 --2- 172.21.15.102:0/1387777511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6af80b1830 0x7f6af8169630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af77fe700 1 -- 172.21.15.102:0/1387777511 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af0009a20 con 0x7f6af8152bd0 2024-08-17T02:26:21.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af77fe700 1 --2- 172.21.15.102:0/1387777511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6af8152bd0 0x7f6af8149160 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6af000b610 tx=0x7f6af0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6aeeffd700 1 -- 172.21.15.102:0/1387777511 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0012db0 con 0x7f6af8152bd0 2024-08-17T02:26:21.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6aeeffd700 1 -- 172.21.15.102:0/1387777511 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af0027470 con 0x7f6af8152bd0 2024-08-17T02:26:21.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af7fff700 1 -- 172.21.15.102:0/1387777511 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af8147070 con 0x7f6af8152bd0 2024-08-17T02:26:21.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6aeeffd700 1 -- 172.21.15.102:0/1387777511 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0027830 con 0x7f6af8152bd0 2024-08-17T02:26:21.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af7fff700 1 -- 172.21.15.102:0/1387777511 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af8145ed0 con 0x7f6af8152bd0 2024-08-17T02:26:21.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.985+0000 7f6af7fff700 1 -- 172.21.15.102:0/1387777511 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af8147830 con 0x7f6af8152bd0 2024-08-17T02:26:21.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.989+0000 7f6aeeffd700 1 -- 172.21.15.102:0/1387777511 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6af0024070 con 0x7f6af8152bd0 2024-08-17T02:26:21.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.989+0000 7f6aeeffd700 1 --2- 172.21.15.102:0/1387777511 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6ad8060860 0x7f6ad8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.989+0000 7f6aeeffd700 1 -- 172.21.15.102:0/1387777511 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6af007f200 con 0x7f6af8152bd0 2024-08-17T02:26:21.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.989+0000 7f6af6ffd700 1 --2- 172.21.15.102:0/1387777511 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6ad8060860 0x7f6ad8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.989+0000 7f6af6ffd700 1 --2- 172.21.15.102:0/1387777511 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6ad8060860 0x7f6ad8062d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8009d10 tx=0x7f6ae80091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:21.993+0000 7f6aeeffd700 1 -- 172.21.15.102:0/1387777511 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6af004f5b0 con 0x7f6af8152bd0 2024-08-17T02:26:22.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.157+0000 7f6af7fff700 1 -- 172.21.15.102:0/1387777511 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6af8064330 con 0x7f6af8152bd0 2024-08-17T02:26:22.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.157+0000 7f6aeeffd700 1 -- 172.21.15.102:0/1387777511 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6af0052bd0 con 0x7f6af8152bd0 2024-08-17T02:26:22.159 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-08-17T02:26:22.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.157+0000 7f6af7fff700 1 -- 172.21.15.102:0/1387777511 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6ad8060860 msgr2=0x7f6ad8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.157+0000 7f6af7fff700 1 --2- 172.21.15.102:0/1387777511 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6ad8060860 0x7f6ad8062d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8009d10 tx=0x7f6ae80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.157+0000 7f6af7fff700 1 -- 172.21.15.102:0/1387777511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6af8152bd0 msgr2=0x7f6af8149160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.157+0000 7f6af7fff700 1 --2- 172.21.15.102:0/1387777511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6af8152bd0 0x7f6af8149160 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6af000b610 tx=0x7f6af0019000 comp rx=0 tx=0).stop 2024-08-17T02:26:22.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.161+0000 7f6af7fff700 1 -- 172.21.15.102:0/1387777511 shutdown_connections 2024-08-17T02:26:22.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.161+0000 7f6af7fff700 1 --2- 172.21.15.102:0/1387777511 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6ad8060860 0x7f6ad8062d10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.161+0000 7f6af7fff700 1 --2- 172.21.15.102:0/1387777511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6af8152bd0 0x7f6af8149160 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.161+0000 7f6af7fff700 1 --2- 172.21.15.102:0/1387777511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6af80b1830 0x7f6af8169630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.161+0000 7f6af7fff700 1 --2- 172.21.15.102:0/1387777511 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6af806ead0 0x7f6af8145990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.161+0000 7f6af7fff700 1 -- 172.21.15.102:0/1387777511 >> 172.21.15.102:0/1387777511 conn(0x7f6af80678a0 msgr2=0x7f6af8151f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:22.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.161+0000 7f6af7fff700 1 -- 172.21.15.102:0/1387777511 shutdown_connections 2024-08-17T02:26:22.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.161+0000 7f6af7fff700 1 -- 172.21.15.102:0/1387777511 wait complete. 2024-08-17T02:26:22.174 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:22.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd632ce700 1 Processor -- start 2024-08-17T02:26:22.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd632ce700 1 -- start start 2024-08-17T02:26:22.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd632ce700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd5c0af030 0x7efd5c0a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd632ce700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5c0b0270 con 0x7efd5c15d540 2024-08-17T02:26:22.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd632ce700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5c0af660 con 0x7efd5c0a9260 2024-08-17T02:26:22.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd632ce700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c0af480 con 0x7efd5c0af030 2024-08-17T02:26:22.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd6106a700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7efd5c15d540 0x7efd5c06e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60030/0 (socket says 172.21.15.102:60030) 2024-08-17T02:26:22.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd6106a700 1 -- 172.21.15.102:0/1453454446 learned_addr learned my addr 172.21.15.102:0/1453454446 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:22.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd60869700 1 --2- 172.21.15.102:0/1453454446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd5c0af030 0x7efd5c0a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 -- 172.21.15.102:0/1453454446 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653792425 0 0) 0x7efd5c0b0270 con 0x7efd5c15d540 2024-08-17T02:26:22.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 -- 172.21.15.102:0/1453454446 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd48003570 con 0x7efd5c15d540 2024-08-17T02:26:22.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 -- 172.21.15.102:0/1453454446 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1724601544 0 0) 0x7efd48003570 con 0x7efd5c15d540 2024-08-17T02:26:22.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 -- 172.21.15.102:0/1453454446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd5c0af030 msgr2=0x7efd5c0a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:22.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 --2- 172.21.15.102:0/1453454446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd5c0af030 0x7efd5c0a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 -- 172.21.15.102:0/1453454446 >> v1:172.21.15.121:6789/0 conn(0x7efd5c0a9260 legacy=0x7efd5c0b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 -- 172.21.15.102:0/1453454446 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c0af940 con 0x7efd5c15d540 2024-08-17T02:26:22.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 -- 172.21.15.102:0/1453454446 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7efd4c001470 con 0x7efd5c15d540 2024-08-17T02:26:22.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 -- 172.21.15.102:0/1453454446 >> v1:172.21.15.102:6789/0 conn(0x7efd5c15d540 legacy=0x7efd5c06e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 --2- 172.21.15.102:0/1453454446 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd48003a90 0x7efd48003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 --2- 172.21.15.102:0/1453454446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd5c0af030 0x7efd48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 --2- 172.21.15.102:0/1453454446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd48004da0 0x7efd480051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 -- 172.21.15.102:0/1453454446 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c0af480 con 0x7efd48004da0 2024-08-17T02:26:22.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 -- 172.21.15.102:0/1453454446 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4800bc20 con 0x7efd48003a90 2024-08-17T02:26:22.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 -- 172.21.15.102:0/1453454446 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4800bde0 con 0x7efd5c0af030 2024-08-17T02:26:22.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd60869700 1 --2- 172.21.15.102:0/1453454446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd5c0af030 0x7efd48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd6106a700 1 --2- 172.21.15.102:0/1453454446 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd48003a90 0x7efd48003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd6186b700 1 --2- 172.21.15.102:0/1453454446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd48004da0 0x7efd480051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd6186b700 1 -- 172.21.15.102:0/1453454446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd5c0af030 msgr2=0x7efd48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:22.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd6186b700 1 --2- 172.21.15.102:0/1453454446 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd5c0af030 0x7efd48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd6186b700 1 -- 172.21.15.102:0/1453454446 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd48003a90 msgr2=0x7efd48003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:22.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd6186b700 1 --2- 172.21.15.102:0/1453454446 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd48003a90 0x7efd48003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd6186b700 1 -- 172.21.15.102:0/1453454446 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd48003570 con 0x7efd48004da0 2024-08-17T02:26:22.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd6186b700 1 --2- 172.21.15.102:0/1453454446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd48004da0 0x7efd480051f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efd54001880 tx=0x7efd54007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbc1a3ccfcd8e3b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 -- 172.21.15.102:0/1453454446 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54012420 con 0x7efd48004da0 2024-08-17T02:26:22.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 -- 172.21.15.102:0/1453454446 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd54012580 con 0x7efd48004da0 2024-08-17T02:26:22.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd53fff700 1 -- 172.21.15.102:0/1453454446 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54012920 con 0x7efd48004da0 2024-08-17T02:26:22.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd632ce700 1 -- 172.21.15.102:0/1453454446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd48004da0 msgr2=0x7efd480051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd632ce700 1 --2- 172.21.15.102:0/1453454446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd48004da0 0x7efd480051f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efd54001880 tx=0x7efd54007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:22.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd6186b700 1 -- 172.21.15.102:0/1453454446 reap_dead start 2024-08-17T02:26:22.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd632ce700 1 -- 172.21.15.102:0/1453454446 shutdown_connections 2024-08-17T02:26:22.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.281+0000 7efd632ce700 1 -- 172.21.15.102:0/1453454446 >> 172.21.15.102:0/1453454446 conn(0x7efd5c066e00 msgr2=0x7efd5c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:22.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.285+0000 7efd632ce700 1 -- 172.21.15.102:0/1453454446 shutdown_connections 2024-08-17T02:26:22.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.285+0000 7efd632ce700 1 -- 172.21.15.102:0/1453454446 wait complete. 2024-08-17T02:26:22.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.285+0000 7efd632ce700 1 Processor -- start 2024-08-17T02:26:22.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.285+0000 7efd632ce700 1 -- start start 2024-08-17T02:26:22.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd632ce700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd48004da0 0x7efd5c160160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd632ce700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c0ca060 0x7efd5c1715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd632ce700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd5c171b30 0x7efd5c156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd632ce700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c097670 con 0x7efd5c171b30 2024-08-17T02:26:22.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd632ce700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c15de20 con 0x7efd5c0ca060 2024-08-17T02:26:22.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd632ce700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c1606a0 con 0x7efd48004da0 2024-08-17T02:26:22.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd6186b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd5c171b30 0x7efd5c156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd6186b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd5c171b30 0x7efd5c156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43442/0 (socket says 172.21.15.102:43442) 2024-08-17T02:26:22.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd6186b700 1 -- 172.21.15.102:0/3027050662 learned_addr learned my addr 172.21.15.102:0/3027050662 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:22.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd6106a700 1 --2- 172.21.15.102:0/3027050662 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd48004da0 0x7efd5c160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd60869700 1 --2- 172.21.15.102:0/3027050662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c0ca060 0x7efd5c1715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd6186b700 1 -- 172.21.15.102:0/3027050662 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd48004da0 msgr2=0x7efd5c160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd6186b700 1 --2- 172.21.15.102:0/3027050662 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd48004da0 0x7efd5c160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd6186b700 1 -- 172.21.15.102:0/3027050662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c0ca060 msgr2=0x7efd5c1715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd6186b700 1 --2- 172.21.15.102:0/3027050662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c0ca060 0x7efd5c1715f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd6186b700 1 -- 172.21.15.102:0/3027050662 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c0ca620 con 0x7efd5c171b30 2024-08-17T02:26:22.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd60869700 1 --2- 172.21.15.102:0/3027050662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c0ca060 0x7efd5c1715f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:22.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd6186b700 1 --2- 172.21.15.102:0/3027050662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd5c171b30 0x7efd5c156e60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efd4800bbf0 tx=0x7efd54015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd517fa700 1 -- 172.21.15.102:0/3027050662 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54001200 con 0x7efd5c171b30 2024-08-17T02:26:22.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd517fa700 1 -- 172.21.15.102:0/3027050662 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd540126f0 con 0x7efd5c171b30 2024-08-17T02:26:22.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd517fa700 1 -- 172.21.15.102:0/3027050662 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54006820 con 0x7efd5c171b30 2024-08-17T02:26:22.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd632ce700 1 -- 172.21.15.102:0/3027050662 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5c0ca900 con 0x7efd5c171b30 2024-08-17T02:26:22.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd632ce700 1 -- 172.21.15.102:0/3027050662 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5c1573a0 con 0x7efd5c171b30 2024-08-17T02:26:22.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.289+0000 7efd632ce700 1 -- 172.21.15.102:0/3027050662 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5c15d910 con 0x7efd5c171b30 2024-08-17T02:26:22.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.293+0000 7efd517fa700 1 -- 172.21.15.102:0/3027050662 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7efd54019070 con 0x7efd5c171b30 2024-08-17T02:26:22.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.293+0000 7efd517fa700 1 --2- 172.21.15.102:0/3027050662 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7efd40060890 0x7efd40062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.293+0000 7efd517fa700 1 -- 172.21.15.102:0/3027050662 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd5407d1b0 con 0x7efd5c171b30 2024-08-17T02:26:22.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.293+0000 7efd6106a700 1 --2- 172.21.15.102:0/3027050662 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7efd40060890 0x7efd40062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.293+0000 7efd6106a700 1 --2- 172.21.15.102:0/3027050662 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7efd40060890 0x7efd40062d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0015a0 tx=0x7efd4c001e50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.301+0000 7efd517fa700 1 -- 172.21.15.102:0/3027050662 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7efd5c15d910 con 0x7efd5c171b30 2024-08-17T02:26:22.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.465+0000 7efd632ce700 1 -- 172.21.15.102:0/3027050662 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd5c15d910 con 0x7efd5c171b30 2024-08-17T02:26:22.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.469+0000 7efd517fa700 1 -- 172.21.15.102:0/3027050662 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7efd5c15d910 con 0x7efd5c171b30 2024-08-17T02:26:22.471 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:22.472 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:57.002263+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:53.562223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:54.343618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:22.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.469+0000 7efd632ce700 1 -- 172.21.15.102:0/3027050662 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7efd40060890 msgr2=0x7efd40062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.469+0000 7efd632ce700 1 --2- 172.21.15.102:0/3027050662 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7efd40060890 0x7efd40062d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0015a0 tx=0x7efd4c001e50 comp rx=0 tx=0).stop 2024-08-17T02:26:22.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.469+0000 7efd632ce700 1 -- 172.21.15.102:0/3027050662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd5c171b30 msgr2=0x7efd5c156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.469+0000 7efd632ce700 1 --2- 172.21.15.102:0/3027050662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd5c171b30 0x7efd5c156e60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efd4800bbf0 tx=0x7efd54015000 comp rx=0 tx=0).stop 2024-08-17T02:26:22.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.469+0000 7efd632ce700 1 -- 172.21.15.102:0/3027050662 shutdown_connections 2024-08-17T02:26:22.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.469+0000 7efd632ce700 1 --2- 172.21.15.102:0/3027050662 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7efd40060890 0x7efd40062d40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.469+0000 7efd632ce700 1 --2- 172.21.15.102:0/3027050662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd5c171b30 0x7efd5c156e60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.469+0000 7efd632ce700 1 --2- 172.21.15.102:0/3027050662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd5c0ca060 0x7efd5c1715f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.469+0000 7efd632ce700 1 --2- 172.21.15.102:0/3027050662 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd48004da0 0x7efd5c160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.469+0000 7efd632ce700 1 -- 172.21.15.102:0/3027050662 >> 172.21.15.102:0/3027050662 conn(0x7efd5c066e00 msgr2=0x7efd5c160b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:22.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.469+0000 7efd632ce700 1 -- 172.21.15.102:0/3027050662 shutdown_connections 2024-08-17T02:26:22.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.469+0000 7efd632ce700 1 -- 172.21.15.102:0/3027050662 wait complete. 2024-08-17T02:26:22.485 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:49.236728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:53.562223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:54.343618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:22.485 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:22.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa128e6700 1 Processor -- start 2024-08-17T02:26:22.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa128e6700 1 -- start start 2024-08-17T02:26:22.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa128e6700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa0c1596d0 0x7faa0c066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa128e6700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7faa0c15dbc0 0x7faa0c067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa128e6700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0c0cba90 con 0x7faa0c159300 2024-08-17T02:26:22.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa128e6700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0c0b2b60 con 0x7faa0c15dbc0 2024-08-17T02:26:22.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa128e6700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0b2940 con 0x7faa0c1596d0 2024-08-17T02:26:22.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa10e83700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7faa0c15dbc0 0x7faa0c067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa0b7fe700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa0c1596d0 0x7faa0c066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa0bfff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7faa0c159300 0x7faa0c0b2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:36622/0 (socket says 172.21.15.102:36622) 2024-08-17T02:26:22.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa10e83700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7faa0c15dbc0 0x7faa0c067340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:48816/0 (socket says 172.21.15.102:48816) 2024-08-17T02:26:22.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa0bfff700 1 -- 172.21.15.102:0/1178545149 learned_addr learned my addr 172.21.15.102:0/1178545149 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:22.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa10e83700 1 -- 172.21.15.102:0/1178545149 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa0c1596d0 msgr2=0x7faa0c066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:22.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa10e83700 1 --2- 172.21.15.102:0/1178545149 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa0c1596d0 0x7faa0c066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa10e83700 1 -- 172.21.15.102:0/1178545149 >> v1:172.21.15.121:6789/0 conn(0x7faa0c159300 legacy=0x7faa0c0b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa10e83700 1 -- 172.21.15.102:0/1178545149 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c0cb160 con 0x7faa0c15dbc0 2024-08-17T02:26:22.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.593+0000 7faa0b7fe700 1 --2- 172.21.15.102:0/1178545149 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa0c1596d0 0x7faa0c066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:22.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.597+0000 7faa10e83700 1 --2- 172.21.15.102:0/1178545149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa0c15dbc0 0x7faa0c067340 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa04009e60 tx=0x7faa04009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74dd33c4f9708610 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.597+0000 7faa0affd700 1 -- 172.21.15.102:0/1178545149 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0400e070 con 0x7faa0c15dbc0 2024-08-17T02:26:22.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.597+0000 7faa0affd700 1 -- 172.21.15.102:0/1178545149 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0400bb60 con 0x7faa0c15dbc0 2024-08-17T02:26:22.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.597+0000 7faa0affd700 1 -- 172.21.15.102:0/1178545149 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa04012430 con 0x7faa0c15dbc0 2024-08-17T02:26:22.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.597+0000 7faa128e6700 1 -- 172.21.15.102:0/1178545149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa0c15dbc0 msgr2=0x7faa0c067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.597+0000 7faa128e6700 1 --2- 172.21.15.102:0/1178545149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa0c15dbc0 0x7faa0c067340 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa04009e60 tx=0x7faa04009780 comp rx=0 tx=0).stop 2024-08-17T02:26:22.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.597+0000 7faa128e6700 1 -- 172.21.15.102:0/1178545149 shutdown_connections 2024-08-17T02:26:22.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.597+0000 7faa128e6700 1 --2- 172.21.15.102:0/1178545149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa0c15dbc0 0x7faa0c067340 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.597+0000 7faa128e6700 1 --2- 172.21.15.102:0/1178545149 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa0c1596d0 0x7faa0c066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.597+0000 7faa128e6700 1 -- 172.21.15.102:0/1178545149 >> 172.21.15.102:0/1178545149 conn(0x7faa0c0682c0 msgr2=0x7faa0c0686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:22.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.597+0000 7faa128e6700 1 -- 172.21.15.102:0/1178545149 shutdown_connections 2024-08-17T02:26:22.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.597+0000 7faa128e6700 1 -- 172.21.15.102:0/1178545149 wait complete. 2024-08-17T02:26:22.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.597+0000 7faa128e6700 1 Processor -- start 2024-08-17T02:26:22.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.597+0000 7faa128e6700 1 -- start start 2024-08-17T02:26:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa128e6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa0c159300 0x7faa0c155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa128e6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa0c1596d0 0x7faa0c0c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa128e6700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa0c15dbc0 0x7faa0c0c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa128e6700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c156ce0 con 0x7faa0c159300 2024-08-17T02:26:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa128e6700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c169530 con 0x7faa0c1596d0 2024-08-17T02:26:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa128e6700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c1697d0 con 0x7faa0c15dbc0 2024-08-17T02:26:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa0bfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa0c159300 0x7faa0c155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa0bfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa0c159300 0x7faa0c155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43454/0 (socket says 172.21.15.102:43454) 2024-08-17T02:26:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa0bfff700 1 -- 172.21.15.102:0/3576582725 learned_addr learned my addr 172.21.15.102:0/3576582725 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa10e83700 1 --2- 172.21.15.102:0/3576582725 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa0c15dbc0 0x7faa0c0c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa0b7fe700 1 --2- 172.21.15.102:0/3576582725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa0c1596d0 0x7faa0c0c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa0bfff700 1 -- 172.21.15.102:0/3576582725 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa0c15dbc0 msgr2=0x7faa0c0c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa0bfff700 1 --2- 172.21.15.102:0/3576582725 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa0c15dbc0 0x7faa0c0c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa0bfff700 1 -- 172.21.15.102:0/3576582725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa0c1596d0 msgr2=0x7faa0c0c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa0bfff700 1 --2- 172.21.15.102:0/3576582725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa0c1596d0 0x7faa0c0c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa0bfff700 1 -- 172.21.15.102:0/3576582725 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f4009420 con 0x7faa0c159300 2024-08-17T02:26:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa0bfff700 1 --2- 172.21.15.102:0/3576582725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa0c159300 0x7faa0c155fb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00c560 tx=0x7fa9fc001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa03fff700 1 -- 172.21.15.102:0/3576582725 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc005b30 con 0x7faa0c159300 2024-08-17T02:26:22.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa03fff700 1 -- 172.21.15.102:0/3576582725 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc005cb0 con 0x7faa0c159300 2024-08-17T02:26:22.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa128e6700 1 -- 172.21.15.102:0/3576582725 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa04009a20 con 0x7faa0c159300 2024-08-17T02:26:22.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa03fff700 1 -- 172.21.15.102:0/3576582725 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc007320 con 0x7faa0c159300 2024-08-17T02:26:22.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.601+0000 7faa128e6700 1 -- 172.21.15.102:0/3576582725 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0c16a2b0 con 0x7faa0c159300 2024-08-17T02:26:22.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.605+0000 7faa128e6700 1 -- 172.21.15.102:0/3576582725 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0c169bc0 con 0x7faa0c159300 2024-08-17T02:26:22.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.605+0000 7faa03fff700 1 -- 172.21.15.102:0/3576582725 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa9fc007690 con 0x7faa0c159300 2024-08-17T02:26:22.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.605+0000 7faa03fff700 1 --2- 172.21.15.102:0/3576582725 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa9ec060860 0x7fa9ec062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.605+0000 7faa03fff700 1 -- 172.21.15.102:0/3576582725 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa9fc07bfb0 con 0x7faa0c159300 2024-08-17T02:26:22.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.605+0000 7faa0b7fe700 1 --2- 172.21.15.102:0/3576582725 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa9ec060860 0x7fa9ec062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.605+0000 7faa0b7fe700 1 --2- 172.21.15.102:0/3576582725 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa9ec060860 0x7fa9ec062d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4006f00 tx=0x7fa9f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.609+0000 7faa03fff700 1 -- 172.21.15.102:0/3576582725 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa9fc04c400 con 0x7faa0c159300 2024-08-17T02:26:22.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.773+0000 7faa128e6700 1 -- 172.21.15.102:0/3576582725 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa0c0645c0 con 0x7faa0c159300 2024-08-17T02:26:22.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.773+0000 7faa03fff700 1 -- 172.21.15.102:0/3576582725 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa9fc017020 con 0x7faa0c159300 2024-08-17T02:26:22.775 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-08-17T02:26:22.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.773+0000 7faa128e6700 1 -- 172.21.15.102:0/3576582725 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa9ec060860 msgr2=0x7fa9ec062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.773+0000 7faa128e6700 1 --2- 172.21.15.102:0/3576582725 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa9ec060860 0x7fa9ec062d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4006f00 tx=0x7fa9f4008040 comp rx=0 tx=0).stop 2024-08-17T02:26:22.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.773+0000 7faa128e6700 1 -- 172.21.15.102:0/3576582725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa0c159300 msgr2=0x7faa0c155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.773+0000 7faa128e6700 1 --2- 172.21.15.102:0/3576582725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa0c159300 0x7faa0c155fb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00c560 tx=0x7fa9fc001020 comp rx=0 tx=0).stop 2024-08-17T02:26:22.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.773+0000 7faa128e6700 1 -- 172.21.15.102:0/3576582725 shutdown_connections 2024-08-17T02:26:22.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.773+0000 7faa128e6700 1 --2- 172.21.15.102:0/3576582725 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa9ec060860 0x7fa9ec062d10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.773+0000 7faa128e6700 1 --2- 172.21.15.102:0/3576582725 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7faa0c15dbc0 0x7faa0c0c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.773+0000 7faa128e6700 1 --2- 172.21.15.102:0/3576582725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa0c1596d0 0x7faa0c0c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.773+0000 7faa128e6700 1 --2- 172.21.15.102:0/3576582725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa0c159300 0x7faa0c155fb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.773+0000 7faa128e6700 1 -- 172.21.15.102:0/3576582725 >> 172.21.15.102:0/3576582725 conn(0x7faa0c0682c0 msgr2=0x7faa0c0b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:22.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.777+0000 7faa128e6700 1 -- 172.21.15.102:0/3576582725 shutdown_connections 2024-08-17T02:26:22.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.777+0000 7faa128e6700 1 -- 172.21.15.102:0/3576582725 wait complete. 2024-08-17T02:26:22.789 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:22.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.897+0000 7fbe9b10e700 1 Processor -- start 2024-08-17T02:26:22.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.897+0000 7fbe9b10e700 1 -- start start 2024-08-17T02:26:22.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.897+0000 7fbe9b10e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe94159300 0x7fbe940b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.897+0000 7fbe9b10e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbe941596d0 0x7fbe94066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.897+0000 7fbe9b10e700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe940cba90 con 0x7fbe9415dbc0 2024-08-17T02:26:22.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.897+0000 7fbe9b10e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe940b2b60 con 0x7fbe941596d0 2024-08-17T02:26:22.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.897+0000 7fbe9b10e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe940cb160 con 0x7fbe94159300 2024-08-17T02:26:22.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.897+0000 7fbe996ab700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fbe9415dbc0 0x7fbe940afe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60038/0 (socket says 172.21.15.102:60038) 2024-08-17T02:26:22.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.897+0000 7fbe996ab700 1 -- 172.21.15.102:0/1824761375 learned_addr learned my addr 172.21.15.102:0/1824761375 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:22.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.897+0000 7fbe93fff700 1 --2- 172.21.15.102:0/1824761375 >> v2:172.21.15.121:3300/0 conn(0x7fbe941596d0 0x7fbe94066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.897+0000 7fbe98eaa700 1 --2- 172.21.15.102:0/1824761375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe94159300 0x7fbe940b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.897+0000 7fbe937fe700 1 -- 172.21.15.102:0/1824761375 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061503595 0 0) 0x7fbe940cba90 con 0x7fbe9415dbc0 2024-08-17T02:26:22.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.897+0000 7fbe937fe700 1 -- 172.21.15.102:0/1824761375 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe7c003570 con 0x7fbe9415dbc0 2024-08-17T02:26:22.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe93fff700 1 -- 172.21.15.102:0/1824761375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe94159300 msgr2=0x7fbe940b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:22.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe93fff700 1 --2- 172.21.15.102:0/1824761375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe94159300 0x7fbe940b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe93fff700 1 -- 172.21.15.102:0/1824761375 >> v1:172.21.15.102:6789/0 conn(0x7fbe9415dbc0 legacy=0x7fbe940afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe93fff700 1 -- 172.21.15.102:0/1824761375 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe940cb440 con 0x7fbe941596d0 2024-08-17T02:26:22.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe93fff700 1 --2- 172.21.15.102:0/1824761375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe941596d0 0x7fbe94066e00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbe840098e0 tx=0x7fbe840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b58f317ec1cf13c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe937fe700 1 -- 172.21.15.102:0/1824761375 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe84011630 con 0x7fbe941596d0 2024-08-17T02:26:22.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe937fe700 1 -- 172.21.15.102:0/1824761375 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe84011790 con 0x7fbe941596d0 2024-08-17T02:26:22.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe937fe700 1 -- 172.21.15.102:0/1824761375 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe84011b10 con 0x7fbe941596d0 2024-08-17T02:26:22.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe9b10e700 1 -- 172.21.15.102:0/1824761375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe941596d0 msgr2=0x7fbe94066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe9b10e700 1 --2- 172.21.15.102:0/1824761375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe941596d0 0x7fbe94066e00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbe840098e0 tx=0x7fbe840091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe9b10e700 1 -- 172.21.15.102:0/1824761375 shutdown_connections 2024-08-17T02:26:22.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe9b10e700 1 --2- 172.21.15.102:0/1824761375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe941596d0 0x7fbe94066e00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe9b10e700 1 --2- 172.21.15.102:0/1824761375 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe94159300 0x7fbe940b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe9b10e700 1 -- 172.21.15.102:0/1824761375 >> 172.21.15.102:0/1824761375 conn(0x7fbe940682c0 msgr2=0x7fbe940686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:22.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe9b10e700 1 -- 172.21.15.102:0/1824761375 shutdown_connections 2024-08-17T02:26:22.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe9b10e700 1 -- 172.21.15.102:0/1824761375 wait complete. 2024-08-17T02:26:22.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe9b10e700 1 Processor -- start 2024-08-17T02:26:22.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.901+0000 7fbe9b10e700 1 -- start start 2024-08-17T02:26:22.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe9b10e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe94159300 0x7fbe94150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe9b10e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe941596d0 0x7fbe941559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe9b10e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe9415dbc0 0x7fbe940b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe9b10e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe940b3de0 con 0x7fbe94159300 2024-08-17T02:26:22.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe9b10e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe94154940 con 0x7fbe9415dbc0 2024-08-17T02:26:22.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe9b10e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe94154c20 con 0x7fbe941596d0 2024-08-17T02:26:22.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe98eaa700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe94159300 0x7fbe94150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe98eaa700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe94159300 0x7fbe94150520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43460/0 (socket says 172.21.15.102:43460) 2024-08-17T02:26:22.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe98eaa700 1 -- 172.21.15.102:0/2426385153 learned_addr learned my addr 172.21.15.102:0/2426385153 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:22.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe996ab700 1 --2- 172.21.15.102:0/2426385153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe9415dbc0 0x7fbe940b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe93fff700 1 --2- 172.21.15.102:0/2426385153 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe941596d0 0x7fbe941559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe98eaa700 1 -- 172.21.15.102:0/2426385153 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe941596d0 msgr2=0x7fbe941559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe98eaa700 1 --2- 172.21.15.102:0/2426385153 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe941596d0 0x7fbe941559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe98eaa700 1 -- 172.21.15.102:0/2426385153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe9415dbc0 msgr2=0x7fbe940b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe98eaa700 1 --2- 172.21.15.102:0/2426385153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe9415dbc0 0x7fbe940b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe98eaa700 1 -- 172.21.15.102:0/2426385153 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe84009420 con 0x7fbe94159300 2024-08-17T02:26:22.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe996ab700 1 --2- 172.21.15.102:0/2426385153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe9415dbc0 0x7fbe940b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:22.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe93fff700 1 --2- 172.21.15.102:0/2426385153 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe941596d0 0x7fbe941559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:22.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe98eaa700 1 --2- 172.21.15.102:0/2426385153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe94159300 0x7fbe94150520 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800e930 tx=0x7fbe880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe90ff9700 1 -- 172.21.15.102:0/2426385153 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800eed0 con 0x7fbe94159300 2024-08-17T02:26:22.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe90ff9700 1 -- 172.21.15.102:0/2426385153 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8800c850 con 0x7fbe94159300 2024-08-17T02:26:22.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe9b10e700 1 -- 172.21.15.102:0/2426385153 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe94154f00 con 0x7fbe94159300 2024-08-17T02:26:22.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe90ff9700 1 -- 172.21.15.102:0/2426385153 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800cbf0 con 0x7fbe94159300 2024-08-17T02:26:22.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.905+0000 7fbe9b10e700 1 -- 172.21.15.102:0/2426385153 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe941554c0 con 0x7fbe94159300 2024-08-17T02:26:22.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.909+0000 7fbe9b10e700 1 -- 172.21.15.102:0/2426385153 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe940645c0 con 0x7fbe94159300 2024-08-17T02:26:22.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.909+0000 7fbe90ff9700 1 -- 172.21.15.102:0/2426385153 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbe88013470 con 0x7fbe94159300 2024-08-17T02:26:22.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.909+0000 7fbe90ff9700 1 --2- 172.21.15.102:0/2426385153 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbe80060890 0x7fbe80062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.909+0000 7fbe93fff700 1 --2- 172.21.15.102:0/2426385153 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbe80060890 0x7fbe80062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.909+0000 7fbe90ff9700 1 -- 172.21.15.102:0/2426385153 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe8807cdd0 con 0x7fbe94159300 2024-08-17T02:26:22.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.909+0000 7fbe93fff700 1 --2- 172.21.15.102:0/2426385153 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbe80060890 0x7fbe80062d40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbe9416cf40 tx=0x7fbe84017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:22.917+0000 7fbe90ff9700 1 -- 172.21.15.102:0/2426385153 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbe8804d180 con 0x7fbe94159300 2024-08-17T02:26:23.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.081+0000 7fbe9b10e700 1 -- 172.21.15.102:0/2426385153 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe940caac0 con 0x7fbe94159300 2024-08-17T02:26:23.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.081+0000 7fbe90ff9700 1 -- 172.21.15.102:0/2426385153 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbe880507a0 con 0x7fbe94159300 2024-08-17T02:26:23.082 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-08-17T02:26:23.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.085+0000 7fbe9b10e700 1 -- 172.21.15.102:0/2426385153 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbe80060890 msgr2=0x7fbe80062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.085+0000 7fbe9b10e700 1 --2- 172.21.15.102:0/2426385153 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbe80060890 0x7fbe80062d40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbe9416cf40 tx=0x7fbe84017000 comp rx=0 tx=0).stop 2024-08-17T02:26:23.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.085+0000 7fbe9b10e700 1 -- 172.21.15.102:0/2426385153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe94159300 msgr2=0x7fbe94150520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.085+0000 7fbe9b10e700 1 --2- 172.21.15.102:0/2426385153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe94159300 0x7fbe94150520 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800e930 tx=0x7fbe880091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.085+0000 7fbe9b10e700 1 -- 172.21.15.102:0/2426385153 shutdown_connections 2024-08-17T02:26:23.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.085+0000 7fbe9b10e700 1 --2- 172.21.15.102:0/2426385153 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbe80060890 0x7fbe80062d40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.085+0000 7fbe9b10e700 1 --2- 172.21.15.102:0/2426385153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe9415dbc0 0x7fbe940b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.085+0000 7fbe9b10e700 1 --2- 172.21.15.102:0/2426385153 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbe941596d0 0x7fbe941559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.085+0000 7fbe9b10e700 1 --2- 172.21.15.102:0/2426385153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe94159300 0x7fbe94150520 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.085+0000 7fbe9b10e700 1 -- 172.21.15.102:0/2426385153 >> 172.21.15.102:0/2426385153 conn(0x7fbe940682c0 msgr2=0x7fbe94157d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.085+0000 7fbe9b10e700 1 -- 172.21.15.102:0/2426385153 shutdown_connections 2024-08-17T02:26:23.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.085+0000 7fbe9b10e700 1 -- 172.21.15.102:0/2426385153 wait complete. 2024-08-17T02:26:23.103 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:23.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.213+0000 7f8cc3fff700 1 Processor -- start 2024-08-17T02:26:23.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.213+0000 7f8cc3fff700 1 -- start start 2024-08-17T02:26:23.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc3fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8cc413f680 0x7f8cc40aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc3fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8cc40ad6c0 0x7f8cc406e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc3fff700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc40b0810 con 0x7f8cc413fa50 2024-08-17T02:26:23.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc3fff700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc40afc70 con 0x7f8cc413f680 2024-08-17T02:26:23.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc3fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40af060 con 0x7f8cc40ad6c0 2024-08-17T02:26:23.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc2ffd700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8cc413f680 0x7f8cc40aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc2ffd700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8cc413f680 0x7f8cc40aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43476/0 (socket says 172.21.15.102:43476) 2024-08-17T02:26:23.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc2ffd700 1 -- 172.21.15.102:0/3670876872 learned_addr learned my addr 172.21.15.102:0/3670876872 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:23.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc37fe700 1 --2- 172.21.15.102:0/3670876872 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8cc40ad6c0 0x7f8cc406e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc2ffd700 1 -- 172.21.15.102:0/3670876872 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8cc40ad6c0 msgr2=0x7f8cc406e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:23.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc2ffd700 1 --2- 172.21.15.102:0/3670876872 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8cc40ad6c0 0x7f8cc406e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc2ffd700 1 -- 172.21.15.102:0/3670876872 >> v1:172.21.15.121:6789/0 conn(0x7f8cc413fa50 legacy=0x7f8cc40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc2ffd700 1 -- 172.21.15.102:0/3670876872 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc40af340 con 0x7f8cc413f680 2024-08-17T02:26:23.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc2ffd700 1 --2- 172.21.15.102:0/3670876872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc413f680 0x7f8cc40aea80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00d1a0 tx=0x7f8cbc00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c909e86e2ee9fa1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc1ffb700 1 -- 172.21.15.102:0/3670876872 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc010070 con 0x7f8cc413f680 2024-08-17T02:26:23.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc1ffb700 1 -- 172.21.15.102:0/3670876872 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc00de10 con 0x7f8cc413f680 2024-08-17T02:26:23.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc1ffb700 1 -- 172.21.15.102:0/3670876872 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc00b320 con 0x7f8cc413f680 2024-08-17T02:26:23.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc3fff700 1 -- 172.21.15.102:0/3670876872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc413f680 msgr2=0x7f8cc40aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc3fff700 1 --2- 172.21.15.102:0/3670876872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc413f680 0x7f8cc40aea80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00d1a0 tx=0x7f8cbc00ba50 comp rx=0 tx=0).stop 2024-08-17T02:26:23.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc3fff700 1 -- 172.21.15.102:0/3670876872 shutdown_connections 2024-08-17T02:26:23.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc3fff700 1 --2- 172.21.15.102:0/3670876872 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8cc40ad6c0 0x7f8cc406e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc3fff700 1 --2- 172.21.15.102:0/3670876872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc413f680 0x7f8cc40aea80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc3fff700 1 -- 172.21.15.102:0/3670876872 >> 172.21.15.102:0/3670876872 conn(0x7f8cc40678a0 msgr2=0x7f8cc4067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc3fff700 1 -- 172.21.15.102:0/3670876872 shutdown_connections 2024-08-17T02:26:23.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.217+0000 7f8cc3fff700 1 -- 172.21.15.102:0/3670876872 wait complete. 2024-08-17T02:26:23.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc3fff700 1 Processor -- start 2024-08-17T02:26:23.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc3fff700 1 -- start start 2024-08-17T02:26:23.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc3fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc40ad6c0 0x7f8cc40a8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc3fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8cc413f680 0x7f8cc40a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc3fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cc413fa50 0x7f8cc40a6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc3fff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40a9cd0 con 0x7f8cc40ad6c0 2024-08-17T02:26:23.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc3fff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40a90c0 con 0x7f8cc413fa50 2024-08-17T02:26:23.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc3fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40a93a0 con 0x7f8cc413f680 2024-08-17T02:26:23.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc2ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc40ad6c0 0x7f8cc40a8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc2ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc40ad6c0 0x7f8cc40a8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43480/0 (socket says 172.21.15.102:43480) 2024-08-17T02:26:23.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc2ffd700 1 -- 172.21.15.102:0/203248819 learned_addr learned my addr 172.21.15.102:0/203248819 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:23.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc27fc700 1 --2- 172.21.15.102:0/203248819 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8cc413f680 0x7f8cc40a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc37fe700 1 --2- 172.21.15.102:0/203248819 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cc413fa50 0x7f8cc40a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc2ffd700 1 -- 172.21.15.102:0/203248819 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8cc413f680 msgr2=0x7f8cc40a6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc2ffd700 1 --2- 172.21.15.102:0/203248819 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8cc413f680 0x7f8cc40a6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc2ffd700 1 -- 172.21.15.102:0/203248819 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cc413fa50 msgr2=0x7f8cc40a6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc2ffd700 1 --2- 172.21.15.102:0/203248819 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cc413fa50 0x7f8cc40a6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc2ffd700 1 -- 172.21.15.102:0/203248819 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc00bcf0 con 0x7f8cc40ad6c0 2024-08-17T02:26:23.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cc2ffd700 1 --2- 172.21.15.102:0/203248819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc40ad6c0 0x7f8cc40a8870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00d840 tx=0x7f8cbc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.221+0000 7f8cbaffd700 1 -- 172.21.15.102:0/203248819 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc009a30 con 0x7f8cc40ad6c0 2024-08-17T02:26:23.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.225+0000 7f8cbaffd700 1 -- 172.21.15.102:0/203248819 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc009b90 con 0x7f8cc40ad6c0 2024-08-17T02:26:23.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.225+0000 7f8cc3fff700 1 -- 172.21.15.102:0/203248819 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc40a9680 con 0x7f8cc40ad6c0 2024-08-17T02:26:23.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.225+0000 7f8cbaffd700 1 -- 172.21.15.102:0/203248819 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc01f420 con 0x7f8cc40ad6c0 2024-08-17T02:26:23.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.225+0000 7f8cc3fff700 1 -- 172.21.15.102:0/203248819 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc4158670 con 0x7f8cc40ad6c0 2024-08-17T02:26:23.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.225+0000 7f8cc3fff700 1 -- 172.21.15.102:0/203248819 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc4064330 con 0x7f8cc40ad6c0 2024-08-17T02:26:23.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.225+0000 7f8cbaffd700 1 -- 172.21.15.102:0/203248819 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8cbc003040 con 0x7f8cc40ad6c0 2024-08-17T02:26:23.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.225+0000 7f8cbaffd700 1 --2- 172.21.15.102:0/203248819 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8ca8060860 0x7f8ca8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.225+0000 7f8cbaffd700 1 -- 172.21.15.102:0/203248819 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8cbc080f40 con 0x7f8cc40ad6c0 2024-08-17T02:26:23.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.225+0000 7f8cc27fc700 1 --2- 172.21.15.102:0/203248819 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8ca8060860 0x7f8ca8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.229+0000 7f8cc27fc700 1 --2- 172.21.15.102:0/203248819 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8ca8060860 0x7f8ca8062d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8cc413b000 tx=0x7f8cac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.229+0000 7f8cbaffd700 1 -- 172.21.15.102:0/203248819 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8cbc051410 con 0x7f8cc40ad6c0 2024-08-17T02:26:23.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.393+0000 7f8cc3fff700 1 -- 172.21.15.102:0/203248819 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8cc406ed70 con 0x7f8cc40ad6c0 2024-08-17T02:26:23.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.393+0000 7f8cbaffd700 1 -- 172.21.15.102:0/203248819 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8cbc054a30 con 0x7f8cc40ad6c0 2024-08-17T02:26:23.398 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-08-17T02:26:23.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.397+0000 7f8cc3fff700 1 -- 172.21.15.102:0/203248819 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8ca8060860 msgr2=0x7f8ca8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.397+0000 7f8cc3fff700 1 --2- 172.21.15.102:0/203248819 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8ca8060860 0x7f8ca8062d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8cc413b000 tx=0x7f8cac009040 comp rx=0 tx=0).stop 2024-08-17T02:26:23.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.397+0000 7f8cc3fff700 1 -- 172.21.15.102:0/203248819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc40ad6c0 msgr2=0x7f8cc40a8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.397+0000 7f8cc3fff700 1 --2- 172.21.15.102:0/203248819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc40ad6c0 0x7f8cc40a8870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00d840 tx=0x7f8cbc01a000 comp rx=0 tx=0).stop 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.397+0000 7f8cc3fff700 1 -- 172.21.15.102:0/203248819 shutdown_connections 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.397+0000 7f8cc3fff700 1 --2- 172.21.15.102:0/203248819 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8ca8060860 0x7f8ca8062d10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.397+0000 7f8cc3fff700 1 --2- 172.21.15.102:0/203248819 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cc413fa50 0x7f8cc40a6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.397+0000 7f8cc3fff700 1 --2- 172.21.15.102:0/203248819 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8cc413f680 0x7f8cc40a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.397+0000 7f8cc3fff700 1 --2- 172.21.15.102:0/203248819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cc40ad6c0 0x7f8cc40a8870 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.397+0000 7f8cc3fff700 1 -- 172.21.15.102:0/203248819 >> 172.21.15.102:0/203248819 conn(0x7f8cc40678a0 msgr2=0x7f8cc4158f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.397+0000 7f8cc3fff700 1 -- 172.21.15.102:0/203248819 shutdown_connections 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.397+0000 7f8cc3fff700 1 -- 172.21.15.102:0/203248819 wait complete. 2024-08-17T02:26:23.412 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:23.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d93083700 1 Processor -- start 2024-08-17T02:26:23.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d93083700 1 -- start start 2024-08-17T02:26:23.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d93083700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0d840e6570 0x7f0d8404b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d93083700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d84006bd0 con 0x7f0d84055b70 2024-08-17T02:26:23.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d93083700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8404c0d0 con 0x7f0d8404bc80 2024-08-17T02:26:23.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d93083700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d840062e0 con 0x7f0d840e6570 2024-08-17T02:26:23.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d92882700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0d84055b70 0x7f0d84007060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60046/0 (socket says 172.21.15.102:60046) 2024-08-17T02:26:23.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d92882700 1 -- 172.21.15.102:0/3398719372 learned_addr learned my addr 172.21.15.102:0/3398719372 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:23.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d92081700 1 --2- 172.21.15.102:0/3398719372 >> v2:172.21.15.121:3300/0 conn(0x7f0d840e6570 0x7f0d8404b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d9107f700 1 -- 172.21.15.102:0/3398719372 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601327703 0 0) 0x7f0d84006bd0 con 0x7f0d84055b70 2024-08-17T02:26:23.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d9107f700 1 -- 172.21.15.102:0/3398719372 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d78003570 con 0x7f0d84055b70 2024-08-17T02:26:23.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d92081700 1 -- 172.21.15.102:0/3398719372 >> v1:172.21.15.121:6789/0 conn(0x7f0d8404bc80 legacy=0x7f0d84055460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d92081700 1 -- 172.21.15.102:0/3398719372 >> v1:172.21.15.102:6789/0 conn(0x7f0d84055b70 legacy=0x7f0d84007060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d92081700 1 -- 172.21.15.102:0/3398719372 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d84006580 con 0x7f0d840e6570 2024-08-17T02:26:23.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d92081700 1 --2- 172.21.15.102:0/3398719372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d840e6570 0x7f0d8404b740 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c065b20 tx=0x7f0d8c064ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66b838d67657e31d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d9107f700 1 -- 172.21.15.102:0/3398719372 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c02b0f0 con 0x7f0d840e6570 2024-08-17T02:26:23.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d9107f700 1 -- 172.21.15.102:0/3398719372 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c04c190 con 0x7f0d840e6570 2024-08-17T02:26:23.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d9107f700 1 -- 172.21.15.102:0/3398719372 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c029ba0 con 0x7f0d840e6570 2024-08-17T02:26:23.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.513+0000 7f0d93083700 1 -- 172.21.15.102:0/3398719372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d840e6570 msgr2=0x7f0d8404b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.517+0000 7f0d93083700 1 --2- 172.21.15.102:0/3398719372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d840e6570 0x7f0d8404b740 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c065b20 tx=0x7f0d8c064ee0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.517+0000 7f0d93083700 1 -- 172.21.15.102:0/3398719372 shutdown_connections 2024-08-17T02:26:23.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.517+0000 7f0d93083700 1 --2- 172.21.15.102:0/3398719372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d840e6570 0x7f0d8404b740 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.517+0000 7f0d93083700 1 -- 172.21.15.102:0/3398719372 >> 172.21.15.102:0/3398719372 conn(0x7f0d84038360 msgr2=0x7f0d84038760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.517+0000 7f0d93083700 1 -- 172.21.15.102:0/3398719372 shutdown_connections 2024-08-17T02:26:23.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.517+0000 7f0d93083700 1 -- 172.21.15.102:0/3398719372 wait complete. 2024-08-17T02:26:23.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.517+0000 7f0d93083700 1 Processor -- start 2024-08-17T02:26:23.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.517+0000 7f0d93083700 1 -- start start 2024-08-17T02:26:23.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d93083700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d8404bc80 0x7f0d840ea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d93083700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d84055b70 0x7f0d840e8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d93083700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d840e6570 0x7f0d840e8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d93083700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840e9e10 con 0x7f0d840e6570 2024-08-17T02:26:23.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d93083700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840e8f80 con 0x7f0d84055b70 2024-08-17T02:26:23.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d93083700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840e9200 con 0x7f0d8404bc80 2024-08-17T02:26:23.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d92882700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d840e6570 0x7f0d840e8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d92882700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d840e6570 0x7f0d840e8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43494/0 (socket says 172.21.15.102:43494) 2024-08-17T02:26:23.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d92882700 1 -- 172.21.15.102:0/3857913912 learned_addr learned my addr 172.21.15.102:0/3857913912 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:23.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d91880700 1 --2- 172.21.15.102:0/3857913912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d84055b70 0x7f0d840e8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d92081700 1 --2- 172.21.15.102:0/3857913912 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d8404bc80 0x7f0d840ea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d92882700 1 -- 172.21.15.102:0/3857913912 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d8404bc80 msgr2=0x7f0d840ea2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d92882700 1 --2- 172.21.15.102:0/3857913912 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d8404bc80 0x7f0d840ea2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d92882700 1 -- 172.21.15.102:0/3857913912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d84055b70 msgr2=0x7f0d840e8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d92882700 1 --2- 172.21.15.102:0/3857913912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d84055b70 0x7f0d840e8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d92882700 1 -- 172.21.15.102:0/3857913912 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c04c770 con 0x7f0d840e6570 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d92882700 1 --2- 172.21.15.102:0/3857913912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d840e6570 0x7f0d840e8a40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800c790 tx=0x7f0d88007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d827fc700 1 -- 172.21.15.102:0/3857913912 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88005c00 con 0x7f0d840e6570 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d93083700 1 -- 172.21.15.102:0/3857913912 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d840e94e0 con 0x7f0d840e6570 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d827fc700 1 -- 172.21.15.102:0/3857913912 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d88005d60 con 0x7f0d840e6570 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d827fc700 1 -- 172.21.15.102:0/3857913912 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d880072e0 con 0x7f0d840e6570 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.521+0000 7f0d93083700 1 -- 172.21.15.102:0/3857913912 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d840e9aa0 con 0x7f0d840e6570 2024-08-17T02:26:23.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.525+0000 7f0d93083700 1 -- 172.21.15.102:0/3857913912 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d840e9f80 con 0x7f0d840e6570 2024-08-17T02:26:23.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.525+0000 7f0d827fc700 1 -- 172.21.15.102:0/3857913912 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0d8801b3b0 con 0x7f0d840e6570 2024-08-17T02:26:23.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.525+0000 7f0d827fc700 1 --2- 172.21.15.102:0/3857913912 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d70060890 0x7f0d70062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.525+0000 7f0d827fc700 1 -- 172.21.15.102:0/3857913912 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0d8807be90 con 0x7f0d840e6570 2024-08-17T02:26:23.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.525+0000 7f0d92081700 1 --2- 172.21.15.102:0/3857913912 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d70060890 0x7f0d70062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.525+0000 7f0d92081700 1 --2- 172.21.15.102:0/3857913912 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d70060890 0x7f0d70062d40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400d890 tx=0x7f0d8c06c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.533+0000 7f0d827fc700 1 -- 172.21.15.102:0/3857913912 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0d8804c390 con 0x7f0d840e6570 2024-08-17T02:26:23.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.701+0000 7f0d93083700 1 -- 172.21.15.102:0/3857913912 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d84005800 con 0x7f0d840e6570 2024-08-17T02:26:23.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.701+0000 7f0d827fc700 1 -- 172.21.15.102:0/3857913912 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f0d88017090 con 0x7f0d840e6570 2024-08-17T02:26:23.704 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:23.704 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:57.002263+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:53.562223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:54.343618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.705+0000 7f0d93083700 1 -- 172.21.15.102:0/3857913912 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d70060890 msgr2=0x7f0d70062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.705+0000 7f0d93083700 1 --2- 172.21.15.102:0/3857913912 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d70060890 0x7f0d70062d40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400d890 tx=0x7f0d8c06c000 comp rx=0 tx=0).stop 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.705+0000 7f0d93083700 1 -- 172.21.15.102:0/3857913912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d840e6570 msgr2=0x7f0d840e8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.705+0000 7f0d93083700 1 --2- 172.21.15.102:0/3857913912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d840e6570 0x7f0d840e8a40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800c790 tx=0x7f0d88007dd0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.705+0000 7f0d93083700 1 -- 172.21.15.102:0/3857913912 shutdown_connections 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.705+0000 7f0d93083700 1 --2- 172.21.15.102:0/3857913912 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d70060890 0x7f0d70062d40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.705+0000 7f0d93083700 1 --2- 172.21.15.102:0/3857913912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d840e6570 0x7f0d840e8a40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.705+0000 7f0d93083700 1 --2- 172.21.15.102:0/3857913912 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d84055b70 0x7f0d840e8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.705+0000 7f0d93083700 1 --2- 172.21.15.102:0/3857913912 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d8404bc80 0x7f0d840ea2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.705+0000 7f0d93083700 1 -- 172.21.15.102:0/3857913912 >> 172.21.15.102:0/3857913912 conn(0x7f0d84038360 msgr2=0x7f0d840528f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.705+0000 7f0d93083700 1 -- 172.21.15.102:0/3857913912 shutdown_connections 2024-08-17T02:26:23.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.705+0000 7f0d93083700 1 -- 172.21.15.102:0/3857913912 wait complete. 2024-08-17T02:26:23.719 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:49.236728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:53.562223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:54.343618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:23.719 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:23.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.829+0000 7fac6ffff700 1 Processor -- start 2024-08-17T02:26:23.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6ffff700 1 -- start start 2024-08-17T02:26:23.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6ffff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fac701590b0 0x7fac70066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6ffff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fac700cd2b0 0x7fac70067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6ffff700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac700ce210 con 0x7fac70159480 2024-08-17T02:26:23.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6ffff700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac700cba00 con 0x7fac700cd2b0 2024-08-17T02:26:23.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6ffff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac700cdc90 con 0x7fac701590b0 2024-08-17T02:26:23.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6f7fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fac700cd2b0 0x7fac70067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6f7fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fac700cd2b0 0x7fac70067340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43510/0 (socket says 172.21.15.102:43510) 2024-08-17T02:26:23.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6f7fe700 1 -- 172.21.15.102:0/533605399 learned_addr learned my addr 172.21.15.102:0/533605399 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:23.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6effd700 1 --2- 172.21.15.102:0/533605399 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fac701590b0 0x7fac70066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6f7fe700 1 -- 172.21.15.102:0/533605399 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fac701590b0 msgr2=0x7fac70066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:23.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6f7fe700 1 --2- 172.21.15.102:0/533605399 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fac701590b0 0x7fac70066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6f7fe700 1 -- 172.21.15.102:0/533605399 >> v1:172.21.15.121:6789/0 conn(0x7fac70159480 legacy=0x7fac7015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6f7fe700 1 -- 172.21.15.102:0/533605399 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac700cb440 con 0x7fac700cd2b0 2024-08-17T02:26:23.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6f7fe700 1 --2- 172.21.15.102:0/533605399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac700cd2b0 0x7fac70067340 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fac68009f20 tx=0x7fac68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b58dbfe604330c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6dffb700 1 -- 172.21.15.102:0/533605399 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6800e070 con 0x7fac700cd2b0 2024-08-17T02:26:23.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6dffb700 1 -- 172.21.15.102:0/533605399 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6800b9d0 con 0x7fac700cd2b0 2024-08-17T02:26:23.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6dffb700 1 -- 172.21.15.102:0/533605399 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac680092e0 con 0x7fac700cd2b0 2024-08-17T02:26:23.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6ffff700 1 -- 172.21.15.102:0/533605399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac700cd2b0 msgr2=0x7fac70067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6ffff700 1 --2- 172.21.15.102:0/533605399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac700cd2b0 0x7fac70067340 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fac68009f20 tx=0x7fac68009840 comp rx=0 tx=0).stop 2024-08-17T02:26:23.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6ffff700 1 -- 172.21.15.102:0/533605399 shutdown_connections 2024-08-17T02:26:23.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6ffff700 1 --2- 172.21.15.102:0/533605399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac700cd2b0 0x7fac70067340 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6ffff700 1 --2- 172.21.15.102:0/533605399 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fac701590b0 0x7fac70066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6ffff700 1 -- 172.21.15.102:0/533605399 >> 172.21.15.102:0/533605399 conn(0x7fac700d0b90 msgr2=0x7fac700ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6ffff700 1 -- 172.21.15.102:0/533605399 shutdown_connections 2024-08-17T02:26:23.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.833+0000 7fac6ffff700 1 -- 172.21.15.102:0/533605399 wait complete. 2024-08-17T02:26:23.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.837+0000 7fac6ffff700 1 Processor -- start 2024-08-17T02:26:23.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.837+0000 7fac6ffff700 1 -- start start 2024-08-17T02:26:23.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.837+0000 7fac6ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac700cd2b0 0x7fac701534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.837+0000 7fac6ffff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac701590b0 0x7fac701554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.837+0000 7fac6ffff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fac70159480 0x7fac701435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.837+0000 7fac6ffff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac700c72a0 con 0x7fac701590b0 2024-08-17T02:26:23.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.837+0000 7fac6ffff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac700c7580 con 0x7fac700cd2b0 2024-08-17T02:26:23.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.837+0000 7fac6ffff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac700c7860 con 0x7fac70159480 2024-08-17T02:26:23.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.837+0000 7fac6e7fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac701590b0 0x7fac701554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.837+0000 7fac6e7fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac701590b0 0x7fac701554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43524/0 (socket says 172.21.15.102:43524) 2024-08-17T02:26:23.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.837+0000 7fac6f7fe700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fac70159480 0x7fac701435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.837+0000 7fac6effd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac700cd2b0 0x7fac701534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.837+0000 7fac6e7fc700 1 -- 172.21.15.102:0/4221471636 learned_addr learned my addr 172.21.15.102:0/4221471636 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:23.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.841+0000 7fac6e7fc700 1 -- 172.21.15.102:0/4221471636 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fac70159480 msgr2=0x7fac701435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.841+0000 7fac6e7fc700 1 --2- 172.21.15.102:0/4221471636 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fac70159480 0x7fac701435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.841+0000 7fac6e7fc700 1 -- 172.21.15.102:0/4221471636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac700cd2b0 msgr2=0x7fac701534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.841+0000 7fac6e7fc700 1 --2- 172.21.15.102:0/4221471636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac700cd2b0 0x7fac701534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.841+0000 7fac6e7fc700 1 -- 172.21.15.102:0/4221471636 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac68009ae0 con 0x7fac701590b0 2024-08-17T02:26:23.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.841+0000 7fac6e7fc700 1 --2- 172.21.15.102:0/4221471636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac701590b0 0x7fac701554e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fac6000c4e0 tx=0x7fac6000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.841+0000 7fac56ffd700 1 -- 172.21.15.102:0/4221471636 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac60011590 con 0x7fac701590b0 2024-08-17T02:26:23.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.841+0000 7fac56ffd700 1 -- 172.21.15.102:0/4221471636 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac60011710 con 0x7fac701590b0 2024-08-17T02:26:23.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.841+0000 7fac56ffd700 1 -- 172.21.15.102:0/4221471636 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac60011ad0 con 0x7fac701590b0 2024-08-17T02:26:23.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.841+0000 7fac6ffff700 1 -- 172.21.15.102:0/4221471636 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac700c7b40 con 0x7fac701590b0 2024-08-17T02:26:23.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.841+0000 7fac6ffff700 1 -- 172.21.15.102:0/4221471636 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac70153a20 con 0x7fac701590b0 2024-08-17T02:26:23.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.841+0000 7fac6ffff700 1 -- 172.21.15.102:0/4221471636 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac70153c40 con 0x7fac701590b0 2024-08-17T02:26:23.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.841+0000 7fac56ffd700 1 -- 172.21.15.102:0/4221471636 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fac6001b3b0 con 0x7fac701590b0 2024-08-17T02:26:23.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.845+0000 7fac56ffd700 1 --2- 172.21.15.102:0/4221471636 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fac5c060860 0x7fac5c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.845+0000 7fac56ffd700 1 -- 172.21.15.102:0/4221471636 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fac6007bfc0 con 0x7fac701590b0 2024-08-17T02:26:23.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.845+0000 7fac6effd700 1 --2- 172.21.15.102:0/4221471636 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fac5c060860 0x7fac5c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.845+0000 7fac6effd700 1 --2- 172.21.15.102:0/4221471636 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fac5c060860 0x7fac5c062d10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fac64009db0 tx=0x7fac640091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:23.853+0000 7fac56ffd700 1 -- 172.21.15.102:0/4221471636 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fac6004c370 con 0x7fac701590b0 2024-08-17T02:26:24.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.009+0000 7fac6ffff700 1 -- 172.21.15.102:0/4221471636 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac700c73e0 con 0x7fac701590b0 2024-08-17T02:26:24.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.009+0000 7fac56ffd700 1 -- 172.21.15.102:0/4221471636 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac700c73e0 con 0x7fac701590b0 2024-08-17T02:26:24.013 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-08-17T02:26:24.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.013+0000 7fac6ffff700 1 -- 172.21.15.102:0/4221471636 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fac5c060860 msgr2=0x7fac5c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.013+0000 7fac6ffff700 1 --2- 172.21.15.102:0/4221471636 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fac5c060860 0x7fac5c062d10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fac64009db0 tx=0x7fac640091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.013+0000 7fac6ffff700 1 -- 172.21.15.102:0/4221471636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac701590b0 msgr2=0x7fac701554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.013+0000 7fac6ffff700 1 --2- 172.21.15.102:0/4221471636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac701590b0 0x7fac701554e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fac6000c4e0 tx=0x7fac6000c7f0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.013+0000 7fac6ffff700 1 -- 172.21.15.102:0/4221471636 shutdown_connections 2024-08-17T02:26:24.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.013+0000 7fac6ffff700 1 --2- 172.21.15.102:0/4221471636 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fac5c060860 0x7fac5c062d10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.013+0000 7fac6ffff700 1 --2- 172.21.15.102:0/4221471636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac701590b0 0x7fac701554e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.013+0000 7fac6ffff700 1 --2- 172.21.15.102:0/4221471636 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fac70159480 0x7fac701435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.013+0000 7fac6ffff700 1 --2- 172.21.15.102:0/4221471636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac700cd2b0 0x7fac701534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.013+0000 7fac6ffff700 1 -- 172.21.15.102:0/4221471636 >> 172.21.15.102:0/4221471636 conn(0x7fac700d0b90 msgr2=0x7fac70063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.013+0000 7fac6ffff700 1 -- 172.21.15.102:0/4221471636 shutdown_connections 2024-08-17T02:26:24.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.013+0000 7fac6ffff700 1 -- 172.21.15.102:0/4221471636 wait complete. 2024-08-17T02:26:24.028 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:24.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1cf5f700 1 Processor -- start 2024-08-17T02:26:24.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1cf5f700 1 -- start start 2024-08-17T02:26:24.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1cf5f700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1c181591e0 0x7f1c180ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1cf5f700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1c180cd080 0x7f1c180ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1cf5f700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c180cf1c0 con 0x7f1c180ced10 2024-08-17T02:26:24.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1cf5f700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c180cf460 con 0x7f1c181591e0 2024-08-17T02:26:24.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1cf5f700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c180cf700 con 0x7f1c180cd080 2024-08-17T02:26:24.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1659c700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1c181591e0 0x7f1c180ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1659c700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1c181591e0 0x7f1c180ce7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43536/0 (socket says 172.21.15.102:43536) 2024-08-17T02:26:24.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1659c700 1 -- 172.21.15.102:0/2510538011 learned_addr learned my addr 172.21.15.102:0/2510538011 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:24.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c16d9d700 1 --2- 172.21.15.102:0/2510538011 >> v2:172.21.15.121:3300/0 conn(0x7f1c180cd080 0x7f1c180ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1659c700 1 -- 172.21.15.102:0/2510538011 >> v2:172.21.15.121:3300/0 conn(0x7f1c180cd080 msgr2=0x7f1c180ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:24.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1659c700 1 --2- 172.21.15.102:0/2510538011 >> v2:172.21.15.121:3300/0 conn(0x7f1c180cd080 0x7f1c180ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1659c700 1 -- 172.21.15.102:0/2510538011 >> v1:172.21.15.121:6789/0 conn(0x7f1c180ced10 legacy=0x7f1c180cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1659c700 1 -- 172.21.15.102:0/2510538011 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c180cf9c0 con 0x7f1c181591e0 2024-08-17T02:26:24.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1659c700 1 --2- 172.21.15.102:0/2510538011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c181591e0 0x7f1c180ce7d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1c180cd860 tx=0x7f1c00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9a618e2e8e9c4f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1559a700 1 -- 172.21.15.102:0/2510538011 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0000b860 con 0x7f1c181591e0 2024-08-17T02:26:24.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1559a700 1 -- 172.21.15.102:0/2510538011 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0000b9c0 con 0x7f1c181591e0 2024-08-17T02:26:24.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.137+0000 7f1c1559a700 1 -- 172.21.15.102:0/2510538011 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0000bd60 con 0x7f1c181591e0 2024-08-17T02:26:24.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1cf5f700 1 -- 172.21.15.102:0/2510538011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c181591e0 msgr2=0x7f1c180ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1cf5f700 1 --2- 172.21.15.102:0/2510538011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c181591e0 0x7f1c180ce7d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1c180cd860 tx=0x7f1c00009250 comp rx=0 tx=0).stop 2024-08-17T02:26:24.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1cf5f700 1 -- 172.21.15.102:0/2510538011 shutdown_connections 2024-08-17T02:26:24.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1cf5f700 1 --2- 172.21.15.102:0/2510538011 >> v2:172.21.15.121:3300/0 conn(0x7f1c180cd080 0x7f1c180ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1cf5f700 1 --2- 172.21.15.102:0/2510538011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c181591e0 0x7f1c180ce7d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1cf5f700 1 -- 172.21.15.102:0/2510538011 >> 172.21.15.102:0/2510538011 conn(0x7f1c18089bc0 msgr2=0x7f1c180994e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1cf5f700 1 -- 172.21.15.102:0/2510538011 shutdown_connections 2024-08-17T02:26:24.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1cf5f700 1 -- 172.21.15.102:0/2510538011 wait complete. 2024-08-17T02:26:24.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1cf5f700 1 Processor -- start 2024-08-17T02:26:24.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1cf5f700 1 -- start start 2024-08-17T02:26:24.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1cf5f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c180cd080 0x7f1c18154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1cf5f700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1c180ced10 0x7f1c1809b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1cf5f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c181591e0 0x7f1c180c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1cf5f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180c6b50 con 0x7f1c180cd080 2024-08-17T02:26:24.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1cf5f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180c8e40 con 0x7f1c181591e0 2024-08-17T02:26:24.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1cf5f700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180c52c0 con 0x7f1c180ced10 2024-08-17T02:26:24.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1659c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c180cd080 0x7f1c18154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1659c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c180cd080 0x7f1c18154740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43552/0 (socket says 172.21.15.102:43552) 2024-08-17T02:26:24.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.141+0000 7f1c1659c700 1 -- 172.21.15.102:0/848890879 learned_addr learned my addr 172.21.15.102:0/848890879 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:24.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.145+0000 7f1c16d9d700 1 --2- 172.21.15.102:0/848890879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c181591e0 0x7f1c180c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.145+0000 7f1c15d9b700 1 --2- 172.21.15.102:0/848890879 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1c180ced10 0x7f1c1809b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.145+0000 7f1c1659c700 1 -- 172.21.15.102:0/848890879 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1c180ced10 msgr2=0x7f1c1809b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.145+0000 7f1c1659c700 1 --2- 172.21.15.102:0/848890879 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1c180ced10 0x7f1c1809b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.145+0000 7f1c1659c700 1 -- 172.21.15.102:0/848890879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c181591e0 msgr2=0x7f1c180c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.145+0000 7f1c1659c700 1 --2- 172.21.15.102:0/848890879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c181591e0 0x7f1c180c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.145+0000 7f1c1659c700 1 -- 172.21.15.102:0/848890879 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c000094f0 con 0x7f1c180cd080 2024-08-17T02:26:24.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.145+0000 7f1c15d9b700 1 --2- 172.21.15.102:0/848890879 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1c180ced10 0x7f1c1809b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:24.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.145+0000 7f1c1659c700 1 --2- 172.21.15.102:0/848890879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c180cd080 0x7f1c18154740 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1c18089370 tx=0x7f1c00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.145+0000 7f1c0e7fc700 1 -- 172.21.15.102:0/848890879 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00024440 con 0x7f1c180cd080 2024-08-17T02:26:24.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.145+0000 7f1c0e7fc700 1 -- 172.21.15.102:0/848890879 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c000245a0 con 0x7f1c180cd080 2024-08-17T02:26:24.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.145+0000 7f1c1cf5f700 1 -- 172.21.15.102:0/848890879 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c180c8550 con 0x7f1c180cd080 2024-08-17T02:26:24.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.145+0000 7f1c0e7fc700 1 -- 172.21.15.102:0/848890879 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00024960 con 0x7f1c180cd080 2024-08-17T02:26:24.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.145+0000 7f1c1cf5f700 1 -- 172.21.15.102:0/848890879 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c180c8ad0 con 0x7f1c180cd080 2024-08-17T02:26:24.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.145+0000 7f1c1cf5f700 1 -- 172.21.15.102:0/848890879 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c180645c0 con 0x7f1c180cd080 2024-08-17T02:26:24.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.149+0000 7f1c0e7fc700 1 -- 172.21.15.102:0/848890879 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1c0001a420 con 0x7f1c180cd080 2024-08-17T02:26:24.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.149+0000 7f1c0e7fc700 1 --2- 172.21.15.102:0/848890879 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1bf8060890 0x7f1bf8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.149+0000 7f1c0e7fc700 1 -- 172.21.15.102:0/848890879 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c0007ea00 con 0x7f1c180cd080 2024-08-17T02:26:24.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.149+0000 7f1c15d9b700 1 --2- 172.21.15.102:0/848890879 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1bf8060890 0x7f1bf8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.149+0000 7f1c15d9b700 1 --2- 172.21.15.102:0/848890879 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1bf8060890 0x7f1bf8062d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1c180b2890 tx=0x7f1c08009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.157+0000 7f1c0e7fc700 1 -- 172.21.15.102:0/848890879 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1c0004eed0 con 0x7f1c180cd080 2024-08-17T02:26:24.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.321+0000 7f1c1cf5f700 1 -- 172.21.15.102:0/848890879 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1c18156dd0 con 0x7f1c180cd080 2024-08-17T02:26:24.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.321+0000 7f1c0e7fc700 1 -- 172.21.15.102:0/848890879 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1c000524f0 con 0x7f1c180cd080 2024-08-17T02:26:24.323 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-08-17T02:26:24.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.321+0000 7f1c1cf5f700 1 -- 172.21.15.102:0/848890879 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1bf8060890 msgr2=0x7f1bf8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.321+0000 7f1c1cf5f700 1 --2- 172.21.15.102:0/848890879 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1bf8060890 0x7f1bf8062d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1c180b2890 tx=0x7f1c08009040 comp rx=0 tx=0).stop 2024-08-17T02:26:24.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.321+0000 7f1c1cf5f700 1 -- 172.21.15.102:0/848890879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c180cd080 msgr2=0x7f1c18154740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.321+0000 7f1c1cf5f700 1 --2- 172.21.15.102:0/848890879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c180cd080 0x7f1c18154740 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1c18089370 tx=0x7f1c00017000 comp rx=0 tx=0).stop 2024-08-17T02:26:24.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.321+0000 7f1c1cf5f700 1 -- 172.21.15.102:0/848890879 shutdown_connections 2024-08-17T02:26:24.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.321+0000 7f1c1cf5f700 1 --2- 172.21.15.102:0/848890879 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1bf8060890 0x7f1bf8062d40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.321+0000 7f1c1cf5f700 1 --2- 172.21.15.102:0/848890879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c181591e0 0x7f1c180c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.321+0000 7f1c1cf5f700 1 --2- 172.21.15.102:0/848890879 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1c180ced10 0x7f1c1809b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.321+0000 7f1c1cf5f700 1 --2- 172.21.15.102:0/848890879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c180cd080 0x7f1c18154740 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.325+0000 7f1c1cf5f700 1 -- 172.21.15.102:0/848890879 >> 172.21.15.102:0/848890879 conn(0x7f1c18089bc0 msgr2=0x7f1c18156220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.325+0000 7f1c1cf5f700 1 -- 172.21.15.102:0/848890879 shutdown_connections 2024-08-17T02:26:24.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.325+0000 7f1c1cf5f700 1 -- 172.21.15.102:0/848890879 wait complete. 2024-08-17T02:26:24.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:24.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca91f700 1 Processor -- start 2024-08-17T02:26:24.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca91f700 1 -- start start 2024-08-17T02:26:24.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca91f700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd5c4142d40 0x7fd5c40b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca91f700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c4140f70 con 0x7fd5c40af190 2024-08-17T02:26:24.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca91f700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c4141250 con 0x7fd5c406e470 2024-08-17T02:26:24.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca91f700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c4141530 con 0x7fd5c4142d40 2024-08-17T02:26:24.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5c911c700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd5c40af190 0x7fd5c40b0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60060/0 (socket says 172.21.15.102:60060) 2024-08-17T02:26:24.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5c911c700 1 -- 172.21.15.102:0/273283473 learned_addr learned my addr 172.21.15.102:0/273283473 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:24.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca11e700 1 --2- 172.21.15.102:0/273283473 >> v2:172.21.15.102:3300/0 conn(0x7fd5c4142d40 0x7fd5c40b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5c891b700 1 -- 172.21.15.102:0/273283473 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228158121 0 0) 0x7fd5c4140f70 con 0x7fd5c40af190 2024-08-17T02:26:24.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5c891b700 1 -- 172.21.15.102:0/273283473 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5b0003570 con 0x7fd5c40af190 2024-08-17T02:26:24.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca11e700 1 -- 172.21.15.102:0/273283473 >> v1:172.21.15.121:6789/0 conn(0x7fd5c406e470 legacy=0x7fd5c40aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca11e700 1 -- 172.21.15.102:0/273283473 >> v1:172.21.15.102:6789/0 conn(0x7fd5c40af190 legacy=0x7fd5c40b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca11e700 1 -- 172.21.15.102:0/273283473 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c4141810 con 0x7fd5c4142d40 2024-08-17T02:26:24.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca11e700 1 --2- 172.21.15.102:0/273283473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5c4142d40 0x7fd5c40b1600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0098e0 tx=0x7fd5bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508c740127f76482 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5c891b700 1 -- 172.21.15.102:0/273283473 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00b640 con 0x7fd5c4142d40 2024-08-17T02:26:24.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5c891b700 1 -- 172.21.15.102:0/273283473 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc00b7a0 con 0x7fd5c4142d40 2024-08-17T02:26:24.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5c891b700 1 -- 172.21.15.102:0/273283473 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00bb40 con 0x7fd5c4142d40 2024-08-17T02:26:24.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca91f700 1 -- 172.21.15.102:0/273283473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5c4142d40 msgr2=0x7fd5c40b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca91f700 1 --2- 172.21.15.102:0/273283473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5c4142d40 0x7fd5c40b1600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0098e0 tx=0x7fd5bc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca91f700 1 -- 172.21.15.102:0/273283473 shutdown_connections 2024-08-17T02:26:24.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca91f700 1 --2- 172.21.15.102:0/273283473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5c4142d40 0x7fd5c40b1600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca91f700 1 -- 172.21.15.102:0/273283473 >> 172.21.15.102:0/273283473 conn(0x7fd5c40678a0 msgr2=0x7fd5c4067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca91f700 1 -- 172.21.15.102:0/273283473 shutdown_connections 2024-08-17T02:26:24.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.449+0000 7fd5ca91f700 1 -- 172.21.15.102:0/273283473 wait complete. 2024-08-17T02:26:24.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.453+0000 7fd5ca91f700 1 Processor -- start 2024-08-17T02:26:24.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.453+0000 7fd5ca91f700 1 -- start start 2024-08-17T02:26:24.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.453+0000 7fd5ca91f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5c406e470 0x7fd5c40c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.453+0000 7fd5ca91f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5c40af190 0x7fd5c415c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.453+0000 7fd5ca91f700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5c4142d40 0x7fd5c416d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.453+0000 7fd5ca91f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c40c29c0 con 0x7fd5c40af190 2024-08-17T02:26:24.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.453+0000 7fd5ca91f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c40c2c30 con 0x7fd5c406e470 2024-08-17T02:26:24.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.453+0000 7fd5ca91f700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c416df00 con 0x7fd5c4142d40 2024-08-17T02:26:24.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.453+0000 7fd5c911c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5c40af190 0x7fd5c415c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.453+0000 7fd5c911c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5c40af190 0x7fd5c415c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43572/0 (socket says 172.21.15.102:43572) 2024-08-17T02:26:24.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.453+0000 7fd5c911c700 1 -- 172.21.15.102:0/1956652544 learned_addr learned my addr 172.21.15.102:0/1956652544 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:24.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.453+0000 7fd5c991d700 1 --2- 172.21.15.102:0/1956652544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5c406e470 0x7fd5c40c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.453+0000 7fd5ca11e700 1 --2- 172.21.15.102:0/1956652544 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5c4142d40 0x7fd5c416d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.457+0000 7fd5c911c700 1 -- 172.21.15.102:0/1956652544 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5c4142d40 msgr2=0x7fd5c416d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.457+0000 7fd5c911c700 1 --2- 172.21.15.102:0/1956652544 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5c4142d40 0x7fd5c416d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.457+0000 7fd5c911c700 1 -- 172.21.15.102:0/1956652544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5c406e470 msgr2=0x7fd5c40c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.457+0000 7fd5c911c700 1 --2- 172.21.15.102:0/1956652544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5c406e470 0x7fd5c40c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.457+0000 7fd5c911c700 1 -- 172.21.15.102:0/1956652544 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc009420 con 0x7fd5c40af190 2024-08-17T02:26:24.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.457+0000 7fd5c911c700 1 --2- 172.21.15.102:0/1956652544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5c40af190 0x7fd5c415c2a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000cc70 tx=0x7fd5c0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.457+0000 7fd5b9ffb700 1 -- 172.21.15.102:0/1956652544 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c000a830 con 0x7fd5c40af190 2024-08-17T02:26:24.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.457+0000 7fd5b9ffb700 1 -- 172.21.15.102:0/1956652544 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c000a9b0 con 0x7fd5c40af190 2024-08-17T02:26:24.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.457+0000 7fd5ca91f700 1 -- 172.21.15.102:0/1956652544 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c416e1e0 con 0x7fd5c40af190 2024-08-17T02:26:24.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.457+0000 7fd5b9ffb700 1 -- 172.21.15.102:0/1956652544 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c000ad70 con 0x7fd5c40af190 2024-08-17T02:26:24.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.457+0000 7fd5ca91f700 1 -- 172.21.15.102:0/1956652544 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c416dc10 con 0x7fd5c40af190 2024-08-17T02:26:24.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.457+0000 7fd5ca91f700 1 -- 172.21.15.102:0/1956652544 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c416e6e0 con 0x7fd5c40af190 2024-08-17T02:26:24.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.457+0000 7fd5b9ffb700 1 -- 172.21.15.102:0/1956652544 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd5c0007300 con 0x7fd5c40af190 2024-08-17T02:26:24.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.461+0000 7fd5b9ffb700 1 --2- 172.21.15.102:0/1956652544 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd5a8060860 0x7fd5a8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.461+0000 7fd5c991d700 1 --2- 172.21.15.102:0/1956652544 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd5a8060860 0x7fd5a8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.461+0000 7fd5b9ffb700 1 -- 172.21.15.102:0/1956652544 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5c007cf50 con 0x7fd5c40af190 2024-08-17T02:26:24.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.461+0000 7fd5c991d700 1 --2- 172.21.15.102:0/1956652544 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd5a8060860 0x7fd5a8062d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40c24c0 tx=0x7fd5b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.465+0000 7fd5b9ffb700 1 -- 172.21.15.102:0/1956652544 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd5c004d3a0 con 0x7fd5c40af190 2024-08-17T02:26:24.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.629+0000 7fd5ca91f700 1 -- 172.21.15.102:0/1956652544 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5c4064330 con 0x7fd5c40af190 2024-08-17T02:26:24.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.629+0000 7fd5b9ffb700 1 -- 172.21.15.102:0/1956652544 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd5c00509c0 con 0x7fd5c40af190 2024-08-17T02:26:24.633 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-08-17T02:26:24.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.633+0000 7fd5ca91f700 1 -- 172.21.15.102:0/1956652544 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd5a8060860 msgr2=0x7fd5a8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.633+0000 7fd5ca91f700 1 --2- 172.21.15.102:0/1956652544 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd5a8060860 0x7fd5a8062d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40c24c0 tx=0x7fd5b4009040 comp rx=0 tx=0).stop 2024-08-17T02:26:24.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.633+0000 7fd5ca91f700 1 -- 172.21.15.102:0/1956652544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5c40af190 msgr2=0x7fd5c415c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.633+0000 7fd5ca91f700 1 --2- 172.21.15.102:0/1956652544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5c40af190 0x7fd5c415c2a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000cc70 tx=0x7fd5c0001a40 comp rx=0 tx=0).stop 2024-08-17T02:26:24.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.633+0000 7fd5ca91f700 1 -- 172.21.15.102:0/1956652544 shutdown_connections 2024-08-17T02:26:24.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.633+0000 7fd5ca91f700 1 --2- 172.21.15.102:0/1956652544 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd5a8060860 0x7fd5a8062d10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.633+0000 7fd5ca91f700 1 --2- 172.21.15.102:0/1956652544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5c40af190 0x7fd5c415c2a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.633+0000 7fd5ca91f700 1 --2- 172.21.15.102:0/1956652544 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd5c4142d40 0x7fd5c416d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.633+0000 7fd5ca91f700 1 --2- 172.21.15.102:0/1956652544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5c406e470 0x7fd5c40c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.633+0000 7fd5ca91f700 1 -- 172.21.15.102:0/1956652544 >> 172.21.15.102:0/1956652544 conn(0x7fd5c40678a0 msgr2=0x7fd5c415d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.633+0000 7fd5ca91f700 1 -- 172.21.15.102:0/1956652544 shutdown_connections 2024-08-17T02:26:24.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.633+0000 7fd5ca91f700 1 -- 172.21.15.102:0/1956652544 wait complete. 2024-08-17T02:26:24.647 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:24.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.749+0000 7fe3daa5e700 1 Processor -- start 2024-08-17T02:26:24.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.749+0000 7fe3daa5e700 1 -- start start 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3daa5e700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe3d4154900 0x7fe3d40b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3daa5e700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d40b1730 con 0x7fe3d40b12d0 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3daa5e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d40cbaa0 con 0x7fe3d40cb560 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3daa5e700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d4068790 con 0x7fe3d4154900 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3d925b700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe3d40b12d0 0x7fe3d40cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60070/0 (socket says 172.21.15.102:60070) 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3d925b700 1 -- 172.21.15.102:0/3045227689 learned_addr learned my addr 172.21.15.102:0/3045227689 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:24.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3d9a5c700 1 --2- 172.21.15.102:0/3045227689 >> v2:172.21.15.102:3300/0 conn(0x7fe3d4154900 0x7fe3d40b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3d8a5a700 1 -- 172.21.15.102:0/3045227689 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983020716 0 0) 0x7fe3d0001110 con 0x7fe3d40b12d0 2024-08-17T02:26:24.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3d8a5a700 1 -- 172.21.15.102:0/3045227689 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3bc003570 con 0x7fe3d40b12d0 2024-08-17T02:26:24.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3d8a5a700 1 -- 172.21.15.102:0/3045227689 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663056568 0 0) 0x7fe3d40cbaa0 con 0x7fe3d40cb560 2024-08-17T02:26:24.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3d8a5a700 1 -- 172.21.15.102:0/3045227689 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3d0001110 con 0x7fe3d40cb560 2024-08-17T02:26:24.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3d9a5c700 1 -- 172.21.15.102:0/3045227689 >> v1:172.21.15.121:6789/0 conn(0x7fe3d40cb560 legacy=0x7fe3d4160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3d9a5c700 1 -- 172.21.15.102:0/3045227689 >> v1:172.21.15.102:6789/0 conn(0x7fe3d40b12d0 legacy=0x7fe3d40cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3d9a5c700 1 -- 172.21.15.102:0/3045227689 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d4157630 con 0x7fe3d4154900 2024-08-17T02:26:24.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3d9a5c700 1 --2- 172.21.15.102:0/3045227689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3d4154900 0x7fe3d40b0d90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009e60 tx=0x7fe3cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2929d12e4c21aed1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3d8a5a700 1 -- 172.21.15.102:0/3045227689 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00e070 con 0x7fe3d4154900 2024-08-17T02:26:24.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3d8a5a700 1 -- 172.21.15.102:0/3045227689 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc00bab0 con 0x7fe3d4154900 2024-08-17T02:26:24.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3d8a5a700 1 -- 172.21.15.102:0/3045227689 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00be30 con 0x7fe3d4154900 2024-08-17T02:26:24.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3daa5e700 1 -- 172.21.15.102:0/3045227689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3d4154900 msgr2=0x7fe3d40b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3daa5e700 1 --2- 172.21.15.102:0/3045227689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3d4154900 0x7fe3d40b0d90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009e60 tx=0x7fe3cc009780 comp rx=0 tx=0).stop 2024-08-17T02:26:24.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3daa5e700 1 -- 172.21.15.102:0/3045227689 shutdown_connections 2024-08-17T02:26:24.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3daa5e700 1 --2- 172.21.15.102:0/3045227689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3d4154900 0x7fe3d40b0d90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3daa5e700 1 -- 172.21.15.102:0/3045227689 >> 172.21.15.102:0/3045227689 conn(0x7fe3d40678d0 msgr2=0x7fe3d4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3daa5e700 1 -- 172.21.15.102:0/3045227689 shutdown_connections 2024-08-17T02:26:24.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.753+0000 7fe3daa5e700 1 -- 172.21.15.102:0/3045227689 wait complete. 2024-08-17T02:26:24.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3daa5e700 1 Processor -- start 2024-08-17T02:26:24.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3daa5e700 1 -- start start 2024-08-17T02:26:24.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3daa5e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3d40b12d0 0x7fe3d4167bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3daa5e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3d40cb560 0x7fe3d40c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3daa5e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe3d4154900 0x7fe3d40aa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3daa5e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d4167740 con 0x7fe3d40b12d0 2024-08-17T02:26:24.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3daa5e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40c7850 con 0x7fe3d40cb560 2024-08-17T02:26:24.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3daa5e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40ab160 con 0x7fe3d4154900 2024-08-17T02:26:24.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3d9a5c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3d40b12d0 0x7fe3d4167bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3d9a5c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3d40b12d0 0x7fe3d4167bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43596/0 (socket says 172.21.15.102:43596) 2024-08-17T02:26:24.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3d9a5c700 1 -- 172.21.15.102:0/3849198864 learned_addr learned my addr 172.21.15.102:0/3849198864 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:24.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3d925b700 1 --2- 172.21.15.102:0/3849198864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3d40cb560 0x7fe3d40c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3da25d700 1 --2- 172.21.15.102:0/3849198864 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe3d4154900 0x7fe3d40aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3d9a5c700 1 -- 172.21.15.102:0/3849198864 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe3d4154900 msgr2=0x7fe3d40aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3d9a5c700 1 --2- 172.21.15.102:0/3849198864 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe3d4154900 0x7fe3d40aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3d9a5c700 1 -- 172.21.15.102:0/3849198864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3d40cb560 msgr2=0x7fe3d40c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3d9a5c700 1 --2- 172.21.15.102:0/3849198864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3d40cb560 0x7fe3d40c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3d9a5c700 1 -- 172.21.15.102:0/3849198864 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc009a20 con 0x7fe3d40b12d0 2024-08-17T02:26:24.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3d9a5c700 1 --2- 172.21.15.102:0/3849198864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3d40b12d0 0x7fe3d4167bd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009460 tx=0x7fe3cc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3c9ffb700 1 -- 172.21.15.102:0/3849198864 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc001010 con 0x7fe3d40b12d0 2024-08-17T02:26:24.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3c9ffb700 1 -- 172.21.15.102:0/3849198864 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc012d40 con 0x7fe3d40b12d0 2024-08-17T02:26:24.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3daa5e700 1 -- 172.21.15.102:0/3849198864 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d40ab440 con 0x7fe3d40b12d0 2024-08-17T02:26:24.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3c9ffb700 1 -- 172.21.15.102:0/3849198864 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc0276c0 con 0x7fe3d40b12d0 2024-08-17T02:26:24.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.757+0000 7fe3daa5e700 1 -- 172.21.15.102:0/3849198864 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d41673d0 con 0x7fe3d40b12d0 2024-08-17T02:26:24.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.761+0000 7fe3c9ffb700 1 -- 172.21.15.102:0/3849198864 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe3cc024070 con 0x7fe3d40b12d0 2024-08-17T02:26:24.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.761+0000 7fe3daa5e700 1 -- 172.21.15.102:0/3849198864 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d40643a0 con 0x7fe3d40b12d0 2024-08-17T02:26:24.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.761+0000 7fe3c9ffb700 1 --2- 172.21.15.102:0/3849198864 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe3c0060860 0x7fe3c0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:24.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.761+0000 7fe3c9ffb700 1 -- 172.21.15.102:0/3849198864 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3cc07f160 con 0x7fe3d40b12d0 2024-08-17T02:26:24.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.761+0000 7fe3d925b700 1 --2- 172.21.15.102:0/3849198864 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe3c0060860 0x7fe3c0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:24.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.761+0000 7fe3d925b700 1 --2- 172.21.15.102:0/3849198864 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe3c0060860 0x7fe3c0062d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40c9120 tx=0x7fe3d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:24.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.769+0000 7fe3c9ffb700 1 -- 172.21.15.102:0/3849198864 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe3cc04f510 con 0x7fe3d40b12d0 2024-08-17T02:26:24.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.929+0000 7fe3daa5e700 1 -- 172.21.15.102:0/3849198864 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3d406f5f0 con 0x7fe3d40b12d0 2024-08-17T02:26:24.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.929+0000 7fe3c9ffb700 1 -- 172.21.15.102:0/3849198864 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fe3cc052b30 con 0x7fe3d40b12d0 2024-08-17T02:26:24.932 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:24.933 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:57.002263+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:53.562223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:54.343618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:24.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.933+0000 7fe3daa5e700 1 -- 172.21.15.102:0/3849198864 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe3c0060860 msgr2=0x7fe3c0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.933+0000 7fe3daa5e700 1 --2- 172.21.15.102:0/3849198864 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe3c0060860 0x7fe3c0062d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40c9120 tx=0x7fe3d0009040 comp rx=0 tx=0).stop 2024-08-17T02:26:24.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.933+0000 7fe3daa5e700 1 -- 172.21.15.102:0/3849198864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3d40b12d0 msgr2=0x7fe3d4167bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.933+0000 7fe3daa5e700 1 --2- 172.21.15.102:0/3849198864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3d40b12d0 0x7fe3d4167bd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009460 tx=0x7fe3cc019000 comp rx=0 tx=0).stop 2024-08-17T02:26:24.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.933+0000 7fe3daa5e700 1 -- 172.21.15.102:0/3849198864 shutdown_connections 2024-08-17T02:26:24.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.933+0000 7fe3daa5e700 1 --2- 172.21.15.102:0/3849198864 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe3c0060860 0x7fe3c0062d10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.933+0000 7fe3daa5e700 1 --2- 172.21.15.102:0/3849198864 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe3d4154900 0x7fe3d40aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.933+0000 7fe3daa5e700 1 --2- 172.21.15.102:0/3849198864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3d40cb560 0x7fe3d40c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.933+0000 7fe3daa5e700 1 --2- 172.21.15.102:0/3849198864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3d40b12d0 0x7fe3d4167bd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.933+0000 7fe3daa5e700 1 -- 172.21.15.102:0/3849198864 >> 172.21.15.102:0/3849198864 conn(0x7fe3d40678d0 msgr2=0x7fe3d406d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.933+0000 7fe3daa5e700 1 -- 172.21.15.102:0/3849198864 shutdown_connections 2024-08-17T02:26:24.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:24.933+0000 7fe3daa5e700 1 -- 172.21.15.102:0/3849198864 wait complete. 2024-08-17T02:26:24.947 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:49.236728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:53.562223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:54.343618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:24.948 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:25.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.061+0000 7f6094fb3700 1 Processor -- start 2024-08-17T02:26:25.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.061+0000 7f6094fb3700 1 -- start start 2024-08-17T02:26:25.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.061+0000 7f6094fb3700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f60900cfb00 0x7f6090067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.061+0000 7f6094fb3700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60900cf670 con 0x7f6090067030 2024-08-17T02:26:25.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.061+0000 7f6094fb3700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60900cea60 con 0x7f6090158cc0 2024-08-17T02:26:25.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.061+0000 7f6094fb3700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60900ced40 con 0x7f60900cfb00 2024-08-17T02:26:25.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f608effd700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f60900cfb00 0x7f6090067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:25.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f608f7fe700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f6090067030 0x7f60900cb080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60076/0 (socket says 172.21.15.102:60076) 2024-08-17T02:26:25.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f608f7fe700 1 -- 172.21.15.102:0/1826391618 learned_addr learned my addr 172.21.15.102:0/1826391618 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:25.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f608effd700 1 -- 172.21.15.102:0/1826391618 >> v1:172.21.15.121:6789/0 conn(0x7f6090158cc0 legacy=0x7f60901590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f608effd700 1 -- 172.21.15.102:0/1826391618 >> v1:172.21.15.102:6789/0 conn(0x7f6090067030 legacy=0x7f60900cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f608effd700 1 -- 172.21.15.102:0/1826391618 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60900cf020 con 0x7f60900cfb00 2024-08-17T02:26:25.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f608e7fc700 1 -- 172.21.15.102:0/1826391618 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374363857 0 0) 0x7f60900cf670 con 0x7f6090067030 2024-08-17T02:26:25.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f608effd700 1 --2- 172.21.15.102:0/1826391618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60900cfb00 0x7f6090067400 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f60800098e0 tx=0x7f60800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0727ba6f66aa3b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:25.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f608e7fc700 1 -- 172.21.15.102:0/1826391618 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080009e80 con 0x7f60900cfb00 2024-08-17T02:26:25.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f608e7fc700 1 -- 172.21.15.102:0/1826391618 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608000b860 con 0x7f60900cfb00 2024-08-17T02:26:25.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f608e7fc700 1 -- 172.21.15.102:0/1826391618 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608000bbe0 con 0x7f60900cfb00 2024-08-17T02:26:25.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f6094fb3700 1 -- 172.21.15.102:0/1826391618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60900cfb00 msgr2=0x7f6090067400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f6094fb3700 1 --2- 172.21.15.102:0/1826391618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60900cfb00 0x7f6090067400 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f60800098e0 tx=0x7f60800091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f6094fb3700 1 -- 172.21.15.102:0/1826391618 shutdown_connections 2024-08-17T02:26:25.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f6094fb3700 1 --2- 172.21.15.102:0/1826391618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60900cfb00 0x7f6090067400 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f6094fb3700 1 -- 172.21.15.102:0/1826391618 >> 172.21.15.102:0/1826391618 conn(0x7f60900d0b50 msgr2=0x7f60900ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:25.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f6094fb3700 1 -- 172.21.15.102:0/1826391618 shutdown_connections 2024-08-17T02:26:25.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.065+0000 7f6094fb3700 1 -- 172.21.15.102:0/1826391618 wait complete. 2024-08-17T02:26:25.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f6094fb3700 1 Processor -- start 2024-08-17T02:26:25.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f6094fb3700 1 -- start start 2024-08-17T02:26:25.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f6094fb3700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6090067030 0x7f6090147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f6094fb3700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60900cfb00 0x7f60900b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f6094fb3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6090158cc0 0x7f60900b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f6094fb3700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609016a520 con 0x7f6090067030 2024-08-17T02:26:25.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f6094fb3700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6090169bf0 con 0x7f6090158cc0 2024-08-17T02:26:25.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f6094fb3700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6090169ed0 con 0x7f60900cfb00 2024-08-17T02:26:25.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f608f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6090067030 0x7f6090147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:25.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f608f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6090067030 0x7f6090147ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43620/0 (socket says 172.21.15.102:43620) 2024-08-17T02:26:25.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f608f7fe700 1 -- 172.21.15.102:0/1479760978 learned_addr learned my addr 172.21.15.102:0/1479760978 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:25.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f608f7fe700 1 -- 172.21.15.102:0/1479760978 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60900cfb00 msgr2=0x7f60900b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f608f7fe700 1 --2- 172.21.15.102:0/1479760978 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60900cfb00 0x7f60900b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f608f7fe700 1 -- 172.21.15.102:0/1479760978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6090158cc0 msgr2=0x7f60900b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f608f7fe700 1 --2- 172.21.15.102:0/1479760978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6090158cc0 0x7f60900b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f608f7fe700 1 -- 172.21.15.102:0/1479760978 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6080009420 con 0x7f6090067030 2024-08-17T02:26:25.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f608f7fe700 1 --2- 172.21.15.102:0/1479760978 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6090067030 0x7f6090147ad0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f608400c810 tx=0x7f6084007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:25.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f60777fe700 1 -- 172.21.15.102:0/1479760978 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084005c00 con 0x7f6090067030 2024-08-17T02:26:25.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f60777fe700 1 -- 172.21.15.102:0/1479760978 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6084005d60 con 0x7f6090067030 2024-08-17T02:26:25.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f6094fb3700 1 -- 172.21.15.102:0/1479760978 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609016a1b0 con 0x7f6090067030 2024-08-17T02:26:25.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f60777fe700 1 -- 172.21.15.102:0/1479760978 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084007340 con 0x7f6090067030 2024-08-17T02:26:25.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.069+0000 7f6094fb3700 1 -- 172.21.15.102:0/1479760978 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6090148010 con 0x7f6090067030 2024-08-17T02:26:25.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.073+0000 7f6094fb3700 1 -- 172.21.15.102:0/1479760978 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60900638f0 con 0x7f6090067030 2024-08-17T02:26:25.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.073+0000 7f60777fe700 1 -- 172.21.15.102:0/1479760978 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f608401b400 con 0x7f6090067030 2024-08-17T02:26:25.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.073+0000 7f60777fe700 1 --2- 172.21.15.102:0/1479760978 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f607c060860 0x7f607c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.073+0000 7f60777fe700 1 -- 172.21.15.102:0/1479760978 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f608407c660 con 0x7f6090067030 2024-08-17T02:26:25.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.073+0000 7f608effd700 1 --2- 172.21.15.102:0/1479760978 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f607c060860 0x7f607c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:25.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.073+0000 7f608effd700 1 --2- 172.21.15.102:0/1479760978 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f607c060860 0x7f607c062d10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f60900ca2f0 tx=0x7f6080017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:25.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.081+0000 7f60777fe700 1 -- 172.21.15.102:0/1479760978 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f608404cb30 con 0x7f6090067030 2024-08-17T02:26:25.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.241+0000 7f6094fb3700 1 -- 172.21.15.102:0/1479760978 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60900ccc30 con 0x7f6090067030 2024-08-17T02:26:25.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.241+0000 7f60777fe700 1 -- 172.21.15.102:0/1479760978 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6084050150 con 0x7f6090067030 2024-08-17T02:26:25.244 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-08-17T02:26:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.245+0000 7f6094fb3700 1 -- 172.21.15.102:0/1479760978 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f607c060860 msgr2=0x7f607c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.245+0000 7f6094fb3700 1 --2- 172.21.15.102:0/1479760978 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f607c060860 0x7f607c062d10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f60900ca2f0 tx=0x7f6080017000 comp rx=0 tx=0).stop 2024-08-17T02:26:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.245+0000 7f6094fb3700 1 -- 172.21.15.102:0/1479760978 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6090067030 msgr2=0x7f6090147ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.245+0000 7f6094fb3700 1 --2- 172.21.15.102:0/1479760978 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6090067030 0x7f6090147ad0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f608400c810 tx=0x7f6084007d90 comp rx=0 tx=0).stop 2024-08-17T02:26:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.245+0000 7f6094fb3700 1 -- 172.21.15.102:0/1479760978 shutdown_connections 2024-08-17T02:26:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.245+0000 7f6094fb3700 1 --2- 172.21.15.102:0/1479760978 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f607c060860 0x7f607c062d10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.245+0000 7f6094fb3700 1 --2- 172.21.15.102:0/1479760978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6090158cc0 0x7f60900b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.245+0000 7f6094fb3700 1 --2- 172.21.15.102:0/1479760978 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f60900cfb00 0x7f60900b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.245+0000 7f6094fb3700 1 --2- 172.21.15.102:0/1479760978 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6090067030 0x7f6090147ad0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.245+0000 7f6094fb3700 1 -- 172.21.15.102:0/1479760978 >> 172.21.15.102:0/1479760978 conn(0x7f60900d0b50 msgr2=0x7f60900b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:25.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.245+0000 7f6094fb3700 1 -- 172.21.15.102:0/1479760978 shutdown_connections 2024-08-17T02:26:25.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.245+0000 7f6094fb3700 1 -- 172.21.15.102:0/1479760978 wait complete. 2024-08-17T02:26:25.258 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:25.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.365+0000 7f23fe85c700 1 Processor -- start 2024-08-17T02:26:25.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.365+0000 7f23fe85c700 1 -- start start 2024-08-17T02:26:25.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23fe85c700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f23f80cd5a0 0x7f23f80ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23fe85c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f23f80c6520 0x7f23f80cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23fe85c700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f80cca00 con 0x7f23f815cb60 2024-08-17T02:26:25.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23fe85c700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f80b2e80 con 0x7f23f80cd5a0 2024-08-17T02:26:25.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23fe85c700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f815cf30 con 0x7f23f80c6520 2024-08-17T02:26:25.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23f77fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f23f80cd5a0 0x7f23f80ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:25.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23f77fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f23f80cd5a0 0x7f23f80ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43632/0 (socket says 172.21.15.102:43632) 2024-08-17T02:26:25.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23f77fe700 1 -- 172.21.15.102:0/1158887764 learned_addr learned my addr 172.21.15.102:0/1158887764 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:25.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23fcdf9700 1 --2- 172.21.15.102:0/1158887764 >> v2:172.21.15.121:3300/0 conn(0x7f23f80c6520 0x7f23f80cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:25.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23f77fe700 1 -- 172.21.15.102:0/1158887764 >> v2:172.21.15.121:3300/0 conn(0x7f23f80c6520 msgr2=0x7f23f80cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:25.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23f77fe700 1 --2- 172.21.15.102:0/1158887764 >> v2:172.21.15.121:3300/0 conn(0x7f23f80c6520 0x7f23f80cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23f77fe700 1 -- 172.21.15.102:0/1158887764 >> v1:172.21.15.121:6789/0 conn(0x7f23f815cb60 legacy=0x7f23f80cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23f77fe700 1 -- 172.21.15.102:0/1158887764 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f80cbb50 con 0x7f23f80cd5a0 2024-08-17T02:26:25.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23fcdf9700 1 --2- 172.21.15.102:0/1158887764 >> v2:172.21.15.121:3300/0 conn(0x7f23f80c6520 0x7f23f80cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:25.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23f77fe700 1 --2- 172.21.15.102:0/1158887764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23f80cd5a0 0x7f23f80ceae0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f23f8089a10 tx=0x7f23e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f00832ef947bc82 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:25.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23f6ffd700 1 -- 172.21.15.102:0/1158887764 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e800b860 con 0x7f23f80cd5a0 2024-08-17T02:26:25.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23f6ffd700 1 -- 172.21.15.102:0/1158887764 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e800b9c0 con 0x7f23f80cd5a0 2024-08-17T02:26:25.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23f6ffd700 1 -- 172.21.15.102:0/1158887764 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e800bd60 con 0x7f23f80cd5a0 2024-08-17T02:26:25.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23fe85c700 1 -- 172.21.15.102:0/1158887764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23f80cd5a0 msgr2=0x7f23f80ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23fe85c700 1 --2- 172.21.15.102:0/1158887764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23f80cd5a0 0x7f23f80ceae0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f23f8089a10 tx=0x7f23e8009250 comp rx=0 tx=0).stop 2024-08-17T02:26:25.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23fe85c700 1 -- 172.21.15.102:0/1158887764 shutdown_connections 2024-08-17T02:26:25.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23fe85c700 1 --2- 172.21.15.102:0/1158887764 >> v2:172.21.15.121:3300/0 conn(0x7f23f80c6520 0x7f23f80cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23fe85c700 1 --2- 172.21.15.102:0/1158887764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23f80cd5a0 0x7f23f80ceae0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23fe85c700 1 -- 172.21.15.102:0/1158887764 >> 172.21.15.102:0/1158887764 conn(0x7f23f80996d0 msgr2=0x7f23f80675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:25.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23fe85c700 1 -- 172.21.15.102:0/1158887764 shutdown_connections 2024-08-17T02:26:25.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.369+0000 7f23fe85c700 1 -- 172.21.15.102:0/1158887764 wait complete. 2024-08-17T02:26:25.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.373+0000 7f23fe85c700 1 Processor -- start 2024-08-17T02:26:25.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.373+0000 7f23fe85c700 1 -- start start 2024-08-17T02:26:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.373+0000 7f23fe85c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23f80c6520 0x7f23f80c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.373+0000 7f23fe85c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23f80cd5a0 0x7f23f80c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.373+0000 7f23fe85c700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f23f815cb60 0x7f23f80c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.373+0000 7f23fe85c700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80b5aa0 con 0x7f23f80cd5a0 2024-08-17T02:26:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.373+0000 7f23fe85c700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80b3be0 con 0x7f23f80c6520 2024-08-17T02:26:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.373+0000 7f23fe85c700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80b4710 con 0x7f23f815cb60 2024-08-17T02:26:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.373+0000 7f23f77fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23f80cd5a0 0x7f23f80c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23f77fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23f80cd5a0 0x7f23f80c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43638/0 (socket says 172.21.15.102:43638) 2024-08-17T02:26:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23f77fe700 1 -- 172.21.15.102:0/4232737082 learned_addr learned my addr 172.21.15.102:0/4232737082 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23f7fff700 1 --2- 172.21.15.102:0/4232737082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23f80c6520 0x7f23f80c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23fcdf9700 1 --2- 172.21.15.102:0/4232737082 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f23f815cb60 0x7f23f80c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23f77fe700 1 -- 172.21.15.102:0/4232737082 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f23f815cb60 msgr2=0x7f23f80c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23f77fe700 1 --2- 172.21.15.102:0/4232737082 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f23f815cb60 0x7f23f80c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23f77fe700 1 -- 172.21.15.102:0/4232737082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23f80c6520 msgr2=0x7f23f80c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23f77fe700 1 --2- 172.21.15.102:0/4232737082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23f80c6520 0x7f23f80c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23f77fe700 1 -- 172.21.15.102:0/4232737082 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e80094f0 con 0x7f23f80cd5a0 2024-08-17T02:26:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23f77fe700 1 --2- 172.21.15.102:0/4232737082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23f80cd5a0 0x7f23f80c7a80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009290 tx=0x7f23e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23dffff700 1 -- 172.21.15.102:0/4232737082 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e801a450 con 0x7f23f80cd5a0 2024-08-17T02:26:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23dffff700 1 -- 172.21.15.102:0/4232737082 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e801a5b0 con 0x7f23f80cd5a0 2024-08-17T02:26:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23fe85c700 1 -- 172.21.15.102:0/4232737082 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f80b4ba0 con 0x7f23f80cd5a0 2024-08-17T02:26:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23dffff700 1 -- 172.21.15.102:0/4232737082 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e801a970 con 0x7f23f80cd5a0 2024-08-17T02:26:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23fe85c700 1 -- 172.21.15.102:0/4232737082 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f80b40c0 con 0x7f23f80cd5a0 2024-08-17T02:26:25.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23fe85c700 1 -- 172.21.15.102:0/4232737082 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f80b48c0 con 0x7f23f80cd5a0 2024-08-17T02:26:25.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.377+0000 7f23dffff700 1 -- 172.21.15.102:0/4232737082 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f23e801ace0 con 0x7f23f80cd5a0 2024-08-17T02:26:25.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.381+0000 7f23dffff700 1 --2- 172.21.15.102:0/4232737082 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f23e4060860 0x7f23e4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.381+0000 7f23dffff700 1 -- 172.21.15.102:0/4232737082 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23e807e230 con 0x7f23f80cd5a0 2024-08-17T02:26:25.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.381+0000 7f23f7fff700 1 --2- 172.21.15.102:0/4232737082 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f23e4060860 0x7f23e4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:25.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.381+0000 7f23f7fff700 1 --2- 172.21.15.102:0/4232737082 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f23e4060860 0x7f23e4062d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f23f8068350 tx=0x7f23ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:25.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.385+0000 7f23dffff700 1 -- 172.21.15.102:0/4232737082 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f23f80b48c0 con 0x7f23f80cd5a0 2024-08-17T02:26:25.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.553+0000 7f23fe85c700 1 -- 172.21.15.102:0/4232737082 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f23f80b4880 con 0x7f23f80cd5a0 2024-08-17T02:26:25.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.553+0000 7f23dffff700 1 -- 172.21.15.102:0/4232737082 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f23e804e680 con 0x7f23f80cd5a0 2024-08-17T02:26:25.559 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-08-17T02:26:25.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.557+0000 7f23fe85c700 1 -- 172.21.15.102:0/4232737082 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f23e4060860 msgr2=0x7f23e4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.557+0000 7f23fe85c700 1 --2- 172.21.15.102:0/4232737082 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f23e4060860 0x7f23e4062d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f23f8068350 tx=0x7f23ec009040 comp rx=0 tx=0).stop 2024-08-17T02:26:25.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.557+0000 7f23fe85c700 1 -- 172.21.15.102:0/4232737082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23f80cd5a0 msgr2=0x7f23f80c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.557+0000 7f23fe85c700 1 --2- 172.21.15.102:0/4232737082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23f80cd5a0 0x7f23f80c7a80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009290 tx=0x7f23e8017000 comp rx=0 tx=0).stop 2024-08-17T02:26:25.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.557+0000 7f23fe85c700 1 -- 172.21.15.102:0/4232737082 shutdown_connections 2024-08-17T02:26:25.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.557+0000 7f23fe85c700 1 --2- 172.21.15.102:0/4232737082 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f23e4060860 0x7f23e4062d10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.557+0000 7f23fe85c700 1 --2- 172.21.15.102:0/4232737082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23f80cd5a0 0x7f23f80c7a80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.557+0000 7f23fe85c700 1 --2- 172.21.15.102:0/4232737082 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f23f815cb60 0x7f23f80c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.557+0000 7f23fe85c700 1 --2- 172.21.15.102:0/4232737082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23f80c6520 0x7f23f80c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.557+0000 7f23fe85c700 1 -- 172.21.15.102:0/4232737082 >> 172.21.15.102:0/4232737082 conn(0x7f23f80996d0 msgr2=0x7f23f80b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:25.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.557+0000 7f23fe85c700 1 -- 172.21.15.102:0/4232737082 shutdown_connections 2024-08-17T02:26:25.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.557+0000 7f23fe85c700 1 -- 172.21.15.102:0/4232737082 wait complete. 2024-08-17T02:26:25.571 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:25.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.681+0000 7fc5bed36700 1 Processor -- start 2024-08-17T02:26:25.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.681+0000 7fc5bed36700 1 -- start start 2024-08-17T02:26:25.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.681+0000 7fc5bed36700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc5b8159fb0 0x7fc5b815a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.681+0000 7fc5bed36700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5b8155820 0x7fc5b8155c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.681+0000 7fc5bed36700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b80ac7f0 con 0x7fc5b8159be0 2024-08-17T02:26:25.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.681+0000 7fc5bed36700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b80c8580 con 0x7fc5b8155820 2024-08-17T02:26:25.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.681+0000 7fc5bed36700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b80c8860 con 0x7fc5b8159fb0 2024-08-17T02:26:25.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.681+0000 7fc5be535700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5b8155820 0x7fc5b8155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:25.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.681+0000 7fc5bdd34700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc5b8159be0 0x7fc5b80c7dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60078/0 (socket says 172.21.15.102:60078) 2024-08-17T02:26:25.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.681+0000 7fc5bdd34700 1 -- 172.21.15.102:0/3609417745 learned_addr learned my addr 172.21.15.102:0/3609417745 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:25.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.681+0000 7fc5bd533700 1 --2- 172.21.15.102:0/3609417745 >> v2:172.21.15.121:3300/0 conn(0x7fc5b8159fb0 0x7fc5b815a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:25.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5bcd32700 1 -- 172.21.15.102:0/3609417745 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267351106 0 0) 0x7fc5b80ac7f0 con 0x7fc5b8159be0 2024-08-17T02:26:25.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5bcd32700 1 -- 172.21.15.102:0/3609417745 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5a4003570 con 0x7fc5b8159be0 2024-08-17T02:26:25.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5be535700 1 -- 172.21.15.102:0/3609417745 >> v2:172.21.15.121:3300/0 conn(0x7fc5b8159fb0 msgr2=0x7fc5b815a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:25.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5be535700 1 --2- 172.21.15.102:0/3609417745 >> v2:172.21.15.121:3300/0 conn(0x7fc5b8159fb0 0x7fc5b815a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5be535700 1 -- 172.21.15.102:0/3609417745 >> v1:172.21.15.102:6789/0 conn(0x7fc5b8159be0 legacy=0x7fc5b80c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5be535700 1 -- 172.21.15.102:0/3609417745 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b80c8b40 con 0x7fc5b8155820 2024-08-17T02:26:25.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5be535700 1 --2- 172.21.15.102:0/3609417745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5b8155820 0x7fc5b8155c30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8064c30 tx=0x7fc5b0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d17ace626525e09 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:25.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5bcd32700 1 -- 172.21.15.102:0/3609417745 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b000e070 con 0x7fc5b8155820 2024-08-17T02:26:25.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5bcd32700 1 -- 172.21.15.102:0/3609417745 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b000bab0 con 0x7fc5b8155820 2024-08-17T02:26:25.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5bcd32700 1 -- 172.21.15.102:0/3609417745 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b000be70 con 0x7fc5b8155820 2024-08-17T02:26:25.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5bed36700 1 -- 172.21.15.102:0/3609417745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5b8155820 msgr2=0x7fc5b8155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5bed36700 1 --2- 172.21.15.102:0/3609417745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5b8155820 0x7fc5b8155c30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8064c30 tx=0x7fc5b0009780 comp rx=0 tx=0).stop 2024-08-17T02:26:25.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5bed36700 1 -- 172.21.15.102:0/3609417745 shutdown_connections 2024-08-17T02:26:25.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5bed36700 1 --2- 172.21.15.102:0/3609417745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5b8155820 0x7fc5b8155c30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5bed36700 1 --2- 172.21.15.102:0/3609417745 >> v2:172.21.15.121:3300/0 conn(0x7fc5b8159fb0 0x7fc5b815a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5bed36700 1 -- 172.21.15.102:0/3609417745 >> 172.21.15.102:0/3609417745 conn(0x7fc5b80c9830 msgr2=0x7fc5b80c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:25.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5bed36700 1 -- 172.21.15.102:0/3609417745 shutdown_connections 2024-08-17T02:26:25.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5bed36700 1 -- 172.21.15.102:0/3609417745 wait complete. 2024-08-17T02:26:25.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5bed36700 1 Processor -- start 2024-08-17T02:26:25.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.685+0000 7fc5bed36700 1 -- start start 2024-08-17T02:26:25.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bed36700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5b8155820 0x7fc5b8153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bed36700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5b8159be0 0x7fc5b81683d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bed36700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5b8159fb0 0x7fc5b8158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bed36700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b8069360 con 0x7fc5b8159be0 2024-08-17T02:26:25.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bed36700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b8069ee0 con 0x7fc5b8159fb0 2024-08-17T02:26:25.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bed36700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b80695b0 con 0x7fc5b8155820 2024-08-17T02:26:25.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bd533700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5b8159be0 0x7fc5b81683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:25.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bd533700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5b8159be0 0x7fc5b81683d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43666/0 (socket says 172.21.15.102:43666) 2024-08-17T02:26:25.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bd533700 1 -- 172.21.15.102:0/1269467907 learned_addr learned my addr 172.21.15.102:0/1269467907 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:25.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bdd34700 1 --2- 172.21.15.102:0/1269467907 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5b8155820 0x7fc5b8153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:25.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5be535700 1 --2- 172.21.15.102:0/1269467907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5b8159fb0 0x7fc5b8158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:25.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bd533700 1 -- 172.21.15.102:0/1269467907 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5b8155820 msgr2=0x7fc5b8153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bd533700 1 --2- 172.21.15.102:0/1269467907 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5b8155820 0x7fc5b8153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bd533700 1 -- 172.21.15.102:0/1269467907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5b8159fb0 msgr2=0x7fc5b8158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bd533700 1 --2- 172.21.15.102:0/1269467907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5b8159fb0 0x7fc5b8158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bd533700 1 -- 172.21.15.102:0/1269467907 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b0009a20 con 0x7fc5b8159be0 2024-08-17T02:26:25.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bd533700 1 --2- 172.21.15.102:0/1269467907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5b8159be0 0x7fc5b81683d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800e960 tx=0x7fc5a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:25.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5adffb700 1 -- 172.21.15.102:0/1269467907 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8013680 con 0x7fc5b8159be0 2024-08-17T02:26:25.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5adffb700 1 -- 172.21.15.102:0/1269467907 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a80137e0 con 0x7fc5b8159be0 2024-08-17T02:26:25.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bed36700 1 -- 172.21.15.102:0/1269467907 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b8069890 con 0x7fc5b8159be0 2024-08-17T02:26:25.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5adffb700 1 -- 172.21.15.102:0/1269467907 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8013b80 con 0x7fc5b8159be0 2024-08-17T02:26:25.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.689+0000 7fc5bed36700 1 -- 172.21.15.102:0/1269467907 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b8153cb0 con 0x7fc5b8159be0 2024-08-17T02:26:25.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.693+0000 7fc5bed36700 1 -- 172.21.15.102:0/1269467907 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b80638f0 con 0x7fc5b8159be0 2024-08-17T02:26:25.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.693+0000 7fc5adffb700 1 -- 172.21.15.102:0/1269467907 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc5a80123d0 con 0x7fc5b8159be0 2024-08-17T02:26:25.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.693+0000 7fc5adffb700 1 --2- 172.21.15.102:0/1269467907 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc59c060860 0x7fc59c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:25.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.693+0000 7fc5adffb700 1 -- 172.21.15.102:0/1269467907 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5a807cc60 con 0x7fc5b8159be0 2024-08-17T02:26:25.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.693+0000 7fc5bdd34700 1 --2- 172.21.15.102:0/1269467907 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc59c060860 0x7fc59c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:25.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.693+0000 7fc5bdd34700 1 --2- 172.21.15.102:0/1269467907 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc59c060860 0x7fc59c062d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4007fd0 tx=0x7fc5b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:25.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.697+0000 7fc5adffb700 1 -- 172.21.15.102:0/1269467907 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc5a804d0b0 con 0x7fc5b8159be0 2024-08-17T02:26:25.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.861+0000 7fc5bed36700 1 -- 172.21.15.102:0/1269467907 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5b80b0190 con 0x7fc5b8159be0 2024-08-17T02:26:25.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.861+0000 7fc5adffb700 1 -- 172.21.15.102:0/1269467907 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5a80506d0 con 0x7fc5b8159be0 2024-08-17T02:26:25.862 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-08-17T02:26:25.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.861+0000 7fc5bed36700 1 -- 172.21.15.102:0/1269467907 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc59c060860 msgr2=0x7fc59c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.861+0000 7fc5bed36700 1 --2- 172.21.15.102:0/1269467907 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc59c060860 0x7fc59c062d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4007fd0 tx=0x7fc5b4009040 comp rx=0 tx=0).stop 2024-08-17T02:26:25.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.861+0000 7fc5bed36700 1 -- 172.21.15.102:0/1269467907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5b8159be0 msgr2=0x7fc5b81683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:25.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.861+0000 7fc5bed36700 1 --2- 172.21.15.102:0/1269467907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5b8159be0 0x7fc5b81683d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800e960 tx=0x7fc5a80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.861+0000 7fc5bed36700 1 -- 172.21.15.102:0/1269467907 shutdown_connections 2024-08-17T02:26:25.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.861+0000 7fc5bed36700 1 --2- 172.21.15.102:0/1269467907 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc59c060860 0x7fc59c062d10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.861+0000 7fc5bed36700 1 --2- 172.21.15.102:0/1269467907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5b8159be0 0x7fc5b81683d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.861+0000 7fc5bed36700 1 --2- 172.21.15.102:0/1269467907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5b8159fb0 0x7fc5b8158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.861+0000 7fc5bed36700 1 --2- 172.21.15.102:0/1269467907 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5b8155820 0x7fc5b8153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:25.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.861+0000 7fc5bed36700 1 -- 172.21.15.102:0/1269467907 >> 172.21.15.102:0/1269467907 conn(0x7fc5b80c9830 msgr2=0x7fc5b80cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:25.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.861+0000 7fc5bed36700 1 -- 172.21.15.102:0/1269467907 shutdown_connections 2024-08-17T02:26:25.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:25.861+0000 7fc5bed36700 1 -- 172.21.15.102:0/1269467907 wait complete. 2024-08-17T02:26:25.934 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:26:25.934 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:26:25.935 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:26.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.041+0000 7f61271b7700 1 Processor -- start 2024-08-17T02:26:26.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.041+0000 7f61271b7700 1 -- start start 2024-08-17T02:26:26.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.041+0000 7f61271b7700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f61200d0010 0x7f61200d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.041+0000 7f61271b7700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61200cf190 con 0x7f6120159040 2024-08-17T02:26:26.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.041+0000 7f61271b7700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61200d09a0 con 0x7f612015cea0 2024-08-17T02:26:26.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.041+0000 7f61271b7700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612015d9f0 con 0x7f61200d0010 2024-08-17T02:26:26.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.041+0000 7f61259b4700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f61200d0010 0x7f61200d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.041+0000 7f61259b4700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f61200d0010 0x7f61200d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43678/0 (socket says 172.21.15.102:43678) 2024-08-17T02:26:26.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.041+0000 7f61259b4700 1 -- 172.21.15.102:0/2554067693 learned_addr learned my addr 172.21.15.102:0/2554067693 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:26.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.041+0000 7f61259b4700 1 -- 172.21.15.102:0/2554067693 >> v1:172.21.15.121:6789/0 conn(0x7f612015cea0 legacy=0x7f612015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.041+0000 7f61259b4700 1 -- 172.21.15.102:0/2554067693 >> v1:172.21.15.102:6789/0 conn(0x7f6120159040 legacy=0x7f61200cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.041+0000 7f61251b3700 1 -- 172.21.15.102:0/2554067693 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010395526 0 0) 0x7f61200cf190 con 0x7f6120159040 2024-08-17T02:26:26.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.041+0000 7f61259b4700 1 -- 172.21.15.102:0/2554067693 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61200ce5e0 con 0x7f61200d0010 2024-08-17T02:26:26.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.045+0000 7f61259b4700 1 --2- 172.21.15.102:0/2554067693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61200d0010 0x7f61200d0460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f611c0099b0 tx=0x7f611c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22dd80a4ecdc041c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.045+0000 7f61251b3700 1 -- 172.21.15.102:0/2554067693 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c00b860 con 0x7f61200d0010 2024-08-17T02:26:26.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.045+0000 7f61251b3700 1 -- 172.21.15.102:0/2554067693 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c00b9c0 con 0x7f61200d0010 2024-08-17T02:26:26.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.045+0000 7f61251b3700 1 -- 172.21.15.102:0/2554067693 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c00bd80 con 0x7f61200d0010 2024-08-17T02:26:26.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.045+0000 7f61271b7700 1 -- 172.21.15.102:0/2554067693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61200d0010 msgr2=0x7f61200d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.045+0000 7f61271b7700 1 --2- 172.21.15.102:0/2554067693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61200d0010 0x7f61200d0460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f611c0099b0 tx=0x7f611c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:26.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.045+0000 7f61271b7700 1 -- 172.21.15.102:0/2554067693 shutdown_connections 2024-08-17T02:26:26.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.045+0000 7f61271b7700 1 --2- 172.21.15.102:0/2554067693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61200d0010 0x7f61200d0460 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.045+0000 7f61271b7700 1 -- 172.21.15.102:0/2554067693 >> 172.21.15.102:0/2554067693 conn(0x7f6120068250 msgr2=0x7f6120068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:26.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.045+0000 7f61271b7700 1 -- 172.21.15.102:0/2554067693 shutdown_connections 2024-08-17T02:26:26.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.045+0000 7f61271b7700 1 -- 172.21.15.102:0/2554067693 wait complete. 2024-08-17T02:26:26.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61271b7700 1 Processor -- start 2024-08-17T02:26:26.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61271b7700 1 -- start start 2024-08-17T02:26:26.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61271b7700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61200d0010 0x7f612016a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61271b7700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6120159040 0x7f61200b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61271b7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f612015cea0 0x7f6120157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61271b7700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612016a610 con 0x7f61200d0010 2024-08-17T02:26:26.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61271b7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612016dbc0 con 0x7f612015cea0 2024-08-17T02:26:26.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61271b7700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612016cfb0 con 0x7f6120159040 2024-08-17T02:26:26.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61261b5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61200d0010 0x7f612016a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61261b5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61200d0010 0x7f612016a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43684/0 (socket says 172.21.15.102:43684) 2024-08-17T02:26:26.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61261b5700 1 -- 172.21.15.102:0/1497512796 learned_addr learned my addr 172.21.15.102:0/1497512796 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:26.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61259b4700 1 --2- 172.21.15.102:0/1497512796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6120159040 0x7f61200b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61269b6700 1 --2- 172.21.15.102:0/1497512796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f612015cea0 0x7f6120157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61261b5700 1 -- 172.21.15.102:0/1497512796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6120159040 msgr2=0x7f61200b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61261b5700 1 --2- 172.21.15.102:0/1497512796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6120159040 0x7f61200b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61261b5700 1 -- 172.21.15.102:0/1497512796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f612015cea0 msgr2=0x7f6120157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61261b5700 1 --2- 172.21.15.102:0/1497512796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f612015cea0 0x7f6120157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61261b5700 1 -- 172.21.15.102:0/1497512796 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c0094f0 con 0x7f61200d0010 2024-08-17T02:26:26.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61261b5700 1 --2- 172.21.15.102:0/1497512796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61200d0010 0x7f612016a0d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f611000c5b0 tx=0x7f6110007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61167fc700 1 -- 172.21.15.102:0/1497512796 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110011590 con 0x7f61200d0010 2024-08-17T02:26:26.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61167fc700 1 -- 172.21.15.102:0/1497512796 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6110011710 con 0x7f61200d0010 2024-08-17T02:26:26.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61271b7700 1 -- 172.21.15.102:0/1497512796 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612016d290 con 0x7f61200d0010 2024-08-17T02:26:26.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61167fc700 1 -- 172.21.15.102:0/1497512796 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110011ad0 con 0x7f61200d0010 2024-08-17T02:26:26.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.049+0000 7f61271b7700 1 -- 172.21.15.102:0/1497512796 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612016d850 con 0x7f61200d0010 2024-08-17T02:26:26.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.053+0000 7f61271b7700 1 -- 172.21.15.102:0/1497512796 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61200643a0 con 0x7f61200d0010 2024-08-17T02:26:26.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.053+0000 7f61167fc700 1 -- 172.21.15.102:0/1497512796 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f611001b3b0 con 0x7f61200d0010 2024-08-17T02:26:26.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.053+0000 7f61167fc700 1 --2- 172.21.15.102:0/1497512796 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6104060890 0x7f6104062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.053+0000 7f61167fc700 1 -- 172.21.15.102:0/1497512796 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f611007bf40 con 0x7f61200d0010 2024-08-17T02:26:26.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.053+0000 7f61259b4700 1 --2- 172.21.15.102:0/1497512796 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6104060890 0x7f6104062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.053+0000 7f61259b4700 1 --2- 172.21.15.102:0/1497512796 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6104060890 0x7f6104062d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f611c0099b0 tx=0x7f611c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.061+0000 7f61167fc700 1 -- 172.21.15.102:0/1497512796 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f611004c390 con 0x7f61200d0010 2024-08-17T02:26:26.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.225+0000 7f61271b7700 1 -- 172.21.15.102:0/1497512796 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f612015b710 con 0x7f61200d0010 2024-08-17T02:26:26.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.229+0000 7f61167fc700 1 -- 172.21.15.102:0/1497512796 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f6110017020 con 0x7f61200d0010 2024-08-17T02:26:26.231 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:26.232 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:57.002263+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:53.562223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:54.343618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:26.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.233+0000 7f61271b7700 1 -- 172.21.15.102:0/1497512796 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6104060890 msgr2=0x7f6104062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.233+0000 7f61271b7700 1 --2- 172.21.15.102:0/1497512796 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6104060890 0x7f6104062d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f611c0099b0 tx=0x7f611c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:26.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.233+0000 7f61271b7700 1 -- 172.21.15.102:0/1497512796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61200d0010 msgr2=0x7f612016a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.233+0000 7f61271b7700 1 --2- 172.21.15.102:0/1497512796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61200d0010 0x7f612016a0d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f611000c5b0 tx=0x7f6110007f60 comp rx=0 tx=0).stop 2024-08-17T02:26:26.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.233+0000 7f61271b7700 1 -- 172.21.15.102:0/1497512796 shutdown_connections 2024-08-17T02:26:26.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.233+0000 7f61271b7700 1 --2- 172.21.15.102:0/1497512796 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6104060890 0x7f6104062d40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.233+0000 7f61271b7700 1 --2- 172.21.15.102:0/1497512796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f612015cea0 0x7f6120157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.233+0000 7f61271b7700 1 --2- 172.21.15.102:0/1497512796 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6120159040 0x7f61200b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.233+0000 7f61271b7700 1 --2- 172.21.15.102:0/1497512796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61200d0010 0x7f612016a0d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.233+0000 7f61271b7700 1 -- 172.21.15.102:0/1497512796 >> 172.21.15.102:0/1497512796 conn(0x7f6120068250 msgr2=0x7f61200af040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:26.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.233+0000 7f61271b7700 1 -- 172.21.15.102:0/1497512796 shutdown_connections 2024-08-17T02:26:26.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.233+0000 7f61271b7700 1 -- 172.21.15.102:0/1497512796 wait complete. 2024-08-17T02:26:26.246 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:49.236728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:53.562223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:54.343618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:26.246 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:26.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.361+0000 7f93eade9700 1 Processor -- start 2024-08-17T02:26:26.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.361+0000 7f93eade9700 1 -- start start 2024-08-17T02:26:26.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.361+0000 7f93eade9700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f93e4142770 0x7f93e40afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.361+0000 7f93eade9700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93e406ee50 0x7f93e40aead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.361+0000 7f93eade9700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e40ae640 con 0x7f93e4142b40 2024-08-17T02:26:26.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.361+0000 7f93eade9700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e40ada30 con 0x7f93e4142770 2024-08-17T02:26:26.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.361+0000 7f93eade9700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40add10 con 0x7f93e406ee50 2024-08-17T02:26:26.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.361+0000 7f93e9de7700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f93e4142770 0x7f93e40afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.361+0000 7f93e9de7700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f93e4142770 0x7f93e40afdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43698/0 (socket says 172.21.15.102:43698) 2024-08-17T02:26:26.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.361+0000 7f93e9de7700 1 -- 172.21.15.102:0/3454905900 learned_addr learned my addr 172.21.15.102:0/3454905900 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:26.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93ea5e8700 1 --2- 172.21.15.102:0/3454905900 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93e406ee50 0x7f93e40aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93e9de7700 1 -- 172.21.15.102:0/3454905900 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93e406ee50 msgr2=0x7f93e40aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:26.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93e9de7700 1 --2- 172.21.15.102:0/3454905900 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93e406ee50 0x7f93e40aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93e9de7700 1 -- 172.21.15.102:0/3454905900 >> v1:172.21.15.102:6789/0 conn(0x7f93e4142b40 legacy=0x7f93e406e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:26.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93e9de7700 1 -- 172.21.15.102:0/3454905900 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e40adff0 con 0x7f93e4142770 2024-08-17T02:26:26.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93ea5e8700 1 --2- 172.21.15.102:0/3454905900 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93e406ee50 0x7f93e40aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:26.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93e9de7700 1 --2- 172.21.15.102:0/3454905900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93e4142770 0x7f93e40afdc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009f20 tx=0x7f93d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69479f7a158a6b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93e8de5700 1 -- 172.21.15.102:0/3454905900 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d400e070 con 0x7f93e4142770 2024-08-17T02:26:26.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93e8de5700 1 -- 172.21.15.102:0/3454905900 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d400ba40 con 0x7f93e4142770 2024-08-17T02:26:26.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93e8de5700 1 -- 172.21.15.102:0/3454905900 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d40092e0 con 0x7f93e4142770 2024-08-17T02:26:26.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93eade9700 1 -- 172.21.15.102:0/3454905900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93e4142770 msgr2=0x7f93e40afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93eade9700 1 --2- 172.21.15.102:0/3454905900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93e4142770 0x7f93e40afdc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009f20 tx=0x7f93d4009840 comp rx=0 tx=0).stop 2024-08-17T02:26:26.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93eade9700 1 -- 172.21.15.102:0/3454905900 shutdown_connections 2024-08-17T02:26:26.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93eade9700 1 --2- 172.21.15.102:0/3454905900 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93e406ee50 0x7f93e40aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93eade9700 1 --2- 172.21.15.102:0/3454905900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93e4142770 0x7f93e40afdc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93eade9700 1 -- 172.21.15.102:0/3454905900 >> 172.21.15.102:0/3454905900 conn(0x7f93e40cd860 msgr2=0x7f93e406e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:26.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93eade9700 1 -- 172.21.15.102:0/3454905900 shutdown_connections 2024-08-17T02:26:26.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93eade9700 1 -- 172.21.15.102:0/3454905900 wait complete. 2024-08-17T02:26:26.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93eade9700 1 Processor -- start 2024-08-17T02:26:26.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.365+0000 7f93eade9700 1 -- start start 2024-08-17T02:26:26.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93eade9700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93e406ee50 0x7f93e4138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93eade9700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93e4142770 0x7f93e40c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93eade9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93e4142b40 0x7f93e40c2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93eade9700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40c27c0 con 0x7f93e4142770 2024-08-17T02:26:26.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93eade9700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e413d9d0 con 0x7f93e4142b40 2024-08-17T02:26:26.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93eade9700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e416c5f0 con 0x7f93e406ee50 2024-08-17T02:26:26.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93e95e6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93e4142770 0x7f93e40c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93e9de7700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93e406ee50 0x7f93e4138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93e95e6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93e4142770 0x7f93e40c1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43704/0 (socket says 172.21.15.102:43704) 2024-08-17T02:26:26.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93ea5e8700 1 --2- 172.21.15.102:0/3079027687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93e4142b40 0x7f93e40c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93e95e6700 1 -- 172.21.15.102:0/3079027687 learned_addr learned my addr 172.21.15.102:0/3079027687 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:26.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93e95e6700 1 -- 172.21.15.102:0/3079027687 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93e406ee50 msgr2=0x7f93e4138ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93e95e6700 1 --2- 172.21.15.102:0/3079027687 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93e406ee50 0x7f93e4138ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93e95e6700 1 -- 172.21.15.102:0/3079027687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93e4142b40 msgr2=0x7f93e40c2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93e95e6700 1 --2- 172.21.15.102:0/3079027687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93e4142b40 0x7f93e40c2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93e95e6700 1 -- 172.21.15.102:0/3079027687 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d4009ae0 con 0x7f93e4142770 2024-08-17T02:26:26.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93e95e6700 1 --2- 172.21.15.102:0/3079027687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93e4142770 0x7f93e40c1d40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f93d800c610 tx=0x7f93d8007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93e1ffb700 1 -- 172.21.15.102:0/3079027687 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8016070 con 0x7f93e4142770 2024-08-17T02:26:26.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93e1ffb700 1 -- 172.21.15.102:0/3079027687 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d8006820 con 0x7f93e4142770 2024-08-17T02:26:26.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93e1ffb700 1 -- 172.21.15.102:0/3079027687 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8006bc0 con 0x7f93e4142770 2024-08-17T02:26:26.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93eade9700 1 -- 172.21.15.102:0/3079027687 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e416bd50 con 0x7f93e4142770 2024-08-17T02:26:26.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.369+0000 7f93eade9700 1 -- 172.21.15.102:0/3079027687 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e416c390 con 0x7f93e4142770 2024-08-17T02:26:26.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.373+0000 7f93eade9700 1 -- 172.21.15.102:0/3079027687 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e40638f0 con 0x7f93e4142770 2024-08-17T02:26:26.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.373+0000 7f93e1ffb700 1 -- 172.21.15.102:0/3079027687 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f93d8006fd0 con 0x7f93e4142770 2024-08-17T02:26:26.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.373+0000 7f93e1ffb700 1 --2- 172.21.15.102:0/3079027687 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f93d0060860 0x7f93d0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.373+0000 7f93e9de7700 1 --2- 172.21.15.102:0/3079027687 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f93d0060860 0x7f93d0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.373+0000 7f93e1ffb700 1 -- 172.21.15.102:0/3079027687 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f93d807bd80 con 0x7f93e4142770 2024-08-17T02:26:26.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.373+0000 7f93e9de7700 1 --2- 172.21.15.102:0/3079027687 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f93d0060860 0x7f93d0062d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009880 tx=0x7f93d4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.381+0000 7f93e1ffb700 1 -- 172.21.15.102:0/3079027687 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f93d804c1d0 con 0x7f93e4142770 2024-08-17T02:26:26.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.545+0000 7f93eade9700 1 -- 172.21.15.102:0/3079027687 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93e406ca90 con 0x7f93e4142770 2024-08-17T02:26:26.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.545+0000 7f93e1ffb700 1 -- 172.21.15.102:0/3079027687 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f93d8053e60 con 0x7f93e4142770 2024-08-17T02:26:26.547 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-08-17T02:26:26.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.545+0000 7f93eade9700 1 -- 172.21.15.102:0/3079027687 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f93d0060860 msgr2=0x7f93d0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.545+0000 7f93eade9700 1 --2- 172.21.15.102:0/3079027687 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f93d0060860 0x7f93d0062d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009880 tx=0x7f93d4017000 comp rx=0 tx=0).stop 2024-08-17T02:26:26.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.545+0000 7f93eade9700 1 -- 172.21.15.102:0/3079027687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93e4142770 msgr2=0x7f93e40c1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.545+0000 7f93eade9700 1 --2- 172.21.15.102:0/3079027687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93e4142770 0x7f93e40c1d40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f93d800c610 tx=0x7f93d8007f50 comp rx=0 tx=0).stop 2024-08-17T02:26:26.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.545+0000 7f93eade9700 1 -- 172.21.15.102:0/3079027687 shutdown_connections 2024-08-17T02:26:26.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.545+0000 7f93eade9700 1 --2- 172.21.15.102:0/3079027687 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f93d0060860 0x7f93d0062d10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.545+0000 7f93eade9700 1 --2- 172.21.15.102:0/3079027687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93e4142770 0x7f93e40c1d40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.545+0000 7f93eade9700 1 --2- 172.21.15.102:0/3079027687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93e4142b40 0x7f93e40c2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.545+0000 7f93eade9700 1 --2- 172.21.15.102:0/3079027687 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f93e406ee50 0x7f93e4138ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.545+0000 7f93eade9700 1 -- 172.21.15.102:0/3079027687 >> 172.21.15.102:0/3079027687 conn(0x7f93e40cd860 msgr2=0x7f93e40cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:26.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.549+0000 7f93eade9700 1 -- 172.21.15.102:0/3079027687 shutdown_connections 2024-08-17T02:26:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.549+0000 7f93eade9700 1 -- 172.21.15.102:0/3079027687 wait complete. 2024-08-17T02:26:26.561 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:26.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.677+0000 7f87fbbb0700 1 Processor -- start 2024-08-17T02:26:26.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.677+0000 7f87fbbb0700 1 -- start start 2024-08-17T02:26:26.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.677+0000 7f87fbbb0700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87f41596d0 0x7f87f4066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.677+0000 7f87fbbb0700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f87f415dbc0 0x7f87f4067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.677+0000 7f87fbbb0700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f40cba90 con 0x7f87f4159300 2024-08-17T02:26:26.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.677+0000 7f87fbbb0700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f40b2b60 con 0x7f87f415dbc0 2024-08-17T02:26:26.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.677+0000 7f87fbbb0700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40b2940 con 0x7f87f41596d0 2024-08-17T02:26:26.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.677+0000 7f87f914b700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87f41596d0 0x7f87f4066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.677+0000 7f87fa14d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f87f415dbc0 0x7f87f4067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.677+0000 7f87f914b700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87f41596d0 0x7f87f4066e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:44578/0 (socket says 172.21.15.102:44578) 2024-08-17T02:26:26.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.677+0000 7f87f914b700 1 -- 172.21.15.102:0/3604201760 learned_addr learned my addr 172.21.15.102:0/3604201760 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:26.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.677+0000 7f87f994c700 1 --1- 172.21.15.102:0/3604201760 >> v1:172.21.15.121:6789/0 conn(0x7f87f4159300 0x7f87f40b2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:36690/0 (socket says 172.21.15.102:36690) 2024-08-17T02:26:26.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.677+0000 7f87f914b700 1 -- 172.21.15.102:0/3604201760 >> v2:172.21.15.121:3300/0 conn(0x7f87f415dbc0 msgr2=0x7f87f4067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:26.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.677+0000 7f87f914b700 1 --2- 172.21.15.102:0/3604201760 >> v2:172.21.15.121:3300/0 conn(0x7f87f415dbc0 0x7f87f4067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.677+0000 7f87f914b700 1 -- 172.21.15.102:0/3604201760 >> v1:172.21.15.121:6789/0 conn(0x7f87f4159300 legacy=0x7f87f40b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.677+0000 7f87f914b700 1 -- 172.21.15.102:0/3604201760 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f40cb160 con 0x7f87f41596d0 2024-08-17T02:26:26.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.681+0000 7f87f914b700 1 --2- 172.21.15.102:0/3604201760 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87f41596d0 0x7f87f4066e00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f87f00099b0 tx=0x7f87f0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dac4222b9a31d59c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.681+0000 7f87f894a700 1 -- 172.21.15.102:0/3604201760 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0009ea0 con 0x7f87f41596d0 2024-08-17T02:26:26.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.681+0000 7f87f894a700 1 -- 172.21.15.102:0/3604201760 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f000b860 con 0x7f87f41596d0 2024-08-17T02:26:26.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.681+0000 7f87f894a700 1 -- 172.21.15.102:0/3604201760 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f000bc20 con 0x7f87f41596d0 2024-08-17T02:26:26.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.681+0000 7f87fbbb0700 1 -- 172.21.15.102:0/3604201760 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87f41596d0 msgr2=0x7f87f4066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.681+0000 7f87fbbb0700 1 --2- 172.21.15.102:0/3604201760 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87f41596d0 0x7f87f4066e00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f87f00099b0 tx=0x7f87f0009250 comp rx=0 tx=0).stop 2024-08-17T02:26:26.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.681+0000 7f87fbbb0700 1 -- 172.21.15.102:0/3604201760 shutdown_connections 2024-08-17T02:26:26.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.681+0000 7f87fbbb0700 1 --2- 172.21.15.102:0/3604201760 >> v2:172.21.15.121:3300/0 conn(0x7f87f415dbc0 0x7f87f4067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.681+0000 7f87fbbb0700 1 --2- 172.21.15.102:0/3604201760 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87f41596d0 0x7f87f4066e00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.681+0000 7f87fbbb0700 1 -- 172.21.15.102:0/3604201760 >> 172.21.15.102:0/3604201760 conn(0x7f87f40682c0 msgr2=0x7f87f40686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:26.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.681+0000 7f87fbbb0700 1 -- 172.21.15.102:0/3604201760 shutdown_connections 2024-08-17T02:26:26.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.681+0000 7f87fbbb0700 1 -- 172.21.15.102:0/3604201760 wait complete. 2024-08-17T02:26:26.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.681+0000 7f87fbbb0700 1 Processor -- start 2024-08-17T02:26:26.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.681+0000 7f87fbbb0700 1 -- start start 2024-08-17T02:26:26.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87fbbb0700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87f4159300 0x7f87f4149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87fbbb0700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87f41596d0 0x7f87f40c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87fbbb0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87f415dbc0 0x7f87f40c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87fbbb0700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4159ae0 con 0x7f87f41596d0 2024-08-17T02:26:26.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87fbbb0700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40c7f00 con 0x7f87f415dbc0 2024-08-17T02:26:26.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87fbbb0700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40c81e0 con 0x7f87f4159300 2024-08-17T02:26:26.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87f914b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87f41596d0 0x7f87f40c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87f914b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87f41596d0 0x7f87f40c91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43720/0 (socket says 172.21.15.102:43720) 2024-08-17T02:26:26.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87f914b700 1 -- 172.21.15.102:0/2214100029 learned_addr learned my addr 172.21.15.102:0/2214100029 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:26.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87f994c700 1 --2- 172.21.15.102:0/2214100029 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87f4159300 0x7f87f4149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87fa14d700 1 --2- 172.21.15.102:0/2214100029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87f415dbc0 0x7f87f40c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87f914b700 1 -- 172.21.15.102:0/2214100029 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87f4159300 msgr2=0x7f87f4149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87f914b700 1 --2- 172.21.15.102:0/2214100029 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87f4159300 0x7f87f4149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87f914b700 1 -- 172.21.15.102:0/2214100029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87f415dbc0 msgr2=0x7f87f40c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87f914b700 1 --2- 172.21.15.102:0/2214100029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87f415dbc0 0x7f87f40c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87f914b700 1 -- 172.21.15.102:0/2214100029 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f00094f0 con 0x7f87f41596d0 2024-08-17T02:26:26.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87f914b700 1 --2- 172.21.15.102:0/2214100029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87f41596d0 0x7f87f40c91e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f87f40b2da0 tx=0x7f87f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87e5ffb700 1 -- 172.21.15.102:0/2214100029 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f001f070 con 0x7f87f41596d0 2024-08-17T02:26:26.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87e5ffb700 1 -- 172.21.15.102:0/2214100029 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f0006ab0 con 0x7f87f41596d0 2024-08-17T02:26:26.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87fbbb0700 1 -- 172.21.15.102:0/2214100029 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f40c84c0 con 0x7f87f41596d0 2024-08-17T02:26:26.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87e5ffb700 1 -- 172.21.15.102:0/2214100029 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f000bc00 con 0x7f87f41596d0 2024-08-17T02:26:26.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.685+0000 7f87fbbb0700 1 -- 172.21.15.102:0/2214100029 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f4149a70 con 0x7f87f41596d0 2024-08-17T02:26:26.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.689+0000 7f87fbbb0700 1 -- 172.21.15.102:0/2214100029 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f4159f50 con 0x7f87f41596d0 2024-08-17T02:26:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.689+0000 7f87e5ffb700 1 -- 172.21.15.102:0/2214100029 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f87f0011630 con 0x7f87f41596d0 2024-08-17T02:26:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.689+0000 7f87e5ffb700 1 --2- 172.21.15.102:0/2214100029 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f87d8060860 0x7f87d8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.689+0000 7f87f994c700 1 --2- 172.21.15.102:0/2214100029 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f87d8060860 0x7f87d8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.689+0000 7f87e5ffb700 1 -- 172.21.15.102:0/2214100029 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87f007de70 con 0x7f87f41596d0 2024-08-17T02:26:26.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.689+0000 7f87f994c700 1 --2- 172.21.15.102:0/2214100029 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f87d8060860 0x7f87d8062d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f87e8004fd0 tx=0x7f87e8007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.701+0000 7f87e5ffb700 1 -- 172.21.15.102:0/2214100029 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f87f004e340 con 0x7f87f41596d0 2024-08-17T02:26:26.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.861+0000 7f87fbbb0700 1 -- 172.21.15.102:0/2214100029 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f87f40645c0 con 0x7f87f41596d0 2024-08-17T02:26:26.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.861+0000 7f87e5ffb700 1 -- 172.21.15.102:0/2214100029 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87f0051960 con 0x7f87f41596d0 2024-08-17T02:26:26.865 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-08-17T02:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.865+0000 7f87fbbb0700 1 -- 172.21.15.102:0/2214100029 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f87d8060860 msgr2=0x7f87d8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.865+0000 7f87fbbb0700 1 --2- 172.21.15.102:0/2214100029 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f87d8060860 0x7f87d8062d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f87e8004fd0 tx=0x7f87e8007eb0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.865+0000 7f87fbbb0700 1 -- 172.21.15.102:0/2214100029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87f41596d0 msgr2=0x7f87f40c91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.865+0000 7f87fbbb0700 1 --2- 172.21.15.102:0/2214100029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87f41596d0 0x7f87f40c91e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f87f40b2da0 tx=0x7f87f0017000 comp rx=0 tx=0).stop 2024-08-17T02:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.865+0000 7f87fbbb0700 1 -- 172.21.15.102:0/2214100029 shutdown_connections 2024-08-17T02:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.865+0000 7f87fbbb0700 1 --2- 172.21.15.102:0/2214100029 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f87d8060860 0x7f87d8062d10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.865+0000 7f87fbbb0700 1 --2- 172.21.15.102:0/2214100029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87f41596d0 0x7f87f40c91e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.865+0000 7f87fbbb0700 1 --2- 172.21.15.102:0/2214100029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87f415dbc0 0x7f87f40c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.865+0000 7f87fbbb0700 1 --2- 172.21.15.102:0/2214100029 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f87f4159300 0x7f87f4149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.865+0000 7f87fbbb0700 1 -- 172.21.15.102:0/2214100029 >> 172.21.15.102:0/2214100029 conn(0x7f87f40682c0 msgr2=0x7f87f415cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.865+0000 7f87fbbb0700 1 -- 172.21.15.102:0/2214100029 shutdown_connections 2024-08-17T02:26:26.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.865+0000 7f87fbbb0700 1 -- 172.21.15.102:0/2214100029 wait complete. 2024-08-17T02:26:26.878 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:26.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.989+0000 7fe2a3fff700 1 Processor -- start 2024-08-17T02:26:26.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.989+0000 7fe2a3fff700 1 -- start start 2024-08-17T02:26:26.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.989+0000 7fe2a3fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2a4067030 0x7fe2a4067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.989+0000 7fe2a3fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe2a40cfb00 0x7fe2a40cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.989+0000 7fe2a3fff700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a40cf670 con 0x7fe2a40cb5c0 2024-08-17T02:26:26.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.989+0000 7fe2a3fff700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a40cea60 con 0x7fe2a40cfb00 2024-08-17T02:26:26.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.989+0000 7fe2a3fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a40ced40 con 0x7fe2a4067030 2024-08-17T02:26:26.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.989+0000 7fe2a37fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe2a40cb5c0 0x7fe2a4158cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:36692/0 (socket says 172.21.15.102:36692) 2024-08-17T02:26:26.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.989+0000 7fe2a27fc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe2a40cfb00 0x7fe2a40cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.989+0000 7fe2a37fe700 1 -- 172.21.15.102:0/2533711744 learned_addr learned my addr 172.21.15.102:0/2533711744 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:26.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.989+0000 7fe2a2ffd700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2a4067030 0x7fe2a4067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.993+0000 7fe2a27fc700 1 -- 172.21.15.102:0/2533711744 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2a4067030 msgr2=0x7fe2a4067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:26.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.993+0000 7fe2a27fc700 1 --2- 172.21.15.102:0/2533711744 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2a4067030 0x7fe2a4067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.993+0000 7fe2a27fc700 1 -- 172.21.15.102:0/2533711744 >> v1:172.21.15.121:6789/0 conn(0x7fe2a40cb5c0 legacy=0x7fe2a4158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.993+0000 7fe2a27fc700 1 -- 172.21.15.102:0/2533711744 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a40cf020 con 0x7fe2a40cfb00 2024-08-17T02:26:26.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.993+0000 7fe2a27fc700 1 --2- 172.21.15.102:0/2533711744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2a40cfb00 0x7fe2a40cb080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0098e0 tx=0x7fe28c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=473399fffcb9d3a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.993+0000 7fe2a1ffb700 1 -- 172.21.15.102:0/2533711744 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c00b640 con 0x7fe2a40cfb00 2024-08-17T02:26:26.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.993+0000 7fe2a1ffb700 1 -- 172.21.15.102:0/2533711744 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c00b7a0 con 0x7fe2a40cfb00 2024-08-17T02:26:26.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.993+0000 7fe2a1ffb700 1 -- 172.21.15.102:0/2533711744 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c00bb40 con 0x7fe2a40cfb00 2024-08-17T02:26:26.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.993+0000 7fe2a3fff700 1 -- 172.21.15.102:0/2533711744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2a40cfb00 msgr2=0x7fe2a40cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.993+0000 7fe2a3fff700 1 --2- 172.21.15.102:0/2533711744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2a40cfb00 0x7fe2a40cb080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0098e0 tx=0x7fe28c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.993+0000 7fe2a3fff700 1 -- 172.21.15.102:0/2533711744 shutdown_connections 2024-08-17T02:26:26.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.993+0000 7fe2a3fff700 1 --2- 172.21.15.102:0/2533711744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2a40cfb00 0x7fe2a40cb080 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.993+0000 7fe2a3fff700 1 --2- 172.21.15.102:0/2533711744 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2a4067030 0x7fe2a4067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.993+0000 7fe2a3fff700 1 -- 172.21.15.102:0/2533711744 >> 172.21.15.102:0/2533711744 conn(0x7fe2a40d0b50 msgr2=0x7fe2a40ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:26.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.993+0000 7fe2a3fff700 1 -- 172.21.15.102:0/2533711744 shutdown_connections 2024-08-17T02:26:26.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.993+0000 7fe2a3fff700 1 -- 172.21.15.102:0/2533711744 wait complete. 2024-08-17T02:26:26.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a3fff700 1 Processor -- start 2024-08-17T02:26:26.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a3fff700 1 -- start start 2024-08-17T02:26:27.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a3fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2a4067030 0x7fe2a40c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a3fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2a40cb5c0 0x7fe2a41468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a3fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2a40cfb00 0x7fe2a40c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a3fff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a4159a60 con 0x7fe2a40cfb00 2024-08-17T02:26:27.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a3fff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a4159d00 con 0x7fe2a4067030 2024-08-17T02:26:27.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a3fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a415c2d0 con 0x7fe2a40cb5c0 2024-08-17T02:26:27.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a37fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2a40cfb00 0x7fe2a40c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a37fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2a40cfb00 0x7fe2a40c8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43726/0 (socket says 172.21.15.102:43726) 2024-08-17T02:26:27.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a37fe700 1 -- 172.21.15.102:0/2974742224 learned_addr learned my addr 172.21.15.102:0/2974742224 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:27.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a2ffd700 1 --2- 172.21.15.102:0/2974742224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2a4067030 0x7fe2a40c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a27fc700 1 --2- 172.21.15.102:0/2974742224 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2a40cb5c0 0x7fe2a41468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a37fe700 1 -- 172.21.15.102:0/2974742224 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2a40cb5c0 msgr2=0x7fe2a41468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a37fe700 1 --2- 172.21.15.102:0/2974742224 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2a40cb5c0 0x7fe2a41468e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a37fe700 1 -- 172.21.15.102:0/2974742224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2a4067030 msgr2=0x7fe2a40c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a37fe700 1 --2- 172.21.15.102:0/2974742224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2a4067030 0x7fe2a40c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a37fe700 1 -- 172.21.15.102:0/2974742224 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c009420 con 0x7fe2a40cfb00 2024-08-17T02:26:27.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:26.997+0000 7fe2a2ffd700 1 --2- 172.21.15.102:0/2974742224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2a4067030 0x7fe2a40c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:27.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.001+0000 7fe2a37fe700 1 --2- 172.21.15.102:0/2974742224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2a40cfb00 0x7fe2a40c8de0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00cc40 tx=0x7fe29c001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.001+0000 7fe29affd700 1 -- 172.21.15.102:0/2974742224 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c00a910 con 0x7fe2a40cfb00 2024-08-17T02:26:27.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.001+0000 7fe29affd700 1 -- 172.21.15.102:0/2974742224 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c00aa70 con 0x7fe2a40cfb00 2024-08-17T02:26:27.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.001+0000 7fe2a3fff700 1 -- 172.21.15.102:0/2974742224 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a415c5b0 con 0x7fe2a40cfb00 2024-08-17T02:26:27.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.001+0000 7fe29affd700 1 -- 172.21.15.102:0/2974742224 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c00ae30 con 0x7fe2a40cfb00 2024-08-17T02:26:27.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.001+0000 7fe2a3fff700 1 -- 172.21.15.102:0/2974742224 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a40c8070 con 0x7fe2a40cfb00 2024-08-17T02:26:27.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.001+0000 7fe29affd700 1 -- 172.21.15.102:0/2974742224 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe29c007300 con 0x7fe2a40cfb00 2024-08-17T02:26:27.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.001+0000 7fe2a3fff700 1 -- 172.21.15.102:0/2974742224 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a415cab0 con 0x7fe2a40cfb00 2024-08-17T02:26:27.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.001+0000 7fe29affd700 1 --2- 172.21.15.102:0/2974742224 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe284060860 0x7fe284062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.001+0000 7fe29affd700 1 -- 172.21.15.102:0/2974742224 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe29c07cf80 con 0x7fe2a40cfb00 2024-08-17T02:26:27.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.001+0000 7fe2a2ffd700 1 --2- 172.21.15.102:0/2974742224 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe284060860 0x7fe284062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.005+0000 7fe2a2ffd700 1 --2- 172.21.15.102:0/2974742224 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe284060860 0x7fe284062d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe294009d80 tx=0x7fe294008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.009+0000 7fe29affd700 1 -- 172.21.15.102:0/2974742224 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe29c04d450 con 0x7fe2a40cfb00 2024-08-17T02:26:27.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.169+0000 7fe2a3fff700 1 -- 172.21.15.102:0/2974742224 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2a40638f0 con 0x7fe2a40cfb00 2024-08-17T02:26:27.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.169+0000 7fe29affd700 1 -- 172.21.15.102:0/2974742224 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe29c050a70 con 0x7fe2a40cfb00 2024-08-17T02:26:27.172 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-08-17T02:26:27.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.173+0000 7fe2a3fff700 1 -- 172.21.15.102:0/2974742224 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe284060860 msgr2=0x7fe284062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.173+0000 7fe2a3fff700 1 --2- 172.21.15.102:0/2974742224 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe284060860 0x7fe284062d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe294009d80 tx=0x7fe294008040 comp rx=0 tx=0).stop 2024-08-17T02:26:27.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.173+0000 7fe2a3fff700 1 -- 172.21.15.102:0/2974742224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2a40cfb00 msgr2=0x7fe2a40c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.173+0000 7fe2a3fff700 1 --2- 172.21.15.102:0/2974742224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2a40cfb00 0x7fe2a40c8de0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00cc40 tx=0x7fe29c001a50 comp rx=0 tx=0).stop 2024-08-17T02:26:27.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.173+0000 7fe2a3fff700 1 -- 172.21.15.102:0/2974742224 shutdown_connections 2024-08-17T02:26:27.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.173+0000 7fe2a3fff700 1 --2- 172.21.15.102:0/2974742224 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe284060860 0x7fe284062d10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.173+0000 7fe2a3fff700 1 --2- 172.21.15.102:0/2974742224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2a40cfb00 0x7fe2a40c8de0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.173+0000 7fe2a3fff700 1 --2- 172.21.15.102:0/2974742224 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe2a40cb5c0 0x7fe2a41468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.173+0000 7fe2a3fff700 1 --2- 172.21.15.102:0/2974742224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2a4067030 0x7fe2a40c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.173+0000 7fe2a3fff700 1 -- 172.21.15.102:0/2974742224 >> 172.21.15.102:0/2974742224 conn(0x7fe2a40d0b50 msgr2=0x7fe2a40b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:27.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.173+0000 7fe2a3fff700 1 -- 172.21.15.102:0/2974742224 shutdown_connections 2024-08-17T02:26:27.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.173+0000 7fe2a3fff700 1 -- 172.21.15.102:0/2974742224 wait complete. 2024-08-17T02:26:27.187 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:26:27.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.293+0000 7fcba1f9b700 1 Processor -- start 2024-08-17T02:26:27.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.293+0000 7fcba1f9b700 1 -- start start 2024-08-17T02:26:27.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba1f9b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcb9c06e620 0x7fcb9c0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba1f9b700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcb9c0b1630 0x7fcb9c141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba1f9b700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9c141a00 con 0x7fcb9c0b0d20 2024-08-17T02:26:27.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba1f9b700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9c140b10 con 0x7fcb9c0b1630 2024-08-17T02:26:27.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba1f9b700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9c140df0 con 0x7fcb9c06e620 2024-08-17T02:26:27.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba179a700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcb9c0b1630 0x7fcb9c141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba179a700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcb9c0b1630 0x7fcb9c141e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43730/0 (socket says 172.21.15.102:43730) 2024-08-17T02:26:27.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba179a700 1 -- 172.21.15.102:0/1350811948 learned_addr learned my addr 172.21.15.102:0/1350811948 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:27.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcb9bfff700 1 --2- 172.21.15.102:0/1350811948 >> v2:172.21.15.121:3300/0 conn(0x7fcb9c06e620 0x7fcb9c0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcb9b7fe700 1 -- 172.21.15.102:0/1350811948 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383938931 0 0) 0x7fcb9c141a00 con 0x7fcb9c0b0d20 2024-08-17T02:26:27.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcb9b7fe700 1 -- 172.21.15.102:0/1350811948 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb88003570 con 0x7fcb9c0b0d20 2024-08-17T02:26:27.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba179a700 1 -- 172.21.15.102:0/1350811948 >> v2:172.21.15.121:3300/0 conn(0x7fcb9c06e620 msgr2=0x7fcb9c0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:27.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba179a700 1 --2- 172.21.15.102:0/1350811948 >> v2:172.21.15.121:3300/0 conn(0x7fcb9c06e620 0x7fcb9c0b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba179a700 1 -- 172.21.15.102:0/1350811948 >> v1:172.21.15.121:6789/0 conn(0x7fcb9c0b0d20 legacy=0x7fcb9c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba179a700 1 -- 172.21.15.102:0/1350811948 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c1410d0 con 0x7fcb9c0b1630 2024-08-17T02:26:27.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcb9bfff700 1 --2- 172.21.15.102:0/1350811948 >> v2:172.21.15.121:3300/0 conn(0x7fcb9c06e620 0x7fcb9c0b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:27.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba179a700 1 --2- 172.21.15.102:0/1350811948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb9c0b1630 0x7fcb9c141e90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c06c630 tx=0x7fcb8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253553b28b3f3290 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcb9b7fe700 1 -- 172.21.15.102:0/1350811948 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c00b640 con 0x7fcb9c0b1630 2024-08-17T02:26:27.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcb9b7fe700 1 -- 172.21.15.102:0/1350811948 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c00b7a0 con 0x7fcb9c0b1630 2024-08-17T02:26:27.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcb9b7fe700 1 -- 172.21.15.102:0/1350811948 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c00bb20 con 0x7fcb9c0b1630 2024-08-17T02:26:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba1f9b700 1 -- 172.21.15.102:0/1350811948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb9c0b1630 msgr2=0x7fcb9c141e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba1f9b700 1 --2- 172.21.15.102:0/1350811948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb9c0b1630 0x7fcb9c141e90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c06c630 tx=0x7fcb8c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba1f9b700 1 -- 172.21.15.102:0/1350811948 shutdown_connections 2024-08-17T02:26:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba1f9b700 1 --2- 172.21.15.102:0/1350811948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb9c0b1630 0x7fcb9c141e90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba1f9b700 1 --2- 172.21.15.102:0/1350811948 >> v2:172.21.15.121:3300/0 conn(0x7fcb9c06e620 0x7fcb9c0b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba1f9b700 1 -- 172.21.15.102:0/1350811948 >> 172.21.15.102:0/1350811948 conn(0x7fcb9c0678d0 msgr2=0x7fcb9c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba1f9b700 1 -- 172.21.15.102:0/1350811948 shutdown_connections 2024-08-17T02:26:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.297+0000 7fcba1f9b700 1 -- 172.21.15.102:0/1350811948 wait complete. 2024-08-17T02:26:27.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba1f9b700 1 Processor -- start 2024-08-17T02:26:27.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba1f9b700 1 -- start start 2024-08-17T02:26:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba1f9b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb9c06e620 0x7fcb9c1463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba1f9b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb9c0b0d20 0x7fcb9c0a9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba1f9b700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb9c0b1630 0x7fcb9c0ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba1f9b700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c0a6a30 con 0x7fcb9c06e620 2024-08-17T02:26:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba1f9b700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c0a6d10 con 0x7fcb9c0b0d20 2024-08-17T02:26:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba1f9b700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c0a6ff0 con 0x7fcb9c0b1630 2024-08-17T02:26:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba0f99700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb9c06e620 0x7fcb9c1463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba0f99700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb9c06e620 0x7fcb9c1463b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43734/0 (socket says 172.21.15.102:43734) 2024-08-17T02:26:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba0f99700 1 -- 172.21.15.102:0/1893612275 learned_addr learned my addr 172.21.15.102:0/1893612275 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcb9bfff700 1 --2- 172.21.15.102:0/1893612275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb9c0b0d20 0x7fcb9c0a9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba179a700 1 --2- 172.21.15.102:0/1893612275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb9c0b1630 0x7fcb9c0ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba0f99700 1 -- 172.21.15.102:0/1893612275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb9c0b1630 msgr2=0x7fcb9c0ad7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba0f99700 1 --2- 172.21.15.102:0/1893612275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb9c0b1630 0x7fcb9c0ad7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba0f99700 1 -- 172.21.15.102:0/1893612275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb9c0b0d20 msgr2=0x7fcb9c0a9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba0f99700 1 --2- 172.21.15.102:0/1893612275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb9c0b0d20 0x7fcb9c0a9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba0f99700 1 -- 172.21.15.102:0/1893612275 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb84009420 con 0x7fcb9c06e620 2024-08-17T02:26:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.301+0000 7fcba179a700 1 --2- 172.21.15.102:0/1893612275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb9c0b1630 0x7fcb9c0ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.305+0000 7fcba0f99700 1 --2- 172.21.15.102:0/1893612275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb9c06e620 0x7fcb9c1463b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400c910 tx=0x7fcb94002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.305+0000 7fcb98ff9700 1 -- 172.21.15.102:0/1893612275 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94012630 con 0x7fcb9c06e620 2024-08-17T02:26:27.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.305+0000 7fcb98ff9700 1 -- 172.21.15.102:0/1893612275 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb940127b0 con 0x7fcb9c06e620 2024-08-17T02:26:27.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.305+0000 7fcb98ff9700 1 -- 172.21.15.102:0/1893612275 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94012b70 con 0x7fcb9c06e620 2024-08-17T02:26:27.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.305+0000 7fcba1f9b700 1 -- 172.21.15.102:0/1893612275 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c0094f0 con 0x7fcb9c06e620 2024-08-17T02:26:27.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.305+0000 7fcba1f9b700 1 -- 172.21.15.102:0/1893612275 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9c0a75b0 con 0x7fcb9c06e620 2024-08-17T02:26:27.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.305+0000 7fcba1f9b700 1 -- 172.21.15.102:0/1893612275 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9c0643a0 con 0x7fcb9c06e620 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.305+0000 7fcb98ff9700 1 -- 172.21.15.102:0/1893612275 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcb9400a3b0 con 0x7fcb9c06e620 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.305+0000 7fcb98ff9700 1 --2- 172.21.15.102:0/1893612275 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcb7c060860 0x7fcb7c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.305+0000 7fcb98ff9700 1 -- 172.21.15.102:0/1893612275 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb9407ce20 con 0x7fcb9c06e620 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.305+0000 7fcb9bfff700 1 --2- 172.21.15.102:0/1893612275 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcb7c060860 0x7fcb7c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.305+0000 7fcb9bfff700 1 --2- 172.21.15.102:0/1893612275 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcb7c060860 0x7fcb7c062d10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0a92f0 tx=0x7fcb840091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.317+0000 7fcb98ff9700 1 -- 172.21.15.102:0/1893612275 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcb9404d270 con 0x7fcb9c06e620 2024-08-17T02:26:27.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:27.537+0000 7fcba1f9b700 1 -- 172.21.15.102:0/1893612275 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fcb9c06f5f0 con 0x7fcb9c06e620 2024-08-17T02:26:28.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.345+0000 7fcb98ff9700 1 -- 172.21.15.102:0/1893612275 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v46) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcb94050890 con 0x7fcb9c06e620 2024-08-17T02:26:28.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.349+0000 7fcba1f9b700 1 -- 172.21.15.102:0/1893612275 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcb7c060860 msgr2=0x7fcb7c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.349+0000 7fcba1f9b700 1 --2- 172.21.15.102:0/1893612275 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcb7c060860 0x7fcb7c062d10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0a92f0 tx=0x7fcb840091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.349+0000 7fcba1f9b700 1 -- 172.21.15.102:0/1893612275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb9c06e620 msgr2=0x7fcb9c1463b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.349+0000 7fcba1f9b700 1 --2- 172.21.15.102:0/1893612275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb9c06e620 0x7fcb9c1463b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400c910 tx=0x7fcb94002700 comp rx=0 tx=0).stop 2024-08-17T02:26:28.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.349+0000 7fcba1f9b700 1 -- 172.21.15.102:0/1893612275 shutdown_connections 2024-08-17T02:26:28.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.349+0000 7fcba1f9b700 1 --2- 172.21.15.102:0/1893612275 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcb7c060860 0x7fcb7c062d10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.349+0000 7fcba1f9b700 1 --2- 172.21.15.102:0/1893612275 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcb9c0b1630 0x7fcb9c0ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.349+0000 7fcba1f9b700 1 --2- 172.21.15.102:0/1893612275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb9c0b0d20 0x7fcb9c0a9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.349+0000 7fcba1f9b700 1 --2- 172.21.15.102:0/1893612275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb9c06e620 0x7fcb9c1463b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.349+0000 7fcba1f9b700 1 -- 172.21.15.102:0/1893612275 >> 172.21.15.102:0/1893612275 conn(0x7fcb9c0678d0 msgr2=0x7fcb9c15cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:28.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.349+0000 7fcba1f9b700 1 -- 172.21.15.102:0/1893612275 shutdown_connections 2024-08-17T02:26:28.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.349+0000 7fcba1f9b700 1 -- 172.21.15.102:0/1893612275 wait complete. 2024-08-17T02:26:28.368 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:26:28.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.477+0000 7f32ff59e700 1 Processor -- start 2024-08-17T02:26:28.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.477+0000 7f32ff59e700 1 -- start start 2024-08-17T02:26:28.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.477+0000 7f32ff59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3300067030 0x7f3300067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.477+0000 7f32ff59e700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3300158cc0 0x7f33001590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.477+0000 7f32ff59e700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33000cf670 con 0x7f33000cfb00 2024-08-17T02:26:28.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.477+0000 7f32ff59e700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33000cea60 con 0x7f3300158cc0 2024-08-17T02:26:28.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.477+0000 7f32ff59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33000ced40 con 0x7f3300067030 2024-08-17T02:26:28.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.477+0000 7f32fed9d700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3300158cc0 0x7f33001590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.477+0000 7f32fed9d700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3300158cc0 0x7f33001590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43740/0 (socket says 172.21.15.102:43740) 2024-08-17T02:26:28.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.477+0000 7f32fed9d700 1 -- 172.21.15.102:0/4140765379 learned_addr learned my addr 172.21.15.102:0/4140765379 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:28.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.477+0000 7f32fe59c700 1 --2- 172.21.15.102:0/4140765379 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3300067030 0x7f3300067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.477+0000 7f32fed9d700 1 -- 172.21.15.102:0/4140765379 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3300067030 msgr2=0x7f3300067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:28.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.477+0000 7f32fed9d700 1 --2- 172.21.15.102:0/4140765379 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3300067030 0x7f3300067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.477+0000 7f32fed9d700 1 -- 172.21.15.102:0/4140765379 >> v1:172.21.15.102:6789/0 conn(0x7f33000cfb00 legacy=0x7f33000cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.477+0000 7f32fed9d700 1 -- 172.21.15.102:0/4140765379 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33000cf020 con 0x7f3300158cc0 2024-08-17T02:26:28.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.481+0000 7f32fed9d700 1 --2- 172.21.15.102:0/4140765379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3300158cc0 0x7f33001590f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009f20 tx=0x7f32f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93235a0d1f4f113a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.481+0000 7f32fd59a700 1 -- 172.21.15.102:0/4140765379 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f800e070 con 0x7f3300158cc0 2024-08-17T02:26:28.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.481+0000 7f32fd59a700 1 -- 172.21.15.102:0/4140765379 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f800ba80 con 0x7f3300158cc0 2024-08-17T02:26:28.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.481+0000 7f32fd59a700 1 -- 172.21.15.102:0/4140765379 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80092e0 con 0x7f3300158cc0 2024-08-17T02:26:28.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.481+0000 7f32ff59e700 1 -- 172.21.15.102:0/4140765379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3300158cc0 msgr2=0x7f33001590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.481+0000 7f32ff59e700 1 --2- 172.21.15.102:0/4140765379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3300158cc0 0x7f33001590f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009f20 tx=0x7f32f8009840 comp rx=0 tx=0).stop 2024-08-17T02:26:28.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.481+0000 7f32ff59e700 1 -- 172.21.15.102:0/4140765379 shutdown_connections 2024-08-17T02:26:28.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.481+0000 7f32ff59e700 1 --2- 172.21.15.102:0/4140765379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3300158cc0 0x7f33001590f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.481+0000 7f32ff59e700 1 --2- 172.21.15.102:0/4140765379 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3300067030 0x7f3300067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.481+0000 7f32ff59e700 1 -- 172.21.15.102:0/4140765379 >> 172.21.15.102:0/4140765379 conn(0x7f33000d0b50 msgr2=0x7f33000ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:28.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.481+0000 7f32ff59e700 1 -- 172.21.15.102:0/4140765379 shutdown_connections 2024-08-17T02:26:28.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.481+0000 7f32ff59e700 1 -- 172.21.15.102:0/4140765379 wait complete. 2024-08-17T02:26:28.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.481+0000 7f32ff59e700 1 Processor -- start 2024-08-17T02:26:28.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.481+0000 7f32ff59e700 1 -- start start 2024-08-17T02:26:28.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.481+0000 7f32ff59e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3300067030 0x7f33001552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32ff59e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33000cfb00 0x7f33001449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32ff59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3300158cc0 0x7f33000c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32ff59e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3300155820 con 0x7f3300067030 2024-08-17T02:26:28.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32ff59e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3300159ba0 con 0x7f33000cfb00 2024-08-17T02:26:28.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32ff59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3300155a50 con 0x7f3300158cc0 2024-08-17T02:26:28.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32fe59c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3300067030 0x7f33001552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32fe59c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3300067030 0x7f33001552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43754/0 (socket says 172.21.15.102:43754) 2024-08-17T02:26:28.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32fe59c700 1 -- 172.21.15.102:0/3912979838 learned_addr learned my addr 172.21.15.102:0/3912979838 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:28.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32fed9d700 1 --2- 172.21.15.102:0/3912979838 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3300158cc0 0x7f33000c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32fdd9b700 1 --2- 172.21.15.102:0/3912979838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33000cfb00 0x7f33001449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32fe59c700 1 -- 172.21.15.102:0/3912979838 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3300158cc0 msgr2=0x7f33000c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32fe59c700 1 --2- 172.21.15.102:0/3912979838 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3300158cc0 0x7f33000c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32fe59c700 1 -- 172.21.15.102:0/3912979838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33000cfb00 msgr2=0x7f33001449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32fe59c700 1 --2- 172.21.15.102:0/3912979838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33000cfb00 0x7f33001449e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32fe59c700 1 -- 172.21.15.102:0/3912979838 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f8009ae0 con 0x7f3300067030 2024-08-17T02:26:28.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32fdd9b700 1 --2- 172.21.15.102:0/3912979838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33000cfb00 0x7f33001449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:28.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32fed9d700 1 --2- 172.21.15.102:0/3912979838 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3300158cc0 0x7f33000c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:28.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32fe59c700 1 --2- 172.21.15.102:0/3912979838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3300067030 0x7f33001552e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f32f400d890 tx=0x7f32f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32ee7fc700 1 -- 172.21.15.102:0/3912979838 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f400b600 con 0x7f3300067030 2024-08-17T02:26:28.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32ee7fc700 1 -- 172.21.15.102:0/3912979838 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f400b760 con 0x7f3300067030 2024-08-17T02:26:28.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32ee7fc700 1 -- 172.21.15.102:0/3912979838 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f400bae0 con 0x7f3300067030 2024-08-17T02:26:28.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32ff59e700 1 -- 172.21.15.102:0/3912979838 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3300155d30 con 0x7f3300067030 2024-08-17T02:26:28.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32ff59e700 1 -- 172.21.15.102:0/3912979838 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33001562f0 con 0x7f3300067030 2024-08-17T02:26:28.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32ff59e700 1 -- 172.21.15.102:0/3912979838 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33000638f0 con 0x7f3300067030 2024-08-17T02:26:28.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.485+0000 7f32ee7fc700 1 -- 172.21.15.102:0/3912979838 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f32f401e460 con 0x7f3300067030 2024-08-17T02:26:28.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.489+0000 7f32ee7fc700 1 --2- 172.21.15.102:0/3912979838 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f32e0060860 0x7f32e0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.489+0000 7f32fdd9b700 1 --2- 172.21.15.102:0/3912979838 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f32e0060860 0x7f32e0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.489+0000 7f32ee7fc700 1 -- 172.21.15.102:0/3912979838 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32f407d360 con 0x7f3300067030 2024-08-17T02:26:28.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.489+0000 7f32fdd9b700 1 --2- 172.21.15.102:0/3912979838 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f32e0060860 0x7f32e0062d10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f33000b01e0 tx=0x7f32f0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.493+0000 7f32ee7fc700 1 -- 172.21.15.102:0/3912979838 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f32f404d710 con 0x7f3300067030 2024-08-17T02:26:28.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.657+0000 7f32ff59e700 1 -- 172.21.15.102:0/3912979838 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3300152dd0 con 0x7f3300067030 2024-08-17T02:26:28.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.665+0000 7f32ee7fc700 1 -- 172.21.15.102:0/3912979838 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f32f4050d30 con 0x7f3300067030 2024-08-17T02:26:28.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.665+0000 7f32ff59e700 1 -- 172.21.15.102:0/3912979838 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f32e0060860 msgr2=0x7f32e0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.665+0000 7f32ff59e700 1 --2- 172.21.15.102:0/3912979838 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f32e0060860 0x7f32e0062d10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f33000b01e0 tx=0x7f32f0009040 comp rx=0 tx=0).stop 2024-08-17T02:26:28.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.665+0000 7f32ff59e700 1 -- 172.21.15.102:0/3912979838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3300067030 msgr2=0x7f33001552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.665+0000 7f32ff59e700 1 --2- 172.21.15.102:0/3912979838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3300067030 0x7f33001552e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f32f400d890 tx=0x7f32f4008040 comp rx=0 tx=0).stop 2024-08-17T02:26:28.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.665+0000 7f32ff59e700 1 -- 172.21.15.102:0/3912979838 shutdown_connections 2024-08-17T02:26:28.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.665+0000 7f32ff59e700 1 --2- 172.21.15.102:0/3912979838 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f32e0060860 0x7f32e0062d10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.665+0000 7f32ff59e700 1 --2- 172.21.15.102:0/3912979838 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3300158cc0 0x7f33000c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.665+0000 7f32ff59e700 1 --2- 172.21.15.102:0/3912979838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33000cfb00 0x7f33001449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.665+0000 7f32ff59e700 1 --2- 172.21.15.102:0/3912979838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3300067030 0x7f33001552e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.665+0000 7f32ff59e700 1 -- 172.21.15.102:0/3912979838 >> 172.21.15.102:0/3912979838 conn(0x7f33000d0b50 msgr2=0x7f33001532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:28.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.665+0000 7f32ff59e700 1 -- 172.21.15.102:0/3912979838 shutdown_connections 2024-08-17T02:26:28.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:28.665+0000 7f32ff59e700 1 -- 172.21.15.102:0/3912979838 wait complete. 2024-08-17T02:26:28.682 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:26:28.682 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:26:28.702 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:26:28.725 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:26:28.725 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2024-08-17T02:26:28.725 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:28.725 DEBUG:teuthology.orchestra.run.smithi102:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:28.749 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:26:28.749 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-08-17T02:26:28.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:28.750 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:26:28.810 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-08-17T02:26:28.811 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:28.811 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:28.836 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:26:28.837 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-08-17T02:26:28.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:28.837 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:26:28.877 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2024-08-17T02:26:28.878 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:28.878 DEBUG:teuthology.orchestra.run.smithi102:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:28.894 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:26:28.894 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-08-17T02:26:28.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:28.894 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:26:28.900 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-08-17T02:26:28.900 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:28.900 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:28.917 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:26:28.917 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-08-17T02:26:28.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:28.917 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:26:28.968 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:26:28.968 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:29.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.081+0000 7f9ecf26b700 1 Processor -- start 2024-08-17T02:26:29.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.081+0000 7f9ecf26b700 1 -- start start 2024-08-17T02:26:29.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.081+0000 7f9ecf26b700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ec80b14a0 0x7f9ec80cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.081+0000 7f9ecf26b700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec80cbaa0 con 0x7f9ec8154900 2024-08-17T02:26:29.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.081+0000 7f9ecf26b700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec8157630 con 0x7f9ec80cb390 2024-08-17T02:26:29.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.081+0000 7f9ecf26b700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8068790 con 0x7f9ec80b14a0 2024-08-17T02:26:29.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.081+0000 7f9ece269700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f9ec8154900 0x7f9ec80b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60114/0 (socket says 172.21.15.102:60114) 2024-08-17T02:26:29.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.081+0000 7f9ece269700 1 -- 172.21.15.102:0/4231740794 learned_addr learned my addr 172.21.15.102:0/4231740794 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:29.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.081+0000 7f9ecda68700 1 --2- 172.21.15.102:0/4231740794 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ec80b14a0 0x7f9ec80cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.081+0000 7f9ecd267700 1 -- 172.21.15.102:0/4231740794 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059925715 0 0) 0x7f9ec80cbaa0 con 0x7f9ec8154900 2024-08-17T02:26:29.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 -- 172.21.15.102:0/4231740794 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb4003570 con 0x7f9ec8154900 2024-08-17T02:26:29.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 -- 172.21.15.102:0/4231740794 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4063432918 0 0) 0x7f9eb4003570 con 0x7f9ec8154900 2024-08-17T02:26:29.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 -- 172.21.15.102:0/4231740794 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ec80b14a0 msgr2=0x7f9ec80cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:29.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 --2- 172.21.15.102:0/4231740794 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ec80b14a0 0x7f9ec80cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 -- 172.21.15.102:0/4231740794 >> v1:172.21.15.121:6789/0 conn(0x7f9ec80cb390 legacy=0x7f9ec8160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 -- 172.21.15.102:0/4231740794 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec8157910 con 0x7f9ec8154900 2024-08-17T02:26:29.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 -- 172.21.15.102:0/4231740794 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7f9eb80017f0 con 0x7f9ec8154900 2024-08-17T02:26:29.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 -- 172.21.15.102:0/4231740794 >> v1:172.21.15.102:6789/0 conn(0x7f9ec8154900 legacy=0x7f9ec80b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 --2- 172.21.15.102:0/4231740794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4003a90 0x7f9eb4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 --2- 172.21.15.102:0/4231740794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9eb4004810 0x7f9eb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 --2- 172.21.15.102:0/4231740794 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ec80b14a0 0x7f9eb40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 -- 172.21.15.102:0/4231740794 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8068790 con 0x7f9eb4003a90 2024-08-17T02:26:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 -- 172.21.15.102:0/4231740794 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb400bb90 con 0x7f9eb4004810 2024-08-17T02:26:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 -- 172.21.15.102:0/4231740794 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb400bd50 con 0x7f9ec80b14a0 2024-08-17T02:26:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ece269700 1 --2- 172.21.15.102:0/4231740794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4003a90 0x7f9eb4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecea6a700 1 --2- 172.21.15.102:0/4231740794 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ec80b14a0 0x7f9eb40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecda68700 1 --2- 172.21.15.102:0/4231740794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9eb4004810 0x7f9eb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ece269700 1 -- 172.21.15.102:0/4231740794 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ec80b14a0 msgr2=0x7f9eb40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ece269700 1 --2- 172.21.15.102:0/4231740794 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ec80b14a0 0x7f9eb40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ece269700 1 -- 172.21.15.102:0/4231740794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9eb4004810 msgr2=0x7f9eb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ece269700 1 --2- 172.21.15.102:0/4231740794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9eb4004810 0x7f9eb4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ece269700 1 -- 172.21.15.102:0/4231740794 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb4003570 con 0x7f9eb4003a90 2024-08-17T02:26:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecda68700 1 --2- 172.21.15.102:0/4231740794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9eb4004810 0x7f9eb4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ece269700 1 --2- 172.21.15.102:0/4231740794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4003a90 0x7f9eb4003ea0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800a930 tx=0x7f9eb80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91afd33495e94ba8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 -- 172.21.15.102:0/4231740794 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80070d0 con 0x7f9eb4003a90 2024-08-17T02:26:29.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 -- 172.21.15.102:0/4231740794 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb8007230 con 0x7f9eb4003a90 2024-08-17T02:26:29.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecd267700 1 -- 172.21.15.102:0/4231740794 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80075d0 con 0x7f9eb4003a90 2024-08-17T02:26:29.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecf26b700 1 -- 172.21.15.102:0/4231740794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4003a90 msgr2=0x7f9eb4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecf26b700 1 --2- 172.21.15.102:0/4231740794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4003a90 0x7f9eb4003ea0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800a930 tx=0x7f9eb80021d0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecea6a700 1 -- 172.21.15.102:0/4231740794 reap_dead start 2024-08-17T02:26:29.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecf26b700 1 -- 172.21.15.102:0/4231740794 shutdown_connections 2024-08-17T02:26:29.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecf26b700 1 -- 172.21.15.102:0/4231740794 >> 172.21.15.102:0/4231740794 conn(0x7f9ec80678d0 msgr2=0x7f9ec8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:29.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecf26b700 1 -- 172.21.15.102:0/4231740794 shutdown_connections 2024-08-17T02:26:29.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.085+0000 7f9ecf26b700 1 -- 172.21.15.102:0/4231740794 wait complete. 2024-08-17T02:26:29.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.089+0000 7f9ecf26b700 1 Processor -- start 2024-08-17T02:26:29.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.089+0000 7f9ecf26b700 1 -- start start 2024-08-17T02:26:29.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.089+0000 7f9ecf26b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4003a90 0x7f9ec8165070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.089+0000 7f9ecf26b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ec8168600 0x7f9ec8167e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.089+0000 7f9ecf26b700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ec8166b80 0x7f9ec8069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.089+0000 7f9ecf26b700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec81655b0 con 0x7f9eb4003a90 2024-08-17T02:26:29.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.089+0000 7f9ecf26b700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80a9ab0 con 0x7f9ec8168600 2024-08-17T02:26:29.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.089+0000 7f9ecf26b700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8168ae0 con 0x7f9ec8166b80 2024-08-17T02:26:29.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.089+0000 7f9ece269700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4003a90 0x7f9ec8165070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.089+0000 7f9ece269700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4003a90 0x7f9ec8165070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43774/0 (socket says 172.21.15.102:43774) 2024-08-17T02:26:29.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.089+0000 7f9ece269700 1 -- 172.21.15.102:0/2161550905 learned_addr learned my addr 172.21.15.102:0/2161550905 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:29.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.089+0000 7f9ecda68700 1 --2- 172.21.15.102:0/2161550905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ec8168600 0x7f9ec8167e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.089+0000 7f9ecea6a700 1 --2- 172.21.15.102:0/2161550905 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ec8166b80 0x7f9ec8069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.093+0000 7f9ecda68700 1 -- 172.21.15.102:0/2161550905 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ec8166b80 msgr2=0x7f9ec8069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.093+0000 7f9ecda68700 1 --2- 172.21.15.102:0/2161550905 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ec8166b80 0x7f9ec8069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.093+0000 7f9ecda68700 1 -- 172.21.15.102:0/2161550905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4003a90 msgr2=0x7f9ec8165070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.093+0000 7f9ecda68700 1 --2- 172.21.15.102:0/2161550905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4003a90 0x7f9ec8165070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.093+0000 7f9ecda68700 1 -- 172.21.15.102:0/2161550905 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec8168dc0 con 0x7f9ec8168600 2024-08-17T02:26:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.093+0000 7f9ece269700 1 --2- 172.21.15.102:0/2161550905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4003a90 0x7f9ec8165070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.093+0000 7f9ecda68700 1 --2- 172.21.15.102:0/2161550905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ec8168600 0x7f9ec8167e60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0010a70 tx=0x7f9eb0008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.093+0000 7f9ec67fc700 1 -- 172.21.15.102:0/2161550905 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb000e870 con 0x7f9ec8168600 2024-08-17T02:26:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.093+0000 7f9ec67fc700 1 -- 172.21.15.102:0/2161550905 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb000e9d0 con 0x7f9ec8168600 2024-08-17T02:26:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.093+0000 7f9ecf26b700 1 -- 172.21.15.102:0/2161550905 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec81690a0 con 0x7f9ec8168600 2024-08-17T02:26:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.093+0000 7f9ec67fc700 1 -- 172.21.15.102:0/2161550905 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb000ed70 con 0x7f9ec8168600 2024-08-17T02:26:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.093+0000 7f9ecf26b700 1 -- 172.21.15.102:0/2161550905 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec8169660 con 0x7f9ec8168600 2024-08-17T02:26:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.093+0000 7f9ecf26b700 1 -- 172.21.15.102:0/2161550905 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec80643a0 con 0x7f9ec8168600 2024-08-17T02:26:29.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.097+0000 7f9ec67fc700 1 -- 172.21.15.102:0/2161550905 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9eb001c610 con 0x7f9ec8168600 2024-08-17T02:26:29.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.097+0000 7f9ec67fc700 1 --2- 172.21.15.102:0/2161550905 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9ea8060860 0x7f9ea8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.097+0000 7f9ec67fc700 1 -- 172.21.15.102:0/2161550905 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9eb007ce10 con 0x7f9ec8168600 2024-08-17T02:26:29.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.097+0000 7f9ece269700 1 --2- 172.21.15.102:0/2161550905 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9ea8060860 0x7f9ea8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.097+0000 7f9ece269700 1 --2- 172.21.15.102:0/2161550905 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9ea8060860 0x7f9ea8062d10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800a710 tx=0x7f9eb8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.105+0000 7f9ec67fc700 1 -- 172.21.15.102:0/2161550905 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9eb004d260 con 0x7f9ec8168600 2024-08-17T02:26:29.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.309+0000 7f9ecf26b700 1 -- 172.21.15.102:0/2161550905 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ec806f5f0 con 0x7f9ec8168600 2024-08-17T02:26:29.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.309+0000 7f9ec67fc700 1 -- 172.21.15.102:0/2161550905 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f9eb0050880 con 0x7f9ec8168600 2024-08-17T02:26:29.313 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:29.313 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/3384500830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3384500830},{"type":"v1","addr":"172.21.15.121:6833","nonce":3384500830}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1668690087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1668690087},{"type":"v1","addr":"172.21.15.102:6837","nonce":1668690087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/932475255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":932475255},{"type":"v1","addr":"172.21.15.102:6835","nonce":932475255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:55.340445+0000","modified":"2024-08-17T02:25:58.024448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/4026340784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4026340784},{"type":"v1","addr":"172.21.15.121:6835","nonce":4026340784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:29.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.313+0000 7f9ecf26b700 1 -- 172.21.15.102:0/2161550905 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9ea8060860 msgr2=0x7f9ea8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.313+0000 7f9ecf26b700 1 --2- 172.21.15.102:0/2161550905 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9ea8060860 0x7f9ea8062d10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800a710 tx=0x7f9eb8016000 comp rx=0 tx=0).stop 2024-08-17T02:26:29.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.313+0000 7f9ecf26b700 1 -- 172.21.15.102:0/2161550905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ec8168600 msgr2=0x7f9ec8167e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.313+0000 7f9ecf26b700 1 --2- 172.21.15.102:0/2161550905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ec8168600 0x7f9ec8167e60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0010a70 tx=0x7f9eb0008040 comp rx=0 tx=0).stop 2024-08-17T02:26:29.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.313+0000 7f9ecf26b700 1 -- 172.21.15.102:0/2161550905 shutdown_connections 2024-08-17T02:26:29.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.313+0000 7f9ecf26b700 1 --2- 172.21.15.102:0/2161550905 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9ea8060860 0x7f9ea8062d10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.313+0000 7f9ecf26b700 1 --2- 172.21.15.102:0/2161550905 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f9ec8166b80 0x7f9ec8069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.313+0000 7f9ecf26b700 1 --2- 172.21.15.102:0/2161550905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ec8168600 0x7f9ec8167e60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.313+0000 7f9ecf26b700 1 --2- 172.21.15.102:0/2161550905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4003a90 0x7f9ec8165070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.313+0000 7f9ecf26b700 1 -- 172.21.15.102:0/2161550905 >> 172.21.15.102:0/2161550905 conn(0x7f9ec80678d0 msgr2=0x7f9ec806cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:29.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.313+0000 7f9ecf26b700 1 -- 172.21.15.102:0/2161550905 shutdown_connections 2024-08-17T02:26:29.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.313+0000 7f9ecf26b700 1 -- 172.21.15.102:0/2161550905 wait complete. 2024-08-17T02:26:29.317 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 6 2024-08-17T02:26:29.327 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:29.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51895c1700 1 Processor -- start 2024-08-17T02:26:29.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51895c1700 1 -- start start 2024-08-17T02:26:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51895c1700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5184155d20 0x7f51840b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51895c1700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f518406df10 0x7f518406e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51895c1700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518406e8b0 con 0x7f51840ad7c0 2024-08-17T02:26:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51895c1700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51840adc10 con 0x7f5184155d20 2024-08-17T02:26:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51895c1700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51840af2b0 con 0x7f518406df10 2024-08-17T02:26:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f5183fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5184155d20 0x7f51840b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51837fe700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f51840ad7c0 0x7f51840aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60130/0 (socket says 172.21.15.102:60130) 2024-08-17T02:26:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51837fe700 1 -- 172.21.15.102:0/643974577 learned_addr learned my addr 172.21.15.102:0/643974577 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f5188dc0700 1 --2- 172.21.15.102:0/643974577 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f518406df10 0x7f518406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f5183fff700 1 -- 172.21.15.102:0/643974577 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f518406df10 msgr2=0x7f518406e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f5183fff700 1 --2- 172.21.15.102:0/643974577 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f518406df10 0x7f518406e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f5182ffd700 1 -- 172.21.15.102:0/643974577 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989884531 0 0) 0x7f516c001110 con 0x7f51840ad7c0 2024-08-17T02:26:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f5183fff700 1 -- 172.21.15.102:0/643974577 >> v1:172.21.15.102:6789/0 conn(0x7f51840ad7c0 legacy=0x7f51840aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f5183fff700 1 -- 172.21.15.102:0/643974577 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51840af590 con 0x7f5184155d20 2024-08-17T02:26:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f5183fff700 1 --2- 172.21.15.102:0/643974577 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5184155d20 0x7f51840b0350 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f51740098e0 tx=0x7f51740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ad93ab2abdcc04 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f5182ffd700 1 -- 172.21.15.102:0/643974577 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517400b640 con 0x7f5184155d20 2024-08-17T02:26:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f5182ffd700 1 -- 172.21.15.102:0/643974577 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517400b7a0 con 0x7f5184155d20 2024-08-17T02:26:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f5182ffd700 1 -- 172.21.15.102:0/643974577 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517400bb40 con 0x7f5184155d20 2024-08-17T02:26:29.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51895c1700 1 -- 172.21.15.102:0/643974577 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5184155d20 msgr2=0x7f51840b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51895c1700 1 --2- 172.21.15.102:0/643974577 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5184155d20 0x7f51840b0350 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f51740098e0 tx=0x7f51740091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51895c1700 1 -- 172.21.15.102:0/643974577 shutdown_connections 2024-08-17T02:26:29.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51895c1700 1 --2- 172.21.15.102:0/643974577 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f518406df10 0x7f518406e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51895c1700 1 --2- 172.21.15.102:0/643974577 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5184155d20 0x7f51840b0350 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51895c1700 1 -- 172.21.15.102:0/643974577 >> 172.21.15.102:0/643974577 conn(0x7f51840678d0 msgr2=0x7f5184067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:29.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51895c1700 1 -- 172.21.15.102:0/643974577 shutdown_connections 2024-08-17T02:26:29.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.429+0000 7f51895c1700 1 -- 172.21.15.102:0/643974577 wait complete. 2024-08-17T02:26:29.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.433+0000 7f51895c1700 1 Processor -- start 2024-08-17T02:26:29.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.433+0000 7f51895c1700 1 -- start start 2024-08-17T02:26:29.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.433+0000 7f51895c1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f518406df10 0x7f5184141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.433+0000 7f51895c1700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51840ad7c0 0x7f51840ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.433+0000 7f51895c1700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5184155d20 0x7f51840abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.433+0000 7f51895c1700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5184147200 con 0x7f51840ad7c0 2024-08-17T02:26:29.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.433+0000 7f51895c1700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5184156390 con 0x7f518406df10 2024-08-17T02:26:29.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.433+0000 7f51895c1700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5184159500 con 0x7f5184155d20 2024-08-17T02:26:29.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.433+0000 7f51837fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51840ad7c0 0x7f51840ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f51837fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51840ad7c0 0x7f51840ab6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43790/0 (socket says 172.21.15.102:43790) 2024-08-17T02:26:29.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f51837fe700 1 -- 172.21.15.102:0/966921651 learned_addr learned my addr 172.21.15.102:0/966921651 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:29.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f5183fff700 1 --2- 172.21.15.102:0/966921651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f518406df10 0x7f5184141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f5188dc0700 1 --2- 172.21.15.102:0/966921651 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5184155d20 0x7f51840abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f51837fe700 1 -- 172.21.15.102:0/966921651 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5184155d20 msgr2=0x7f51840abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f51837fe700 1 --2- 172.21.15.102:0/966921651 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5184155d20 0x7f51840abc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f51837fe700 1 -- 172.21.15.102:0/966921651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f518406df10 msgr2=0x7f5184141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f51837fe700 1 --2- 172.21.15.102:0/966921651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f518406df10 0x7f5184141a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f51837fe700 1 -- 172.21.15.102:0/966921651 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5174009420 con 0x7f51840ad7c0 2024-08-17T02:26:29.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f5183fff700 1 --2- 172.21.15.102:0/966921651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f518406df10 0x7f5184141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:29.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f51837fe700 1 --2- 172.21.15.102:0/966921651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51840ad7c0 0x7f51840ab6e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f516c00c810 tx=0x7f516c007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f517bfff700 1 -- 172.21.15.102:0/966921651 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c005b30 con 0x7f51840ad7c0 2024-08-17T02:26:29.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f517bfff700 1 -- 172.21.15.102:0/966921651 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c005c90 con 0x7f51840ad7c0 2024-08-17T02:26:29.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f51895c1700 1 -- 172.21.15.102:0/966921651 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51841473e0 con 0x7f51840ad7c0 2024-08-17T02:26:29.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f517bfff700 1 -- 172.21.15.102:0/966921651 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c0072e0 con 0x7f51840ad7c0 2024-08-17T02:26:29.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f51895c1700 1 -- 172.21.15.102:0/966921651 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51841479a0 con 0x7f51840ad7c0 2024-08-17T02:26:29.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f51895c1700 1 -- 172.21.15.102:0/966921651 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5184147bc0 con 0x7f51840ad7c0 2024-08-17T02:26:29.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.437+0000 7f517bfff700 1 -- 172.21.15.102:0/966921651 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f516c0076d0 con 0x7f51840ad7c0 2024-08-17T02:26:29.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.441+0000 7f517bfff700 1 --2- 172.21.15.102:0/966921651 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5164060860 0x7f5164062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.441+0000 7f517bfff700 1 -- 172.21.15.102:0/966921651 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f516c07bde0 con 0x7f51840ad7c0 2024-08-17T02:26:29.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.441+0000 7f5183fff700 1 --2- 172.21.15.102:0/966921651 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5164060860 0x7f5164062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.441+0000 7f5183fff700 1 --2- 172.21.15.102:0/966921651 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5164060860 0x7f5164062d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f51740091e0 tx=0x7f5174017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.445+0000 7f517bfff700 1 -- 172.21.15.102:0/966921651 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f516c04a480 con 0x7f51840ad7c0 2024-08-17T02:26:29.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.609+0000 7f51895c1700 1 -- 172.21.15.102:0/966921651 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f518406e8b0 con 0x7f51840ad7c0 2024-08-17T02:26:29.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.609+0000 7f517bfff700 1 -- 172.21.15.102:0/966921651 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f518406e8b0 con 0x7f51840ad7c0 2024-08-17T02:26:29.613 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:29.613 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:57.002263+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:53.562223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:54.343618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:29.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.613+0000 7f51895c1700 1 -- 172.21.15.102:0/966921651 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5164060860 msgr2=0x7f5164062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.613+0000 7f51895c1700 1 --2- 172.21.15.102:0/966921651 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5164060860 0x7f5164062d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f51740091e0 tx=0x7f5174017000 comp rx=0 tx=0).stop 2024-08-17T02:26:29.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.613+0000 7f51895c1700 1 -- 172.21.15.102:0/966921651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51840ad7c0 msgr2=0x7f51840ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.613+0000 7f51895c1700 1 --2- 172.21.15.102:0/966921651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51840ad7c0 0x7f51840ab6e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f516c00c810 tx=0x7f516c007c50 comp rx=0 tx=0).stop 2024-08-17T02:26:29.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.613+0000 7f51895c1700 1 -- 172.21.15.102:0/966921651 shutdown_connections 2024-08-17T02:26:29.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.613+0000 7f51895c1700 1 --2- 172.21.15.102:0/966921651 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5164060860 0x7f5164062d10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.613+0000 7f51895c1700 1 --2- 172.21.15.102:0/966921651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51840ad7c0 0x7f51840ab6e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.613+0000 7f51895c1700 1 --2- 172.21.15.102:0/966921651 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5184155d20 0x7f51840abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.613+0000 7f51895c1700 1 --2- 172.21.15.102:0/966921651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f518406df10 0x7f5184141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.613+0000 7f51895c1700 1 -- 172.21.15.102:0/966921651 >> 172.21.15.102:0/966921651 conn(0x7f51840678d0 msgr2=0x7f5184153690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:29.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.613+0000 7f51895c1700 1 -- 172.21.15.102:0/966921651 shutdown_connections 2024-08-17T02:26:29.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.613+0000 7f51895c1700 1 -- 172.21.15.102:0/966921651 wait complete. 2024-08-17T02:26:29.627 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:49.236728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:53.562223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:54.343618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:29.628 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:29.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c7151700 1 Processor -- start 2024-08-17T02:26:29.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c7151700 1 -- start start 2024-08-17T02:26:29.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c7151700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff9c0142660 0x7ff9c0142a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c7151700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff9c00c82e0 0x7ff9c00c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c7151700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c00b1180 con 0x7ff9c00ae510 2024-08-17T02:26:29.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c7151700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c00c9310 con 0x7ff9c0142660 2024-08-17T02:26:29.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c7151700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c00b0890 con 0x7ff9c00c82e0 2024-08-17T02:26:29.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c614f700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff9c0142660 0x7ff9c0142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c594e700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff9c00ae510 0x7ff9c00ae940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60134/0 (socket says 172.21.15.102:60134) 2024-08-17T02:26:29.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c594e700 1 -- 172.21.15.102:0/3661424647 learned_addr learned my addr 172.21.15.102:0/3661424647 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:29.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c6950700 1 --2- 172.21.15.102:0/3661424647 >> v2:172.21.15.121:3300/0 conn(0x7ff9c00c82e0 0x7ff9c00c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c614f700 1 -- 172.21.15.102:0/3661424647 >> v2:172.21.15.121:3300/0 conn(0x7ff9c00c82e0 msgr2=0x7ff9c00c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:29.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c614f700 1 --2- 172.21.15.102:0/3661424647 >> v2:172.21.15.121:3300/0 conn(0x7ff9c00c82e0 0x7ff9c00c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c614f700 1 -- 172.21.15.102:0/3661424647 >> v1:172.21.15.102:6789/0 conn(0x7ff9c00ae510 legacy=0x7ff9c00ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c614f700 1 -- 172.21.15.102:0/3661424647 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c00c9030 con 0x7ff9c0142660 2024-08-17T02:26:29.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c514d700 1 -- 172.21.15.102:0/3661424647 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402081477 0 0) 0x7ff9c00b1180 con 0x7ff9c00ae510 2024-08-17T02:26:29.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c614f700 1 --2- 172.21.15.102:0/3661424647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9c0142660 0x7ff9c0142a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00b10f0 tx=0x7ff9bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53499f683fdbe9bd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c514d700 1 -- 172.21.15.102:0/3661424647 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc00b6b0 con 0x7ff9c0142660 2024-08-17T02:26:29.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c514d700 1 -- 172.21.15.102:0/3661424647 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc00b810 con 0x7ff9c0142660 2024-08-17T02:26:29.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.737+0000 7ff9c514d700 1 -- 172.21.15.102:0/3661424647 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc00bbb0 con 0x7ff9c0142660 2024-08-17T02:26:29.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c7151700 1 -- 172.21.15.102:0/3661424647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9c0142660 msgr2=0x7ff9c0142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c7151700 1 --2- 172.21.15.102:0/3661424647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9c0142660 0x7ff9c0142a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00b10f0 tx=0x7ff9bc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c7151700 1 -- 172.21.15.102:0/3661424647 shutdown_connections 2024-08-17T02:26:29.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c7151700 1 --2- 172.21.15.102:0/3661424647 >> v2:172.21.15.121:3300/0 conn(0x7ff9c00c82e0 0x7ff9c00c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c7151700 1 --2- 172.21.15.102:0/3661424647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9c0142660 0x7ff9c0142a30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c7151700 1 -- 172.21.15.102:0/3661424647 >> 172.21.15.102:0/3661424647 conn(0x7ff9c00c9830 msgr2=0x7ff9c00c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:29.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c7151700 1 -- 172.21.15.102:0/3661424647 shutdown_connections 2024-08-17T02:26:29.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c7151700 1 -- 172.21.15.102:0/3661424647 wait complete. 2024-08-17T02:26:29.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c7151700 1 Processor -- start 2024-08-17T02:26:29.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c7151700 1 -- start start 2024-08-17T02:26:29.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c7151700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c00ae510 0x7ff9c013f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c7151700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9c00c82e0 0x7ff9c012f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c7151700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9c0142660 0x7ff9c012cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c7151700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c012e3f0 con 0x7ff9c00c82e0 2024-08-17T02:26:29.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c7151700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c012d7e0 con 0x7ff9c00ae510 2024-08-17T02:26:29.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c7151700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c012dac0 con 0x7ff9c0142660 2024-08-17T02:26:29.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c594e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9c00c82e0 0x7ff9c012f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c594e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9c00c82e0 0x7ff9c012f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43802/0 (socket says 172.21.15.102:43802) 2024-08-17T02:26:29.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c594e700 1 -- 172.21.15.102:0/2242892536 learned_addr learned my addr 172.21.15.102:0/2242892536 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:29.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c6950700 1 --2- 172.21.15.102:0/2242892536 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9c0142660 0x7ff9c012cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.741+0000 7ff9c614f700 1 --2- 172.21.15.102:0/2242892536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c00ae510 0x7ff9c013f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.745+0000 7ff9c594e700 1 -- 172.21.15.102:0/2242892536 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9c0142660 msgr2=0x7ff9c012cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.745+0000 7ff9c594e700 1 --2- 172.21.15.102:0/2242892536 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9c0142660 0x7ff9c012cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.745+0000 7ff9c594e700 1 -- 172.21.15.102:0/2242892536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c00ae510 msgr2=0x7ff9c013f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.745+0000 7ff9c594e700 1 --2- 172.21.15.102:0/2242892536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c00ae510 0x7ff9c013f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.745+0000 7ff9c594e700 1 -- 172.21.15.102:0/2242892536 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc009420 con 0x7ff9c00c82e0 2024-08-17T02:26:29.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.745+0000 7ff9c594e700 1 --2- 172.21.15.102:0/2242892536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9c00c82e0 0x7ff9c012f8f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000c5b0 tx=0x7ff9b0001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.745+0000 7ff9b67fc700 1 -- 172.21.15.102:0/2242892536 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0005b30 con 0x7ff9c00c82e0 2024-08-17T02:26:29.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.745+0000 7ff9b67fc700 1 -- 172.21.15.102:0/2242892536 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b0005c90 con 0x7ff9c00c82e0 2024-08-17T02:26:29.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.745+0000 7ff9b67fc700 1 -- 172.21.15.102:0/2242892536 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0007300 con 0x7ff9c00c82e0 2024-08-17T02:26:29.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.745+0000 7ff9c7151700 1 -- 172.21.15.102:0/2242892536 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c012dda0 con 0x7ff9c00c82e0 2024-08-17T02:26:29.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.745+0000 7ff9c7151700 1 -- 172.21.15.102:0/2242892536 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c012fe30 con 0x7ff9c00c82e0 2024-08-17T02:26:29.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.745+0000 7ff9c7151700 1 -- 172.21.15.102:0/2242892536 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c00638f0 con 0x7ff9c00c82e0 2024-08-17T02:26:29.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.745+0000 7ff9b67fc700 1 -- 172.21.15.102:0/2242892536 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff9b001b3b0 con 0x7ff9c00c82e0 2024-08-17T02:26:29.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.749+0000 7ff9b67fc700 1 --2- 172.21.15.102:0/2242892536 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff9a4060860 0x7ff9a4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.749+0000 7ff9c614f700 1 --2- 172.21.15.102:0/2242892536 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff9a4060860 0x7ff9a4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.749+0000 7ff9b67fc700 1 -- 172.21.15.102:0/2242892536 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9b007bff0 con 0x7ff9c00c82e0 2024-08-17T02:26:29.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.749+0000 7ff9c614f700 1 --2- 172.21.15.102:0/2242892536 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff9a4060860 0x7ff9a4062d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0093f0 tx=0x7ff9bc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.753+0000 7ff9b67fc700 1 -- 172.21.15.102:0/2242892536 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff9b004c440 con 0x7ff9c00c82e0 2024-08-17T02:26:29.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.917+0000 7ff9c7151700 1 -- 172.21.15.102:0/2242892536 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9c00cad90 con 0x7ff9c00c82e0 2024-08-17T02:26:29.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.917+0000 7ff9b67fc700 1 -- 172.21.15.102:0/2242892536 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9b004fa60 con 0x7ff9c00c82e0 2024-08-17T02:26:29.919 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-08-17T02:26:29.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.917+0000 7ff9c7151700 1 -- 172.21.15.102:0/2242892536 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff9a4060860 msgr2=0x7ff9a4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.917+0000 7ff9c7151700 1 --2- 172.21.15.102:0/2242892536 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff9a4060860 0x7ff9a4062d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0093f0 tx=0x7ff9bc017000 comp rx=0 tx=0).stop 2024-08-17T02:26:29.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.921+0000 7ff9c7151700 1 -- 172.21.15.102:0/2242892536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9c00c82e0 msgr2=0x7ff9c012f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.921+0000 7ff9c7151700 1 --2- 172.21.15.102:0/2242892536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9c00c82e0 0x7ff9c012f8f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000c5b0 tx=0x7ff9b0001070 comp rx=0 tx=0).stop 2024-08-17T02:26:29.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.921+0000 7ff9c7151700 1 -- 172.21.15.102:0/2242892536 shutdown_connections 2024-08-17T02:26:29.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.921+0000 7ff9c7151700 1 --2- 172.21.15.102:0/2242892536 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff9a4060860 0x7ff9a4062d10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.921+0000 7ff9c7151700 1 --2- 172.21.15.102:0/2242892536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9c00c82e0 0x7ff9c012f8f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.921+0000 7ff9c7151700 1 --2- 172.21.15.102:0/2242892536 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9c0142660 0x7ff9c012cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.921+0000 7ff9c7151700 1 --2- 172.21.15.102:0/2242892536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c00ae510 0x7ff9c013f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.921+0000 7ff9c7151700 1 -- 172.21.15.102:0/2242892536 >> 172.21.15.102:0/2242892536 conn(0x7ff9c00c9830 msgr2=0x7ff9c01599f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:29.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.921+0000 7ff9c7151700 1 -- 172.21.15.102:0/2242892536 shutdown_connections 2024-08-17T02:26:29.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:29.921+0000 7ff9c7151700 1 -- 172.21.15.102:0/2242892536 wait complete. 2024-08-17T02:26:29.934 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:30.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.041+0000 7f96062a7700 1 Processor -- start 2024-08-17T02:26:30.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.041+0000 7f96062a7700 1 -- start start 2024-08-17T02:26:30.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.041+0000 7f96062a7700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f96001574f0 0x7f9600157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.041+0000 7f96062a7700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960006e010 con 0x7f96001514d0 2024-08-17T02:26:30.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.041+0000 7f96062a7700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9600157fb0 con 0x7f96000b0d90 2024-08-17T02:26:30.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.041+0000 7f96062a7700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9600158290 con 0x7f96001574f0 2024-08-17T02:26:30.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.041+0000 7f9604aa4700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f96001574f0 0x7f9600157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.041+0000 7f96052a5700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f96001514d0 0x7f960006ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60140/0 (socket says 172.21.15.102:60140) 2024-08-17T02:26:30.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.041+0000 7f9604aa4700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f96001574f0 0x7f9600157970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43814/0 (socket says 172.21.15.102:43814) 2024-08-17T02:26:30.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.041+0000 7f96052a5700 1 -- 172.21.15.102:0/2409094848 learned_addr learned my addr 172.21.15.102:0/2409094848 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:30.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f9604aa4700 1 -- 172.21.15.102:0/2409094848 >> v1:172.21.15.121:6789/0 conn(0x7f96000b0d90 legacy=0x7f96000c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f9604aa4700 1 -- 172.21.15.102:0/2409094848 >> v1:172.21.15.102:6789/0 conn(0x7f96001514d0 legacy=0x7f960006ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f95fffff700 1 -- 172.21.15.102:0/2409094848 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165935406 0 0) 0x7f960006e010 con 0x7f96001514d0 2024-08-17T02:26:30.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f9604aa4700 1 -- 172.21.15.102:0/2409094848 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960006e260 con 0x7f96001574f0 2024-08-17T02:26:30.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f9604aa4700 1 --2- 172.21.15.102:0/2409094848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96001574f0 0x7f9600157970 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009e60 tx=0x7f95f0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68296c02ce40334f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f95fffff700 1 -- 172.21.15.102:0/2409094848 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f000e070 con 0x7f96001574f0 2024-08-17T02:26:30.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f95fffff700 1 -- 172.21.15.102:0/2409094848 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f000bc30 con 0x7f96001574f0 2024-08-17T02:26:30.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f95fffff700 1 -- 172.21.15.102:0/2409094848 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0012430 con 0x7f96001574f0 2024-08-17T02:26:30.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f96062a7700 1 -- 172.21.15.102:0/2409094848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96001574f0 msgr2=0x7f9600157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f96062a7700 1 --2- 172.21.15.102:0/2409094848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96001574f0 0x7f9600157970 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009e60 tx=0x7f95f0009780 comp rx=0 tx=0).stop 2024-08-17T02:26:30.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f96062a7700 1 -- 172.21.15.102:0/2409094848 shutdown_connections 2024-08-17T02:26:30.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f96062a7700 1 --2- 172.21.15.102:0/2409094848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96001574f0 0x7f9600157970 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f96062a7700 1 -- 172.21.15.102:0/2409094848 >> 172.21.15.102:0/2409094848 conn(0x7f96000678a0 msgr2=0x7f9600067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f96062a7700 1 -- 172.21.15.102:0/2409094848 shutdown_connections 2024-08-17T02:26:30.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f96062a7700 1 -- 172.21.15.102:0/2409094848 wait complete. 2024-08-17T02:26:30.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f96062a7700 1 Processor -- start 2024-08-17T02:26:30.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.045+0000 7f96062a7700 1 -- start start 2024-08-17T02:26:30.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f96062a7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96000b0d90 0x7f9600154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f96062a7700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96001514d0 0x7f96001672b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f96062a7700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96001574f0 0x7f96001677f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f96062a7700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96000abb20 con 0x7f96001514d0 2024-08-17T02:26:30.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f96062a7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960014eae0 con 0x7f96000b0d90 2024-08-17T02:26:30.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f96062a7700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9600152e20 con 0x7f96001574f0 2024-08-17T02:26:30.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f9604aa4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96001514d0 0x7f96001672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f9604aa4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96001514d0 0x7f96001672b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43822/0 (socket says 172.21.15.102:43822) 2024-08-17T02:26:30.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f9604aa4700 1 -- 172.21.15.102:0/2813684519 learned_addr learned my addr 172.21.15.102:0/2813684519 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:30.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f96052a5700 1 --2- 172.21.15.102:0/2813684519 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96000b0d90 0x7f9600154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f9605aa6700 1 --2- 172.21.15.102:0/2813684519 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96001574f0 0x7f96001677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f9604aa4700 1 -- 172.21.15.102:0/2813684519 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96001574f0 msgr2=0x7f96001677f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f9604aa4700 1 --2- 172.21.15.102:0/2813684519 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96001574f0 0x7f96001677f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f9604aa4700 1 -- 172.21.15.102:0/2813684519 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96000b0d90 msgr2=0x7f9600154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f9604aa4700 1 --2- 172.21.15.102:0/2813684519 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96000b0d90 0x7f9600154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f9604aa4700 1 -- 172.21.15.102:0/2813684519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f0009a20 con 0x7f96001514d0 2024-08-17T02:26:30.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f9604aa4700 1 --2- 172.21.15.102:0/2813684519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96001514d0 0x7f96001672b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f95f0012580 tx=0x7f95f0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f95fd7fa700 1 -- 172.21.15.102:0/2813684519 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0012df0 con 0x7f96001514d0 2024-08-17T02:26:30.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f95fd7fa700 1 -- 172.21.15.102:0/2813684519 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f0027470 con 0x7f96001514d0 2024-08-17T02:26:30.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f95fd7fa700 1 -- 172.21.15.102:0/2813684519 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0027830 con 0x7f96001514d0 2024-08-17T02:26:30.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f96062a7700 1 -- 172.21.15.102:0/2813684519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9600153100 con 0x7f96001514d0 2024-08-17T02:26:30.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.049+0000 7f96062a7700 1 -- 172.21.15.102:0/2813684519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96001536c0 con 0x7f96001514d0 2024-08-17T02:26:30.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.053+0000 7f96062a7700 1 -- 172.21.15.102:0/2813684519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96000abc90 con 0x7f96001514d0 2024-08-17T02:26:30.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.053+0000 7f95fd7fa700 1 -- 172.21.15.102:0/2813684519 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f95f0024070 con 0x7f96001514d0 2024-08-17T02:26:30.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.053+0000 7f95fd7fa700 1 --2- 172.21.15.102:0/2813684519 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f95e0060860 0x7f95e0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.053+0000 7f95fd7fa700 1 -- 172.21.15.102:0/2813684519 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95f007f260 con 0x7f96001514d0 2024-08-17T02:26:30.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.053+0000 7f96052a5700 1 --2- 172.21.15.102:0/2813684519 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f95e0060860 0x7f95e0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.053+0000 7f96052a5700 1 --2- 172.21.15.102:0/2813684519 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f95e0060860 0x7f95e0062d10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f960006f340 tx=0x7f95e8007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.061+0000 7f95fd7fa700 1 -- 172.21.15.102:0/2813684519 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f96000abc90 con 0x7f96001514d0 2024-08-17T02:26:30.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.225+0000 7f96062a7700 1 -- 172.21.15.102:0/2813684519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96000abc90 con 0x7f96001514d0 2024-08-17T02:26:30.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.225+0000 7f95fd7fa700 1 -- 172.21.15.102:0/2813684519 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96000abc90 con 0x7f96001514d0 2024-08-17T02:26:30.228 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-08-17T02:26:30.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.229+0000 7f96062a7700 1 -- 172.21.15.102:0/2813684519 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f95e0060860 msgr2=0x7f95e0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.229+0000 7f96062a7700 1 --2- 172.21.15.102:0/2813684519 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f95e0060860 0x7f95e0062d10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f960006f340 tx=0x7f95e8007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:30.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.229+0000 7f96062a7700 1 -- 172.21.15.102:0/2813684519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96001514d0 msgr2=0x7f96001672b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.229+0000 7f96062a7700 1 --2- 172.21.15.102:0/2813684519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96001514d0 0x7f96001672b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f95f0012580 tx=0x7f95f0019000 comp rx=0 tx=0).stop 2024-08-17T02:26:30.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.229+0000 7f96062a7700 1 -- 172.21.15.102:0/2813684519 shutdown_connections 2024-08-17T02:26:30.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.229+0000 7f96062a7700 1 --2- 172.21.15.102:0/2813684519 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f95e0060860 0x7f95e0062d10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.229+0000 7f96062a7700 1 --2- 172.21.15.102:0/2813684519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96001514d0 0x7f96001672b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.229+0000 7f96062a7700 1 --2- 172.21.15.102:0/2813684519 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f96001574f0 0x7f96001677f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.229+0000 7f96062a7700 1 --2- 172.21.15.102:0/2813684519 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96000b0d90 0x7f9600154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.229+0000 7f96062a7700 1 -- 172.21.15.102:0/2813684519 >> 172.21.15.102:0/2813684519 conn(0x7f96000678a0 msgr2=0x7f96001562c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.229+0000 7f96062a7700 1 -- 172.21.15.102:0/2813684519 shutdown_connections 2024-08-17T02:26:30.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.229+0000 7f96062a7700 1 -- 172.21.15.102:0/2813684519 wait complete. 2024-08-17T02:26:30.243 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:30.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.349+0000 7f70503e5700 1 Processor -- start 2024-08-17T02:26:30.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.349+0000 7f70503e5700 1 -- start start 2024-08-17T02:26:30.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.349+0000 7f70503e5700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7048158fb0 0x7f7048159380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.349+0000 7f70503e5700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704806a3b0 con 0x7f7048068db0 2024-08-17T02:26:30.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.349+0000 7f70503e5700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70480a9fe0 con 0x7f70480c8b70 2024-08-17T02:26:30.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.349+0000 7f70503e5700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70480c8fc0 con 0x7f7048158fb0 2024-08-17T02:26:30.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.349+0000 7f704e982700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f7048068db0 0x7f70480aa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60148/0 (socket says 172.21.15.102:60148) 2024-08-17T02:26:30.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.349+0000 7f704e982700 1 -- 172.21.15.102:0/1399731683 learned_addr learned my addr 172.21.15.102:0/1399731683 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:30.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f704e181700 1 --2- 172.21.15.102:0/1399731683 >> v2:172.21.15.102:3300/0 conn(0x7f7048158fb0 0x7f7048159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f704d17f700 1 -- 172.21.15.102:0/1399731683 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347613305 0 0) 0x7f704806a3b0 con 0x7f7048068db0 2024-08-17T02:26:30.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f704d17f700 1 -- 172.21.15.102:0/1399731683 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7034003570 con 0x7f7048068db0 2024-08-17T02:26:30.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f704d17f700 1 -- 172.21.15.102:0/1399731683 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302417869 0 0) 0x7f70480a9fe0 con 0x7f70480c8b70 2024-08-17T02:26:30.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f704d17f700 1 -- 172.21.15.102:0/1399731683 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f704806a3b0 con 0x7f70480c8b70 2024-08-17T02:26:30.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f704e181700 1 -- 172.21.15.102:0/1399731683 >> v1:172.21.15.121:6789/0 conn(0x7f70480c8b70 legacy=0x7f70480686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f704e181700 1 -- 172.21.15.102:0/1399731683 >> v1:172.21.15.102:6789/0 conn(0x7f7048068db0 legacy=0x7f70480aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f704d17f700 1 -- 172.21.15.102:0/1399731683 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 362832418 0 0) 0x7f7034003570 con 0x7f7048068db0 2024-08-17T02:26:30.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f704e181700 1 -- 172.21.15.102:0/1399731683 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704806a0d0 con 0x7f7048158fb0 2024-08-17T02:26:30.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f704e181700 1 --2- 172.21.15.102:0/1399731683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7048158fb0 0x7f7048159380 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7044009910 tx=0x7f70440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf9232273002400 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f704d17f700 1 -- 172.21.15.102:0/1399731683 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044011630 con 0x7f7048158fb0 2024-08-17T02:26:30.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f704d17f700 1 -- 172.21.15.102:0/1399731683 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7044011790 con 0x7f7048158fb0 2024-08-17T02:26:30.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f704d17f700 1 -- 172.21.15.102:0/1399731683 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044011b30 con 0x7f7048158fb0 2024-08-17T02:26:30.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f70503e5700 1 -- 172.21.15.102:0/1399731683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7048158fb0 msgr2=0x7f7048159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f70503e5700 1 --2- 172.21.15.102:0/1399731683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7048158fb0 0x7f7048159380 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7044009910 tx=0x7f70440091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f70503e5700 1 -- 172.21.15.102:0/1399731683 shutdown_connections 2024-08-17T02:26:30.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f70503e5700 1 --2- 172.21.15.102:0/1399731683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7048158fb0 0x7f7048159380 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f70503e5700 1 -- 172.21.15.102:0/1399731683 >> 172.21.15.102:0/1399731683 conn(0x7f70480c9bf0 msgr2=0x7f704806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f70503e5700 1 -- 172.21.15.102:0/1399731683 shutdown_connections 2024-08-17T02:26:30.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.353+0000 7f70503e5700 1 -- 172.21.15.102:0/1399731683 wait complete. 2024-08-17T02:26:30.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f70503e5700 1 Processor -- start 2024-08-17T02:26:30.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f70503e5700 1 -- start start 2024-08-17T02:26:30.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f70503e5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7048068db0 0x7f704816d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f70503e5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70480c8b70 0x7f704814eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f70503e5700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7048158fb0 0x7f70481544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f70503e5700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7048150070 con 0x7f70480c8b70 2024-08-17T02:26:30.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f70503e5700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704814fbf0 con 0x7f7048068db0 2024-08-17T02:26:30.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f70503e5700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7048150280 con 0x7f7048158fb0 2024-08-17T02:26:30.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f704d980700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70480c8b70 0x7f704814eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f704d980700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70480c8b70 0x7f704814eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43830/0 (socket says 172.21.15.102:43830) 2024-08-17T02:26:30.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f704d980700 1 -- 172.21.15.102:0/1640157589 learned_addr learned my addr 172.21.15.102:0/1640157589 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:30.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f704e181700 1 --2- 172.21.15.102:0/1640157589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7048068db0 0x7f704816d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f704e982700 1 --2- 172.21.15.102:0/1640157589 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7048158fb0 0x7f70481544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f704d980700 1 -- 172.21.15.102:0/1640157589 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7048158fb0 msgr2=0x7f70481544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f704d980700 1 --2- 172.21.15.102:0/1640157589 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7048158fb0 0x7f70481544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f704d980700 1 -- 172.21.15.102:0/1640157589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7048068db0 msgr2=0x7f704816d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f704d980700 1 --2- 172.21.15.102:0/1640157589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7048068db0 0x7f704816d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f704d980700 1 -- 172.21.15.102:0/1640157589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7044009420 con 0x7f70480c8b70 2024-08-17T02:26:30.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f704d980700 1 --2- 172.21.15.102:0/1640157589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70480c8b70 0x7f704814eba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f703800c790 tx=0x7f7038007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f703e7fc700 1 -- 172.21.15.102:0/1640157589 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038010510 con 0x7f70480c8b70 2024-08-17T02:26:30.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f703e7fc700 1 -- 172.21.15.102:0/1640157589 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7038010670 con 0x7f70480c8b70 2024-08-17T02:26:30.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f70503e5700 1 -- 172.21.15.102:0/1640157589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7048150560 con 0x7f70480c8b70 2024-08-17T02:26:30.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f703e7fc700 1 -- 172.21.15.102:0/1640157589 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038010a10 con 0x7f70480c8b70 2024-08-17T02:26:30.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.357+0000 7f70503e5700 1 -- 172.21.15.102:0/1640157589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7048150b20 con 0x7f70480c8b70 2024-08-17T02:26:30.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.361+0000 7f70503e5700 1 -- 172.21.15.102:0/1640157589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7048150d40 con 0x7f70480c8b70 2024-08-17T02:26:30.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.361+0000 7f703e7fc700 1 -- 172.21.15.102:0/1640157589 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f703801b3b0 con 0x7f70480c8b70 2024-08-17T02:26:30.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.361+0000 7f703e7fc700 1 --2- 172.21.15.102:0/1640157589 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f702c060860 0x7f702c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.361+0000 7f704e181700 1 --2- 172.21.15.102:0/1640157589 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f702c060860 0x7f702c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.361+0000 7f703e7fc700 1 -- 172.21.15.102:0/1640157589 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f703807c440 con 0x7f70480c8b70 2024-08-17T02:26:30.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.365+0000 7f704e181700 1 --2- 172.21.15.102:0/1640157589 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f702c060860 0x7f702c062d10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f70440093f0 tx=0x7f7044017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.369+0000 7f703e7fc700 1 -- 172.21.15.102:0/1640157589 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f703804c890 con 0x7f70480c8b70 2024-08-17T02:26:30.451 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:30.453 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:30.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.533+0000 7f70503e5700 1 -- 172.21.15.102:0/1640157589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70480645c0 con 0x7f70480c8b70 2024-08-17T02:26:30.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.533+0000 7f703e7fc700 1 -- 172.21.15.102:0/1640157589 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f703804feb0 con 0x7f70480c8b70 2024-08-17T02:26:30.537 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-08-17T02:26:30.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.537+0000 7f70503e5700 1 -- 172.21.15.102:0/1640157589 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f702c060860 msgr2=0x7f702c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.537+0000 7f70503e5700 1 --2- 172.21.15.102:0/1640157589 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f702c060860 0x7f702c062d10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f70440093f0 tx=0x7f7044017000 comp rx=0 tx=0).stop 2024-08-17T02:26:30.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.537+0000 7f70503e5700 1 -- 172.21.15.102:0/1640157589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70480c8b70 msgr2=0x7f704814eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.537+0000 7f70503e5700 1 --2- 172.21.15.102:0/1640157589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70480c8b70 0x7f704814eba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f703800c790 tx=0x7f7038007e10 comp rx=0 tx=0).stop 2024-08-17T02:26:30.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.537+0000 7f70503e5700 1 -- 172.21.15.102:0/1640157589 shutdown_connections 2024-08-17T02:26:30.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.537+0000 7f70503e5700 1 --2- 172.21.15.102:0/1640157589 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f702c060860 0x7f702c062d10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.537+0000 7f70503e5700 1 --2- 172.21.15.102:0/1640157589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70480c8b70 0x7f704814eba0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.537+0000 7f70503e5700 1 --2- 172.21.15.102:0/1640157589 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7048158fb0 0x7f70481544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.537+0000 7f70503e5700 1 --2- 172.21.15.102:0/1640157589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7048068db0 0x7f704816d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.537+0000 7f70503e5700 1 -- 172.21.15.102:0/1640157589 >> 172.21.15.102:0/1640157589 conn(0x7f70480c9bf0 msgr2=0x7f70480b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.537+0000 7f70503e5700 1 -- 172.21.15.102:0/1640157589 shutdown_connections 2024-08-17T02:26:30.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.537+0000 7f70503e5700 1 -- 172.21.15.102:0/1640157589 wait complete. 2024-08-17T02:26:30.551 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:30.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.653+0000 7fd703579700 1 Processor -- start 2024-08-17T02:26:30.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.653+0000 7fd703579700 1 -- start start 2024-08-17T02:26:30.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.653+0000 7fd703579700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6fc06d2f0 0x7fd6fc06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.653+0000 7fd703579700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd6fc160f30 0x7fd6fc163310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.653+0000 7fd703579700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc0caaa0 con 0x7fd6fc1593e0 2024-08-17T02:26:30.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.653+0000 7fd703579700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6fc0b2f40 con 0x7fd6fc160f30 2024-08-17T02:26:30.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.653+0000 7fd703579700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc06dc80 con 0x7fd6fc06d2f0 2024-08-17T02:26:30.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.653+0000 7fd702d78700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd6fc160f30 0x7fd6fc163310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.653+0000 7fd702d78700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd6fc160f30 0x7fd6fc163310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:49072/0 (socket says 172.21.15.102:49072) 2024-08-17T02:26:30.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.653+0000 7fd702d78700 1 -- 172.21.15.102:0/324607253 learned_addr learned my addr 172.21.15.102:0/324607253 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:30.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.653+0000 7fd702577700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd6fc1593e0 0x7fd6fc0cd5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:36746/0 (socket says 172.21.15.102:36746) 2024-08-17T02:26:30.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.653+0000 7fd701d76700 1 --2- 172.21.15.102:0/324607253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6fc06d2f0 0x7fd6fc06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd702d78700 1 -- 172.21.15.102:0/324607253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6fc06d2f0 msgr2=0x7fd6fc06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:30.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd702d78700 1 --2- 172.21.15.102:0/324607253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6fc06d2f0 0x7fd6fc06d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd702d78700 1 -- 172.21.15.102:0/324607253 >> v1:172.21.15.121:6789/0 conn(0x7fd6fc1593e0 legacy=0x7fd6fc0cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd702d78700 1 -- 172.21.15.102:0/324607253 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc0b2050 con 0x7fd6fc160f30 2024-08-17T02:26:30.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd702d78700 1 --2- 172.21.15.102:0/324607253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc160f30 0x7fd6fc163310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009f20 tx=0x7fd6f4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b92c980cd8b565e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd701575700 1 -- 172.21.15.102:0/324607253 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f400e070 con 0x7fd6fc160f30 2024-08-17T02:26:30.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd701575700 1 -- 172.21.15.102:0/324607253 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f400b9d0 con 0x7fd6fc160f30 2024-08-17T02:26:30.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd701575700 1 -- 172.21.15.102:0/324607253 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f40092e0 con 0x7fd6fc160f30 2024-08-17T02:26:30.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd703579700 1 -- 172.21.15.102:0/324607253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc160f30 msgr2=0x7fd6fc163310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd703579700 1 --2- 172.21.15.102:0/324607253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc160f30 0x7fd6fc163310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009f20 tx=0x7fd6f4009840 comp rx=0 tx=0).stop 2024-08-17T02:26:30.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd703579700 1 -- 172.21.15.102:0/324607253 shutdown_connections 2024-08-17T02:26:30.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd703579700 1 --2- 172.21.15.102:0/324607253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc160f30 0x7fd6fc163310 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd703579700 1 --2- 172.21.15.102:0/324607253 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6fc06d2f0 0x7fd6fc06d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd703579700 1 -- 172.21.15.102:0/324607253 >> 172.21.15.102:0/324607253 conn(0x7fd6fc0ceb30 msgr2=0x7fd6fc06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd703579700 1 -- 172.21.15.102:0/324607253 shutdown_connections 2024-08-17T02:26:30.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd703579700 1 -- 172.21.15.102:0/324607253 wait complete. 2024-08-17T02:26:30.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd703579700 1 Processor -- start 2024-08-17T02:26:30.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.657+0000 7fd703579700 1 -- start start 2024-08-17T02:26:30.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd703579700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc06d2f0 0x7fd6fc15bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd703579700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6fc1593e0 0x7fd6fc0c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd703579700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6fc160f30 0x7fd6fc16ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd703579700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc153f90 con 0x7fd6fc1593e0 2024-08-17T02:26:30.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd703579700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0c8ec0 con 0x7fd6fc06d2f0 2024-08-17T02:26:30.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd703579700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0c91a0 con 0x7fd6fc160f30 2024-08-17T02:26:30.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd701d76700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6fc1593e0 0x7fd6fc0c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd701d76700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6fc1593e0 0x7fd6fc0c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43836/0 (socket says 172.21.15.102:43836) 2024-08-17T02:26:30.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd701d76700 1 -- 172.21.15.102:0/358716699 learned_addr learned my addr 172.21.15.102:0/358716699 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:30.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd702577700 1 --2- 172.21.15.102:0/358716699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc06d2f0 0x7fd6fc15bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd702d78700 1 --2- 172.21.15.102:0/358716699 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6fc160f30 0x7fd6fc16ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd701d76700 1 -- 172.21.15.102:0/358716699 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6fc160f30 msgr2=0x7fd6fc16ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd701d76700 1 --2- 172.21.15.102:0/358716699 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6fc160f30 0x7fd6fc16ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd701d76700 1 -- 172.21.15.102:0/358716699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc06d2f0 msgr2=0x7fd6fc15bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd701d76700 1 --2- 172.21.15.102:0/358716699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc06d2f0 0x7fd6fc15bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd701d76700 1 -- 172.21.15.102:0/358716699 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f4009ae0 con 0x7fd6fc1593e0 2024-08-17T02:26:30.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd702d78700 1 --2- 172.21.15.102:0/358716699 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6fc160f30 0x7fd6fc16ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:30.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd702577700 1 --2- 172.21.15.102:0/358716699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc06d2f0 0x7fd6fc15bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:30.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd701d76700 1 --2- 172.21.15.102:0/358716699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6fc1593e0 0x7fd6fc0c8410 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000e930 tx=0x7fd6f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd6ee7fc700 1 -- 172.21.15.102:0/358716699 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f000eed0 con 0x7fd6fc1593e0 2024-08-17T02:26:30.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd703579700 1 -- 172.21.15.102:0/358716699 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6fc0c9480 con 0x7fd6fc1593e0 2024-08-17T02:26:30.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd6ee7fc700 1 -- 172.21.15.102:0/358716699 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f000c850 con 0x7fd6fc1593e0 2024-08-17T02:26:30.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd6ee7fc700 1 -- 172.21.15.102:0/358716699 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f000cbf0 con 0x7fd6fc1593e0 2024-08-17T02:26:30.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd703579700 1 -- 172.21.15.102:0/358716699 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc0c9b20 con 0x7fd6fc1593e0 2024-08-17T02:26:30.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd703579700 1 -- 172.21.15.102:0/358716699 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc064330 con 0x7fd6fc1593e0 2024-08-17T02:26:30.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.661+0000 7fd6ee7fc700 1 -- 172.21.15.102:0/358716699 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd6f0013470 con 0x7fd6fc1593e0 2024-08-17T02:26:30.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.665+0000 7fd6ee7fc700 1 --2- 172.21.15.102:0/358716699 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd6e0060860 0x7fd6e0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.665+0000 7fd6ee7fc700 1 -- 172.21.15.102:0/358716699 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6f007ce80 con 0x7fd6fc1593e0 2024-08-17T02:26:30.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.665+0000 7fd702577700 1 --2- 172.21.15.102:0/358716699 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd6e0060860 0x7fd6e0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.665+0000 7fd702577700 1 --2- 172.21.15.102:0/358716699 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd6e0060860 0x7fd6e0062d10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8001820 tx=0x7fd6f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.669+0000 7fd6ee7fc700 1 -- 172.21.15.102:0/358716699 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd6f004d230 con 0x7fd6fc1593e0 2024-08-17T02:26:30.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.869+0000 7fd703579700 1 -- 172.21.15.102:0/358716699 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6fc071590 con 0x7fd6fc1593e0 2024-08-17T02:26:30.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.869+0000 7fd6ee7fc700 1 -- 172.21.15.102:0/358716699 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fd6f0050850 con 0x7fd6fc1593e0 2024-08-17T02:26:30.871 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:30.871 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/3384500830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3384500830},{"type":"v1","addr":"172.21.15.121:6833","nonce":3384500830}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1668690087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1668690087},{"type":"v1","addr":"172.21.15.102:6837","nonce":1668690087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/932475255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":932475255},{"type":"v1","addr":"172.21.15.102:6835","nonce":932475255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:55.340445+0000","modified":"2024-08-17T02:25:58.024448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/4026340784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4026340784},{"type":"v1","addr":"172.21.15.121:6835","nonce":4026340784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:30.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.873+0000 7fd703579700 1 -- 172.21.15.102:0/358716699 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd6e0060860 msgr2=0x7fd6e0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.873+0000 7fd703579700 1 --2- 172.21.15.102:0/358716699 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd6e0060860 0x7fd6e0062d10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8001820 tx=0x7fd6f8009040 comp rx=0 tx=0).stop 2024-08-17T02:26:30.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.873+0000 7fd703579700 1 -- 172.21.15.102:0/358716699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6fc1593e0 msgr2=0x7fd6fc0c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.873+0000 7fd703579700 1 --2- 172.21.15.102:0/358716699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6fc1593e0 0x7fd6fc0c8410 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd6f000e930 tx=0x7fd6f00091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.873+0000 7fd703579700 1 -- 172.21.15.102:0/358716699 shutdown_connections 2024-08-17T02:26:30.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.873+0000 7fd703579700 1 --2- 172.21.15.102:0/358716699 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd6e0060860 0x7fd6e0062d10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.873+0000 7fd703579700 1 --2- 172.21.15.102:0/358716699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6fc1593e0 0x7fd6fc0c8410 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.873+0000 7fd703579700 1 --2- 172.21.15.102:0/358716699 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd6fc160f30 0x7fd6fc16ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.873+0000 7fd703579700 1 --2- 172.21.15.102:0/358716699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6fc06d2f0 0x7fd6fc15bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.873+0000 7fd703579700 1 -- 172.21.15.102:0/358716699 >> 172.21.15.102:0/358716699 conn(0x7fd6fc0ceb30 msgr2=0x7fd6fc069270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.873+0000 7fd703579700 1 -- 172.21.15.102:0/358716699 shutdown_connections 2024-08-17T02:26:30.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.873+0000 7fd703579700 1 -- 172.21.15.102:0/358716699 wait complete. 2024-08-17T02:26:30.875 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 6 2024-08-17T02:26:30.886 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:30.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a264fd700 1 Processor -- start 2024-08-17T02:26:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a264fd700 1 -- start start 2024-08-17T02:26:30.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a264fd700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a2015aa30 0x7f2a2015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a264fd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2a200b3b30 0x7f2a200b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a264fd700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2015a820 con 0x7f2a200aac50 2024-08-17T02:26:30.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a264fd700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2015bc90 con 0x7f2a200b3b30 2024-08-17T02:26:30.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a264fd700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200b4490 con 0x7f2a2015aa30 2024-08-17T02:26:30.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1ffff700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2a200aac50 0x7f2a201574a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60158/0 (socket says 172.21.15.102:60158) 2024-08-17T02:26:30.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1ffff700 1 -- 172.21.15.102:0/2145872930 learned_addr learned my addr 172.21.15.102:0/2145872930 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:30.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1effd700 1 -- 172.21.15.102:0/2145872930 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518879922 0 0) 0x7f2a18001290 con 0x7f2a200aac50 2024-08-17T02:26:30.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1effd700 1 -- 172.21.15.102:0/2145872930 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a00003570 con 0x7f2a200aac50 2024-08-17T02:26:30.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a24a9a700 1 --2- 172.21.15.102:0/2145872930 >> v2:172.21.15.121:3300/0 conn(0x7f2a200b3b30 0x7f2a200b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1f7fe700 1 --2- 172.21.15.102:0/2145872930 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a2015aa30 0x7f2a2015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1effd700 1 -- 172.21.15.102:0/2145872930 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1649334394 0 0) 0x7f2a00003570 con 0x7f2a200aac50 2024-08-17T02:26:30.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1effd700 1 -- 172.21.15.102:0/2145872930 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a2015aa30 msgr2=0x7f2a2015a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:30.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1effd700 1 --2- 172.21.15.102:0/2145872930 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a2015aa30 0x7f2a2015a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1effd700 1 -- 172.21.15.102:0/2145872930 >> v2:172.21.15.121:3300/0 conn(0x7f2a200b3b30 msgr2=0x7f2a200b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:30.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1effd700 1 --2- 172.21.15.102:0/2145872930 >> v2:172.21.15.121:3300/0 conn(0x7f2a200b3b30 0x7f2a200b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1effd700 1 -- 172.21.15.102:0/2145872930 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2015b010 con 0x7f2a200aac50 2024-08-17T02:26:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1effd700 1 -- 172.21.15.102:0/2145872930 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7f2a18001780 con 0x7f2a200aac50 2024-08-17T02:26:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1effd700 1 -- 172.21.15.102:0/2145872930 >> v1:172.21.15.102:6789/0 conn(0x7f2a200aac50 legacy=0x7f2a201574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1effd700 1 --2- 172.21.15.102:0/2145872930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a00003a60 0x7f2a00003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1effd700 1 --2- 172.21.15.102:0/2145872930 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a2015aa30 0x7f2a00004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1effd700 1 --2- 172.21.15.102:0/2145872930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a00004d50 0x7f2a000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1effd700 1 -- 172.21.15.102:0/2145872930 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2015bc90 con 0x7f2a00004d50 2024-08-17T02:26:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1effd700 1 -- 172.21.15.102:0/2145872930 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200b4490 con 0x7f2a00003a60 2024-08-17T02:26:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a1effd700 1 -- 172.21.15.102:0/2145872930 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0000bb90 con 0x7f2a2015aa30 2024-08-17T02:26:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.989+0000 7f2a24a9a700 1 --2- 172.21.15.102:0/2145872930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a00004d50 0x7f2a000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a1ffff700 1 --2- 172.21.15.102:0/2145872930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a00003a60 0x7f2a00003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a1f7fe700 1 --2- 172.21.15.102:0/2145872930 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a2015aa30 0x7f2a00004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a24a9a700 1 -- 172.21.15.102:0/2145872930 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a2015aa30 msgr2=0x7f2a00004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a24a9a700 1 --2- 172.21.15.102:0/2145872930 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a2015aa30 0x7f2a00004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a24a9a700 1 -- 172.21.15.102:0/2145872930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a00003a60 msgr2=0x7f2a00003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a24a9a700 1 --2- 172.21.15.102:0/2145872930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a00003a60 0x7f2a00003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a24a9a700 1 -- 172.21.15.102:0/2145872930 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a00003570 con 0x7f2a00004d50 2024-08-17T02:26:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a24a9a700 1 --2- 172.21.15.102:0/2145872930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a00004d50 0x7f2a000051c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800bb90 tx=0x7f2a08008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f815fb5775fc3e67 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a1effd700 1 -- 172.21.15.102:0/2145872930 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0800d5d0 con 0x7f2a00004d50 2024-08-17T02:26:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a1effd700 1 -- 172.21.15.102:0/2145872930 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0800d730 con 0x7f2a00004d50 2024-08-17T02:26:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a1effd700 1 -- 172.21.15.102:0/2145872930 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0800daf0 con 0x7f2a00004d50 2024-08-17T02:26:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a264fd700 1 -- 172.21.15.102:0/2145872930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a00004d50 msgr2=0x7f2a000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a264fd700 1 --2- 172.21.15.102:0/2145872930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a00004d50 0x7f2a000051c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800bb90 tx=0x7f2a08008040 comp rx=0 tx=0).stop 2024-08-17T02:26:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a24a9a700 1 -- 172.21.15.102:0/2145872930 reap_dead start 2024-08-17T02:26:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a264fd700 1 -- 172.21.15.102:0/2145872930 shutdown_connections 2024-08-17T02:26:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a264fd700 1 -- 172.21.15.102:0/2145872930 >> 172.21.15.102:0/2145872930 conn(0x7f2a200994d0 msgr2=0x7f2a200675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a264fd700 1 -- 172.21.15.102:0/2145872930 shutdown_connections 2024-08-17T02:26:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a264fd700 1 -- 172.21.15.102:0/2145872930 wait complete. 2024-08-17T02:26:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a264fd700 1 Processor -- start 2024-08-17T02:26:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.993+0000 7f2a264fd700 1 -- start start 2024-08-17T02:26:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a264fd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a201533f0 0x7f2a200aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a264fd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a200af000 0x7f2a2015c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a264fd700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a2015cd20 0x7f2a200ab020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a264fd700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a20169630 con 0x7f2a200af000 2024-08-17T02:26:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a264fd700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2015d510 con 0x7f2a201533f0 2024-08-17T02:26:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a264fd700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2015d7f0 con 0x7f2a2015cd20 2024-08-17T02:26:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a1f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a200af000 0x7f2a2015c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a1ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a201533f0 0x7f2a200aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a1f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a200af000 0x7f2a2015c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43850/0 (socket says 172.21.15.102:43850) 2024-08-17T02:26:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a1f7fe700 1 -- 172.21.15.102:0/2948522393 learned_addr learned my addr 172.21.15.102:0/2948522393 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:31.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a24a9a700 1 --2- 172.21.15.102:0/2948522393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a2015cd20 0x7f2a200ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a1f7fe700 1 -- 172.21.15.102:0/2948522393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a2015cd20 msgr2=0x7f2a200ab020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a1f7fe700 1 --2- 172.21.15.102:0/2948522393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a2015cd20 0x7f2a200ab020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a1f7fe700 1 -- 172.21.15.102:0/2948522393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a201533f0 msgr2=0x7f2a200aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a1f7fe700 1 --2- 172.21.15.102:0/2948522393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a201533f0 0x7f2a200aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a1f7fe700 1 -- 172.21.15.102:0/2948522393 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2015dad0 con 0x7f2a200af000 2024-08-17T02:26:31.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a1f7fe700 1 --2- 172.21.15.102:0/2948522393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a200af000 0x7f2a2015c7e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2a10002330 tx=0x7f2a1000e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a17fff700 1 -- 172.21.15.102:0/2948522393 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10011040 con 0x7f2a200af000 2024-08-17T02:26:31.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a17fff700 1 -- 172.21.15.102:0/2948522393 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a10016480 con 0x7f2a200af000 2024-08-17T02:26:31.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a17fff700 1 -- 172.21.15.102:0/2948522393 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10016820 con 0x7f2a200af000 2024-08-17T02:26:31.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a264fd700 1 -- 172.21.15.102:0/2948522393 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2015ddb0 con 0x7f2a200af000 2024-08-17T02:26:31.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:30.997+0000 7f2a264fd700 1 -- 172.21.15.102:0/2948522393 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2015d190 con 0x7f2a200af000 2024-08-17T02:26:31.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.001+0000 7f2a264fd700 1 -- 172.21.15.102:0/2948522393 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a201697a0 con 0x7f2a200af000 2024-08-17T02:26:31.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.001+0000 7f2a17fff700 1 -- 172.21.15.102:0/2948522393 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2a10003040 con 0x7f2a200af000 2024-08-17T02:26:31.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.001+0000 7f2a17fff700 1 --2- 172.21.15.102:0/2948522393 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2a04060890 0x7f2a04062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.001+0000 7f2a17fff700 1 -- 172.21.15.102:0/2948522393 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2a1007ca70 con 0x7f2a200af000 2024-08-17T02:26:31.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.001+0000 7f2a1ffff700 1 --2- 172.21.15.102:0/2948522393 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2a04060890 0x7f2a04062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.001+0000 7f2a1ffff700 1 --2- 172.21.15.102:0/2948522393 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2a04060890 0x7f2a04062d40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2a18000fd0 tx=0x7f2a18007ab0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.009+0000 7f2a17fff700 1 -- 172.21.15.102:0/2948522393 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2a1004cf90 con 0x7f2a200af000 2024-08-17T02:26:31.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.169+0000 7f2a264fd700 1 -- 172.21.15.102:0/2948522393 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a200645c0 con 0x7f2a200af000 2024-08-17T02:26:31.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.169+0000 7f2a17fff700 1 -- 172.21.15.102:0/2948522393 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f2a1001b090 con 0x7f2a200af000 2024-08-17T02:26:31.173 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:31.173 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:57.002263+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:53.562223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:54.343618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:31.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.173+0000 7f2a264fd700 1 -- 172.21.15.102:0/2948522393 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2a04060890 msgr2=0x7f2a04062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.173+0000 7f2a264fd700 1 --2- 172.21.15.102:0/2948522393 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2a04060890 0x7f2a04062d40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2a18000fd0 tx=0x7f2a18007ab0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.173+0000 7f2a264fd700 1 -- 172.21.15.102:0/2948522393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a200af000 msgr2=0x7f2a2015c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.173+0000 7f2a264fd700 1 --2- 172.21.15.102:0/2948522393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a200af000 0x7f2a2015c7e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2a10002330 tx=0x7f2a1000e040 comp rx=0 tx=0).stop 2024-08-17T02:26:31.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.173+0000 7f2a264fd700 1 -- 172.21.15.102:0/2948522393 shutdown_connections 2024-08-17T02:26:31.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.173+0000 7f2a264fd700 1 --2- 172.21.15.102:0/2948522393 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2a04060890 0x7f2a04062d40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.173+0000 7f2a264fd700 1 --2- 172.21.15.102:0/2948522393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a200af000 0x7f2a2015c7e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.173+0000 7f2a264fd700 1 --2- 172.21.15.102:0/2948522393 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2a2015cd20 0x7f2a200ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.173+0000 7f2a264fd700 1 --2- 172.21.15.102:0/2948522393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a201533f0 0x7f2a200aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.173+0000 7f2a264fd700 1 -- 172.21.15.102:0/2948522393 >> 172.21.15.102:0/2948522393 conn(0x7f2a200994d0 msgr2=0x7f2a200b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:31.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.173+0000 7f2a264fd700 1 -- 172.21.15.102:0/2948522393 shutdown_connections 2024-08-17T02:26:31.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.173+0000 7f2a264fd700 1 -- 172.21.15.102:0/2948522393 wait complete. 2024-08-17T02:26:31.191 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:26:31.192 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:31.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f5188104700 1 Processor -- start 2024-08-17T02:26:31.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f5188104700 1 -- start start 2024-08-17T02:26:31.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f5188104700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f518015d590 0x7f51800b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f5188104700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f518015d960 0x7f51800aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f5188104700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51800ae660 con 0x7f51800b2ad0 2024-08-17T02:26:31.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f5188104700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51800c9f80 con 0x7f518015d960 2024-08-17T02:26:31.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f5188104700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51800b2fd0 con 0x7f518015d590 2024-08-17T02:26:31.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f518569f700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f518015d960 0x7f51800aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f51866a1700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f51800b2ad0 0x7f5180161270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60164/0 (socket says 172.21.15.102:60164) 2024-08-17T02:26:31.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f51866a1700 1 -- 172.21.15.102:0/1844151582 learned_addr learned my addr 172.21.15.102:0/1844151582 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:31.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f5185ea0700 1 --2- 172.21.15.102:0/1844151582 >> v2:172.21.15.121:3300/0 conn(0x7f518015d590 0x7f51800b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f518569f700 1 -- 172.21.15.102:0/1844151582 >> v2:172.21.15.121:3300/0 conn(0x7f518015d590 msgr2=0x7f51800b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:31.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f518569f700 1 --2- 172.21.15.102:0/1844151582 >> v2:172.21.15.121:3300/0 conn(0x7f518015d590 0x7f51800b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f518569f700 1 -- 172.21.15.102:0/1844151582 >> v1:172.21.15.102:6789/0 conn(0x7f51800b2ad0 legacy=0x7f5180161270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f5184e9e700 1 -- 172.21.15.102:0/1844151582 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403258305 0 0) 0x7f51800ae660 con 0x7f51800b2ad0 2024-08-17T02:26:31.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f518569f700 1 -- 172.21.15.102:0/1844151582 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51800c99c0 con 0x7f518015d960 2024-08-17T02:26:31.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f518569f700 1 --2- 172.21.15.102:0/1844151582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518015d960 0x7f51800aeaf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5180070560 tx=0x7f5178009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4c202836787320 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f5184e9e700 1 -- 172.21.15.102:0/1844151582 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517800e070 con 0x7f518015d960 2024-08-17T02:26:31.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f5184e9e700 1 -- 172.21.15.102:0/1844151582 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517800bb60 con 0x7f518015d960 2024-08-17T02:26:31.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.297+0000 7f5184e9e700 1 -- 172.21.15.102:0/1844151582 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5178012430 con 0x7f518015d960 2024-08-17T02:26:31.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5188104700 1 -- 172.21.15.102:0/1844151582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518015d960 msgr2=0x7f51800aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5188104700 1 --2- 172.21.15.102:0/1844151582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518015d960 0x7f51800aeaf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5180070560 tx=0x7f5178009780 comp rx=0 tx=0).stop 2024-08-17T02:26:31.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5188104700 1 -- 172.21.15.102:0/1844151582 shutdown_connections 2024-08-17T02:26:31.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5188104700 1 --2- 172.21.15.102:0/1844151582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518015d960 0x7f51800aeaf0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5188104700 1 --2- 172.21.15.102:0/1844151582 >> v2:172.21.15.121:3300/0 conn(0x7f518015d590 0x7f51800b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5188104700 1 -- 172.21.15.102:0/1844151582 >> 172.21.15.102:0/1844151582 conn(0x7f51800a9db0 msgr2=0x7f51800ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:31.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5188104700 1 -- 172.21.15.102:0/1844151582 shutdown_connections 2024-08-17T02:26:31.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5188104700 1 -- 172.21.15.102:0/1844151582 wait complete. 2024-08-17T02:26:31.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5188104700 1 Processor -- start 2024-08-17T02:26:31.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5188104700 1 -- start start 2024-08-17T02:26:31.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5188104700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51800b2ad0 0x7f518016e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5188104700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518015d590 0x7f518015b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5188104700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f518015d960 0x7f518015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5188104700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518016f0c0 con 0x7f518015d590 2024-08-17T02:26:31.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5188104700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518009a8f0 con 0x7f518015d960 2024-08-17T02:26:31.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5188104700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51801719e0 con 0x7f51800b2ad0 2024-08-17T02:26:31.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f518569f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518015d590 0x7f518015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f5185ea0700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51800b2ad0 0x7f518016e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f518569f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518015d590 0x7f518015b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43872/0 (socket says 172.21.15.102:43872) 2024-08-17T02:26:31.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f518569f700 1 -- 172.21.15.102:0/3779481696 learned_addr learned my addr 172.21.15.102:0/3779481696 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:31.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.301+0000 7f51866a1700 1 --2- 172.21.15.102:0/3779481696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f518015d960 0x7f518015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.305+0000 7f518569f700 1 -- 172.21.15.102:0/3779481696 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51800b2ad0 msgr2=0x7f518016e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.305+0000 7f518569f700 1 --2- 172.21.15.102:0/3779481696 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51800b2ad0 0x7f518016e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.305+0000 7f518569f700 1 -- 172.21.15.102:0/3779481696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f518015d960 msgr2=0x7f518015b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.305+0000 7f518569f700 1 --2- 172.21.15.102:0/3779481696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f518015d960 0x7f518015b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.305+0000 7f518569f700 1 -- 172.21.15.102:0/3779481696 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5178009a20 con 0x7f518015d590 2024-08-17T02:26:31.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.305+0000 7f518569f700 1 --2- 172.21.15.102:0/3779481696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518015d590 0x7f518015b480 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f51780099f0 tx=0x7f5178019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.305+0000 7f5175ffb700 1 -- 172.21.15.102:0/3779481696 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5178012cd0 con 0x7f518015d590 2024-08-17T02:26:31.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.305+0000 7f5175ffb700 1 -- 172.21.15.102:0/3779481696 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5178012e50 con 0x7f518015d590 2024-08-17T02:26:31.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.305+0000 7f5188104700 1 -- 172.21.15.102:0/3779481696 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5180171cc0 con 0x7f518015d590 2024-08-17T02:26:31.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.305+0000 7f5175ffb700 1 -- 172.21.15.102:0/3779481696 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51780276c0 con 0x7f518015d590 2024-08-17T02:26:31.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.305+0000 7f5188104700 1 -- 172.21.15.102:0/3779481696 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5180172280 con 0x7f518015d590 2024-08-17T02:26:31.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.305+0000 7f5188104700 1 -- 172.21.15.102:0/3779481696 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518016f270 con 0x7f518015d590 2024-08-17T02:26:31.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.305+0000 7f5175ffb700 1 -- 172.21.15.102:0/3779481696 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5178024070 con 0x7f518015d590 2024-08-17T02:26:31.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.309+0000 7f5175ffb700 1 --2- 172.21.15.102:0/3779481696 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f516c060860 0x7f516c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.309+0000 7f5185ea0700 1 --2- 172.21.15.102:0/3779481696 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f516c060860 0x7f516c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.309+0000 7f5175ffb700 1 -- 172.21.15.102:0/3779481696 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f517807f050 con 0x7f518015d590 2024-08-17T02:26:31.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.309+0000 7f5185ea0700 1 --2- 172.21.15.102:0/3779481696 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f516c060860 0x7f516c062d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f517c009d20 tx=0x7f517c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.313+0000 7f5175ffb700 1 -- 172.21.15.102:0/3779481696 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f518016f270 con 0x7f518015d590 2024-08-17T02:26:31.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.513+0000 7f5188104700 1 -- 172.21.15.102:0/3779481696 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51800645c0 con 0x7f518015d590 2024-08-17T02:26:31.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.513+0000 7f5175ffb700 1 -- 172.21.15.102:0/3779481696 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f517804f4a0 con 0x7f518015d590 2024-08-17T02:26:31.516 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:31.516 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/3384500830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3384500830},{"type":"v1","addr":"172.21.15.121:6833","nonce":3384500830}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1668690087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1668690087},{"type":"v1","addr":"172.21.15.102:6837","nonce":1668690087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/932475255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":932475255},{"type":"v1","addr":"172.21.15.102:6835","nonce":932475255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:55.340445+0000","modified":"2024-08-17T02:25:58.024448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/4026340784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4026340784},{"type":"v1","addr":"172.21.15.121:6835","nonce":4026340784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:31.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.517+0000 7f5188104700 1 -- 172.21.15.102:0/3779481696 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f516c060860 msgr2=0x7f516c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.517+0000 7f5188104700 1 --2- 172.21.15.102:0/3779481696 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f516c060860 0x7f516c062d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f517c009d20 tx=0x7f517c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.517+0000 7f5188104700 1 -- 172.21.15.102:0/3779481696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518015d590 msgr2=0x7f518015b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.517+0000 7f5188104700 1 --2- 172.21.15.102:0/3779481696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518015d590 0x7f518015b480 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f51780099f0 tx=0x7f5178019000 comp rx=0 tx=0).stop 2024-08-17T02:26:31.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.517+0000 7f5188104700 1 -- 172.21.15.102:0/3779481696 shutdown_connections 2024-08-17T02:26:31.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.517+0000 7f5188104700 1 --2- 172.21.15.102:0/3779481696 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f516c060860 0x7f516c062d10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.517+0000 7f5188104700 1 --2- 172.21.15.102:0/3779481696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518015d590 0x7f518015b480 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.517+0000 7f5188104700 1 --2- 172.21.15.102:0/3779481696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f518015d960 0x7f518015b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.517+0000 7f5188104700 1 --2- 172.21.15.102:0/3779481696 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f51800b2ad0 0x7f518016e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.517+0000 7f5188104700 1 -- 172.21.15.102:0/3779481696 >> 172.21.15.102:0/3779481696 conn(0x7f51800a9db0 msgr2=0x7f518015fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:31.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.517+0000 7f5188104700 1 -- 172.21.15.102:0/3779481696 shutdown_connections 2024-08-17T02:26:31.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.517+0000 7f5188104700 1 -- 172.21.15.102:0/3779481696 wait complete. 2024-08-17T02:26:31.520 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 6 2024-08-17T02:26:31.530 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:31.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc70173a700 1 Processor -- start 2024-08-17T02:26:31.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc70173a700 1 -- start start 2024-08-17T02:26:31.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc70173a700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc6fc142780 0x7fc6fc0ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc70173a700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc6fc142b50 0x7fc6fc0ca910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc70173a700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6fc0ca510 con 0x7fc6fc0aef00 2024-08-17T02:26:31.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc70173a700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6fc0c9900 con 0x7fc6fc142780 2024-08-17T02:26:31.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc70173a700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6fc0c9be0 con 0x7fc6fc142b50 2024-08-17T02:26:31.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc6fbfff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc6fc142780 0x7fc6fc0ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc6fbfff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc6fc142780 0x7fc6fc0ae9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60112/0 (socket says 172.21.15.102:60112) 2024-08-17T02:26:31.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc6fbfff700 1 -- 172.21.15.102:0/2635203498 learned_addr learned my addr 172.21.15.102:0/2635203498 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:31.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc6fb7fe700 1 --2- 172.21.15.102:0/2635203498 >> v2:172.21.15.121:3300/0 conn(0x7fc6fc142b50 0x7fc6fc0ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc6fbfff700 1 -- 172.21.15.102:0/2635203498 >> v2:172.21.15.121:3300/0 conn(0x7fc6fc142b50 msgr2=0x7fc6fc0ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:31.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc6fbfff700 1 --2- 172.21.15.102:0/2635203498 >> v2:172.21.15.121:3300/0 conn(0x7fc6fc142b50 0x7fc6fc0ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc6fbfff700 1 -- 172.21.15.102:0/2635203498 >> v1:172.21.15.102:6789/0 conn(0x7fc6fc0aef00 legacy=0x7fc6fc1596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc6fbfff700 1 -- 172.21.15.102:0/2635203498 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc0c9ec0 con 0x7fc6fc142780 2024-08-17T02:26:31.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc6fb7fe700 1 --2- 172.21.15.102:0/2635203498 >> v2:172.21.15.121:3300/0 conn(0x7fc6fc142b50 0x7fc6fc0ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:31.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc6fbfff700 1 --2- 172.21.15.102:0/2635203498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6fc142780 0x7fc6fc0ae9c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0b3090 tx=0x7fc6e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c389e5c296724ac9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc6faffd700 1 -- 172.21.15.102:0/2635203498 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e400b860 con 0x7fc6fc142780 2024-08-17T02:26:31.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc6faffd700 1 -- 172.21.15.102:0/2635203498 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e400b9c0 con 0x7fc6fc142780 2024-08-17T02:26:31.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc6faffd700 1 -- 172.21.15.102:0/2635203498 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e400bd60 con 0x7fc6fc142780 2024-08-17T02:26:31.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc70173a700 1 -- 172.21.15.102:0/2635203498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6fc142780 msgr2=0x7fc6fc0ae9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc70173a700 1 --2- 172.21.15.102:0/2635203498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6fc142780 0x7fc6fc0ae9c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0b3090 tx=0x7fc6e4009250 comp rx=0 tx=0).stop 2024-08-17T02:26:31.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc70173a700 1 -- 172.21.15.102:0/2635203498 shutdown_connections 2024-08-17T02:26:31.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc70173a700 1 --2- 172.21.15.102:0/2635203498 >> v2:172.21.15.121:3300/0 conn(0x7fc6fc142b50 0x7fc6fc0ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc70173a700 1 --2- 172.21.15.102:0/2635203498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6fc142780 0x7fc6fc0ae9c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc70173a700 1 -- 172.21.15.102:0/2635203498 >> 172.21.15.102:0/2635203498 conn(0x7fc6fc06e070 msgr2=0x7fc6fc0b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:31.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc70173a700 1 -- 172.21.15.102:0/2635203498 shutdown_connections 2024-08-17T02:26:31.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.633+0000 7fc70173a700 1 -- 172.21.15.102:0/2635203498 wait complete. 2024-08-17T02:26:31.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.637+0000 7fc70173a700 1 Processor -- start 2024-08-17T02:26:31.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.637+0000 7fc70173a700 1 -- start start 2024-08-17T02:26:31.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.637+0000 7fc70173a700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6fc0aef00 0x7fc6fc13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.637+0000 7fc70173a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6fc142780 0x7fc6fc155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.637+0000 7fc70173a700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6fc142b50 0x7fc6fc137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.637+0000 7fc70173a700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc138960 con 0x7fc6fc142b50 2024-08-17T02:26:31.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.637+0000 7fc70173a700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc13c270 con 0x7fc6fc142780 2024-08-17T02:26:31.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.637+0000 7fc70173a700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc13a7c0 con 0x7fc6fc0aef00 2024-08-17T02:26:31.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.637+0000 7fc700f39700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6fc142b50 0x7fc6fc137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.637+0000 7fc700f39700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6fc142b50 0x7fc6fc137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60128/0 (socket says 172.21.15.102:60128) 2024-08-17T02:26:31.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.637+0000 7fc700f39700 1 -- 172.21.15.102:0/3960196195 learned_addr learned my addr 172.21.15.102:0/3960196195 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:31.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.637+0000 7fc6fb7fe700 1 --2- 172.21.15.102:0/3960196195 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6fc142780 0x7fc6fc155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.637+0000 7fc6fbfff700 1 --2- 172.21.15.102:0/3960196195 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6fc0aef00 0x7fc6fc13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.641+0000 7fc700f39700 1 -- 172.21.15.102:0/3960196195 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6fc0aef00 msgr2=0x7fc6fc13bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.641+0000 7fc700f39700 1 --2- 172.21.15.102:0/3960196195 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6fc0aef00 0x7fc6fc13bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.641+0000 7fc700f39700 1 -- 172.21.15.102:0/3960196195 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6fc142780 msgr2=0x7fc6fc155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.641+0000 7fc700f39700 1 --2- 172.21.15.102:0/3960196195 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6fc142780 0x7fc6fc155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.641+0000 7fc700f39700 1 -- 172.21.15.102:0/3960196195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e40094f0 con 0x7fc6fc142b50 2024-08-17T02:26:31.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.641+0000 7fc700f39700 1 --2- 172.21.15.102:0/3960196195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6fc142b50 0x7fc6fc137ac0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00c590 tx=0x7fc6ec007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.641+0000 7fc6f3fff700 1 -- 172.21.15.102:0/3960196195 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec011590 con 0x7fc6fc142b50 2024-08-17T02:26:31.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.641+0000 7fc6f3fff700 1 -- 172.21.15.102:0/3960196195 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ec0116f0 con 0x7fc6fc142b50 2024-08-17T02:26:31.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.641+0000 7fc70173a700 1 -- 172.21.15.102:0/3960196195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6fc0b0080 con 0x7fc6fc142b50 2024-08-17T02:26:31.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.641+0000 7fc6f3fff700 1 -- 172.21.15.102:0/3960196195 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec011ab0 con 0x7fc6fc142b50 2024-08-17T02:26:31.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.641+0000 7fc70173a700 1 -- 172.21.15.102:0/3960196195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6fc0b0320 con 0x7fc6fc142b50 2024-08-17T02:26:31.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.641+0000 7fc70173a700 1 -- 172.21.15.102:0/3960196195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6fc0638f0 con 0x7fc6fc142b50 2024-08-17T02:26:31.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.641+0000 7fc6f3fff700 1 -- 172.21.15.102:0/3960196195 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc6ec01b3b0 con 0x7fc6fc142b50 2024-08-17T02:26:31.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.641+0000 7fc6f3fff700 1 --2- 172.21.15.102:0/3960196195 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc6dc060860 0x7fc6dc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.641+0000 7fc6fbfff700 1 --2- 172.21.15.102:0/3960196195 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc6dc060860 0x7fc6dc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.641+0000 7fc6f3fff700 1 -- 172.21.15.102:0/3960196195 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc6ec07bf20 con 0x7fc6fc142b50 2024-08-17T02:26:31.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.645+0000 7fc6fbfff700 1 --2- 172.21.15.102:0/3960196195 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc6dc060860 0x7fc6dc062d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0b3090 tx=0x7fc6e4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.653+0000 7fc6f3fff700 1 -- 172.21.15.102:0/3960196195 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc6ec04c370 con 0x7fc6fc142b50 2024-08-17T02:26:31.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.853+0000 7fc70173a700 1 -- 172.21.15.102:0/3960196195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6fc0ae570 con 0x7fc6fc142b50 2024-08-17T02:26:31.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.853+0000 7fc6f3fff700 1 -- 172.21.15.102:0/3960196195 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fc6ec017090 con 0x7fc6fc142b50 2024-08-17T02:26:31.856 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:31.857 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/3384500830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":3384500830},{"type":"v1","addr":"172.21.15.121:6833","nonce":3384500830}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4214,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1668690087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1668690087},{"type":"v1","addr":"172.21.15.102:6837","nonce":1668690087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/932475255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":932475255},{"type":"v1","addr":"172.21.15.102:6835","nonce":932475255}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:55.340445+0000","modified":"2024-08-17T02:25:58.024448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6835/4026340784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":4026340784},{"type":"v1","addr":"172.21.15.121:6835","nonce":4026340784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:31.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.857+0000 7fc70173a700 1 -- 172.21.15.102:0/3960196195 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc6dc060860 msgr2=0x7fc6dc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.857+0000 7fc70173a700 1 --2- 172.21.15.102:0/3960196195 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc6dc060860 0x7fc6dc062d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0b3090 tx=0x7fc6e4017000 comp rx=0 tx=0).stop 2024-08-17T02:26:31.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.857+0000 7fc70173a700 1 -- 172.21.15.102:0/3960196195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6fc142b50 msgr2=0x7fc6fc137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.857+0000 7fc70173a700 1 --2- 172.21.15.102:0/3960196195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6fc142b50 0x7fc6fc137ac0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec00c590 tx=0x7fc6ec007ec0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.857+0000 7fc70173a700 1 -- 172.21.15.102:0/3960196195 shutdown_connections 2024-08-17T02:26:31.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.857+0000 7fc70173a700 1 --2- 172.21.15.102:0/3960196195 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc6dc060860 0x7fc6dc062d10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.857+0000 7fc70173a700 1 --2- 172.21.15.102:0/3960196195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6fc142b50 0x7fc6fc137ac0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.857+0000 7fc70173a700 1 --2- 172.21.15.102:0/3960196195 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6fc142780 0x7fc6fc155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.857+0000 7fc70173a700 1 --2- 172.21.15.102:0/3960196195 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc6fc0aef00 0x7fc6fc13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.857+0000 7fc70173a700 1 -- 172.21.15.102:0/3960196195 >> 172.21.15.102:0/3960196195 conn(0x7fc6fc06e070 msgr2=0x7fc6fc141560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:31.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.857+0000 7fc70173a700 1 -- 172.21.15.102:0/3960196195 shutdown_connections 2024-08-17T02:26:31.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.857+0000 7fc70173a700 1 -- 172.21.15.102:0/3960196195 wait complete. 2024-08-17T02:26:31.860 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 6 2024-08-17T02:26:31.871 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:31.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.973+0000 7f0d808e0700 1 Processor -- start 2024-08-17T02:26:31.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.973+0000 7f0d808e0700 1 -- start start 2024-08-17T02:26:31.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d808e0700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0d7c0cd1b0 0x7f0d7c1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d808e0700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0d7c15a190 0x7f0d7c15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d808e0700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7c15a610 con 0x7f0d7c153320 2024-08-17T02:26:31.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d808e0700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7c0ce430 con 0x7f0d7c0cd1b0 2024-08-17T02:26:31.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d808e0700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7c15dbd0 con 0x7f0d7c15a190 2024-08-17T02:26:31.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d73fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0d7c0cd1b0 0x7f0d7c1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d73fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0d7c0cd1b0 0x7f0d7c1536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60138/0 (socket says 172.21.15.102:60138) 2024-08-17T02:26:31.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d73fff700 1 -- 172.21.15.102:0/2205697939 learned_addr learned my addr 172.21.15.102:0/2205697939 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:31.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d7ad9d700 1 --1- 172.21.15.102:0/2205697939 >> v1:172.21.15.102:6789/0 conn(0x7f0d7c153320 0x7f0d7c0ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:58494/0 (socket says 172.21.15.102:58494) 2024-08-17T02:26:31.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d7b59e700 1 --2- 172.21.15.102:0/2205697939 >> v2:172.21.15.121:3300/0 conn(0x7f0d7c15a190 0x7f0d7c15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d73fff700 1 -- 172.21.15.102:0/2205697939 >> v2:172.21.15.121:3300/0 conn(0x7f0d7c15a190 msgr2=0x7f0d7c15cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:31.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d73fff700 1 --2- 172.21.15.102:0/2205697939 >> v2:172.21.15.121:3300/0 conn(0x7f0d7c15a190 0x7f0d7c15cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d73fff700 1 -- 172.21.15.102:0/2205697939 >> v1:172.21.15.102:6789/0 conn(0x7f0d7c153320 legacy=0x7f0d7c0ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d73fff700 1 -- 172.21.15.102:0/2205697939 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c15d370 con 0x7f0d7c0cd1b0 2024-08-17T02:26:31.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d73fff700 1 --2- 172.21.15.102:0/2205697939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d7c0cd1b0 0x7f0d7c1536f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0d640099b0 tx=0x7f0d64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375835da230f1cbb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d7a59c700 1 -- 172.21.15.102:0/2205697939 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6400b820 con 0x7f0d7c0cd1b0 2024-08-17T02:26:31.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d7a59c700 1 -- 172.21.15.102:0/2205697939 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6400b980 con 0x7f0d7c0cd1b0 2024-08-17T02:26:31.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d7a59c700 1 -- 172.21.15.102:0/2205697939 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6400bd20 con 0x7f0d7c0cd1b0 2024-08-17T02:26:31.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d808e0700 1 -- 172.21.15.102:0/2205697939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d7c0cd1b0 msgr2=0x7f0d7c1536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d808e0700 1 --2- 172.21.15.102:0/2205697939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d7c0cd1b0 0x7f0d7c1536f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0d640099b0 tx=0x7f0d64009250 comp rx=0 tx=0).stop 2024-08-17T02:26:31.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d808e0700 1 -- 172.21.15.102:0/2205697939 shutdown_connections 2024-08-17T02:26:31.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d808e0700 1 --2- 172.21.15.102:0/2205697939 >> v2:172.21.15.121:3300/0 conn(0x7f0d7c15a190 0x7f0d7c15cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d808e0700 1 --2- 172.21.15.102:0/2205697939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d7c0cd1b0 0x7f0d7c1536f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d808e0700 1 -- 172.21.15.102:0/2205697939 >> 172.21.15.102:0/2205697939 conn(0x7f0d7c0d00a0 msgr2=0x7f0d7c0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:31.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d808e0700 1 -- 172.21.15.102:0/2205697939 shutdown_connections 2024-08-17T02:26:31.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.977+0000 7f0d808e0700 1 -- 172.21.15.102:0/2205697939 wait complete. 2024-08-17T02:26:31.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d808e0700 1 Processor -- start 2024-08-17T02:26:31.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d808e0700 1 -- start start 2024-08-17T02:26:31.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d808e0700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d7c0cd1b0 0x7f0d7c0b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d808e0700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d7c153320 0x7f0d7c150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d808e0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d7c15a190 0x7f0d7c0c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d808e0700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0c7b10 con 0x7f0d7c0cd1b0 2024-08-17T02:26:31.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d808e0700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c15eb20 con 0x7f0d7c15a190 2024-08-17T02:26:31.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d808e0700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0b12a0 con 0x7f0d7c153320 2024-08-17T02:26:31.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d7ad9d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d7c0cd1b0 0x7f0d7c0b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d7ad9d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d7c0cd1b0 0x7f0d7c0b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60140/0 (socket says 172.21.15.102:60140) 2024-08-17T02:26:31.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d7ad9d700 1 -- 172.21.15.102:0/3331514224 learned_addr learned my addr 172.21.15.102:0/3331514224 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:31.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d73fff700 1 --2- 172.21.15.102:0/3331514224 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d7c153320 0x7f0d7c150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d7b59e700 1 --2- 172.21.15.102:0/3331514224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d7c15a190 0x7f0d7c0c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d7ad9d700 1 -- 172.21.15.102:0/3331514224 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d7c153320 msgr2=0x7f0d7c150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d7ad9d700 1 --2- 172.21.15.102:0/3331514224 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d7c153320 0x7f0d7c150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d7ad9d700 1 -- 172.21.15.102:0/3331514224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d7c15a190 msgr2=0x7f0d7c0c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d7ad9d700 1 --2- 172.21.15.102:0/3331514224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d7c15a190 0x7f0d7c0c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d7ad9d700 1 -- 172.21.15.102:0/3331514224 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d640094f0 con 0x7f0d7c0cd1b0 2024-08-17T02:26:31.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d7ad9d700 1 --2- 172.21.15.102:0/3331514224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d7c0cd1b0 0x7f0d7c0b0cc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00c7c0 tx=0x7f0d6c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d72ffd700 1 -- 172.21.15.102:0/3331514224 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c005a70 con 0x7f0d7c0cd1b0 2024-08-17T02:26:31.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d72ffd700 1 -- 172.21.15.102:0/3331514224 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c005bf0 con 0x7f0d7c0cd1b0 2024-08-17T02:26:31.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d808e0700 1 -- 172.21.15.102:0/3331514224 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7c15e4d0 con 0x7f0d7c0cd1b0 2024-08-17T02:26:31.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d72ffd700 1 -- 172.21.15.102:0/3331514224 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0070f0 con 0x7f0d7c0cd1b0 2024-08-17T02:26:31.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.981+0000 7f0d808e0700 1 -- 172.21.15.102:0/3331514224 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7c0b39e0 con 0x7f0d7c0cd1b0 2024-08-17T02:26:31.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.985+0000 7f0d808e0700 1 -- 172.21.15.102:0/3331514224 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7c0638f0 con 0x7f0d7c0cd1b0 2024-08-17T02:26:31.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.985+0000 7f0d72ffd700 1 -- 172.21.15.102:0/3331514224 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0d6c007460 con 0x7f0d7c0cd1b0 2024-08-17T02:26:31.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.985+0000 7f0d72ffd700 1 --2- 172.21.15.102:0/3331514224 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d5c060890 0x7f0d5c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.985+0000 7f0d73fff700 1 --2- 172.21.15.102:0/3331514224 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d5c060890 0x7f0d5c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.985+0000 7f0d72ffd700 1 -- 172.21.15.102:0/3331514224 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0d6c07c650 con 0x7f0d7c0cd1b0 2024-08-17T02:26:31.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.989+0000 7f0d73fff700 1 --2- 172.21.15.102:0/3331514224 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d5c060890 0x7f0d5c062d40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0cd5b0 tx=0x7f0d64017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:31.993+0000 7f0d72ffd700 1 -- 172.21.15.102:0/3331514224 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0d6c04cb20 con 0x7f0d7c0cd1b0 2024-08-17T02:26:32.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.157+0000 7f0d808e0700 1 -- 172.21.15.102:0/3331514224 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d7c0cde20 con 0x7f0d7c0cd1b0 2024-08-17T02:26:32.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.161+0000 7f0d72ffd700 1 -- 172.21.15.102:0/3331514224 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f0d6c050140 con 0x7f0d7c0cd1b0 2024-08-17T02:26:32.164 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:32.164 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:25:57.002263+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:53.562223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:54.343618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:32.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.161+0000 7f0d808e0700 1 -- 172.21.15.102:0/3331514224 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d5c060890 msgr2=0x7f0d5c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.161+0000 7f0d808e0700 1 --2- 172.21.15.102:0/3331514224 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d5c060890 0x7f0d5c062d40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0cd5b0 tx=0x7f0d64017000 comp rx=0 tx=0).stop 2024-08-17T02:26:32.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.161+0000 7f0d808e0700 1 -- 172.21.15.102:0/3331514224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d7c0cd1b0 msgr2=0x7f0d7c0b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.161+0000 7f0d808e0700 1 --2- 172.21.15.102:0/3331514224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d7c0cd1b0 0x7f0d7c0b0cc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00c7c0 tx=0x7f0d6c007f70 comp rx=0 tx=0).stop 2024-08-17T02:26:32.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.165+0000 7f0d808e0700 1 -- 172.21.15.102:0/3331514224 shutdown_connections 2024-08-17T02:26:32.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.165+0000 7f0d808e0700 1 --2- 172.21.15.102:0/3331514224 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0d5c060890 0x7f0d5c062d40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.165+0000 7f0d808e0700 1 --2- 172.21.15.102:0/3331514224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d7c15a190 0x7f0d7c0c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.165+0000 7f0d808e0700 1 --2- 172.21.15.102:0/3331514224 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0d7c153320 0x7f0d7c150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.165+0000 7f0d808e0700 1 --2- 172.21.15.102:0/3331514224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d7c0cd1b0 0x7f0d7c0b0cc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.165+0000 7f0d808e0700 1 -- 172.21.15.102:0/3331514224 >> 172.21.15.102:0/3331514224 conn(0x7f0d7c0d00a0 msgr2=0x7f0d7c15acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.165+0000 7f0d808e0700 1 -- 172.21.15.102:0/3331514224 shutdown_connections 2024-08-17T02:26:32.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.165+0000 7f0d808e0700 1 -- 172.21.15.102:0/3331514224 wait complete. 2024-08-17T02:26:32.185 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:26:32.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.293+0000 7fe017956700 1 Processor -- start 2024-08-17T02:26:32.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.293+0000 7fe017956700 1 -- start start 2024-08-17T02:26:32.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.293+0000 7fe017956700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe010153a70 0x7fe010159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.293+0000 7fe017956700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe01006e9c0 0x7fe010158260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.293+0000 7fe017956700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe010157810 con 0x7fe010153e40 2024-08-17T02:26:32.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.293+0000 7fe017956700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe010157dd0 con 0x7fe010153a70 2024-08-17T02:26:32.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.293+0000 7fe017956700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01015a700 con 0x7fe01006e9c0 2024-08-17T02:26:32.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.293+0000 7fe015ef3700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe01006e9c0 0x7fe010158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.293+0000 7fe0156f2700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe010153a70 0x7fe010159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.293+0000 7fe015ef3700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe01006e9c0 0x7fe010158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:42414/0 (socket says 172.21.15.102:42414) 2024-08-17T02:26:32.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.293+0000 7fe014ef1700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe010153e40 0x7fe01006e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:49882/0 (socket says 172.21.15.102:49882) 2024-08-17T02:26:32.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.293+0000 7fe015ef3700 1 -- 172.21.15.102:0/636178091 learned_addr learned my addr 172.21.15.102:0/636178091 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:32.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.293+0000 7fe00ffff700 1 -- 172.21.15.102:0/636178091 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197881259 0 0) 0x7fe010157810 con 0x7fe010153e40 2024-08-17T02:26:32.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe00ffff700 1 -- 172.21.15.102:0/636178091 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff8003570 con 0x7fe010153e40 2024-08-17T02:26:32.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe015ef3700 1 -- 172.21.15.102:0/636178091 >> v2:172.21.15.121:3300/0 conn(0x7fe010153a70 msgr2=0x7fe010159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:32.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe015ef3700 1 --2- 172.21.15.102:0/636178091 >> v2:172.21.15.121:3300/0 conn(0x7fe010153a70 0x7fe010159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe015ef3700 1 -- 172.21.15.102:0/636178091 >> v1:172.21.15.121:6789/0 conn(0x7fe010153e40 legacy=0x7fe01006e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe015ef3700 1 -- 172.21.15.102:0/636178091 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01015a9e0 con 0x7fe01006e9c0 2024-08-17T02:26:32.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe0156f2700 1 --2- 172.21.15.102:0/636178091 >> v2:172.21.15.121:3300/0 conn(0x7fe010153a70 0x7fe010159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:32.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe015ef3700 1 --2- 172.21.15.102:0/636178091 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe01006e9c0 0x7fe010158260 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe0080099b0 tx=0x7fe008009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9299570f57e27ae6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe00ffff700 1 -- 172.21.15.102:0/636178091 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00800b680 con 0x7fe01006e9c0 2024-08-17T02:26:32.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe00ffff700 1 -- 172.21.15.102:0/636178091 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00800b7e0 con 0x7fe01006e9c0 2024-08-17T02:26:32.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe00ffff700 1 -- 172.21.15.102:0/636178091 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00800bb60 con 0x7fe01006e9c0 2024-08-17T02:26:32.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe017956700 1 -- 172.21.15.102:0/636178091 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe01006e9c0 msgr2=0x7fe010158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe017956700 1 --2- 172.21.15.102:0/636178091 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe01006e9c0 0x7fe010158260 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe0080099b0 tx=0x7fe008009250 comp rx=0 tx=0).stop 2024-08-17T02:26:32.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe017956700 1 -- 172.21.15.102:0/636178091 shutdown_connections 2024-08-17T02:26:32.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe017956700 1 --2- 172.21.15.102:0/636178091 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe01006e9c0 0x7fe010158260 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe017956700 1 --2- 172.21.15.102:0/636178091 >> v2:172.21.15.121:3300/0 conn(0x7fe010153a70 0x7fe010159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe017956700 1 -- 172.21.15.102:0/636178091 >> 172.21.15.102:0/636178091 conn(0x7fe010067810 msgr2=0x7fe010067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe017956700 1 -- 172.21.15.102:0/636178091 shutdown_connections 2024-08-17T02:26:32.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe017956700 1 -- 172.21.15.102:0/636178091 wait complete. 2024-08-17T02:26:32.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe017956700 1 Processor -- start 2024-08-17T02:26:32.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.297+0000 7fe017956700 1 -- start start 2024-08-17T02:26:32.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe017956700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe01006e9c0 0x7fe0101552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe017956700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe010153a70 0x7fe010155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe017956700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe010153e40 0x7fe010167430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe017956700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe010099220 con 0x7fe01006e9c0 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe017956700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0101681b0 con 0x7fe010153e40 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe017956700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe010098bd0 con 0x7fe010153a70 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe0156f2700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe01006e9c0 0x7fe0101552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe0156f2700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe01006e9c0 0x7fe0101552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60146/0 (socket says 172.21.15.102:60146) 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe0156f2700 1 -- 172.21.15.102:0/288275876 learned_addr learned my addr 172.21.15.102:0/288275876 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe015ef3700 1 --2- 172.21.15.102:0/288275876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe010153e40 0x7fe010167430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe014ef1700 1 --2- 172.21.15.102:0/288275876 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe010153a70 0x7fe010155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe0156f2700 1 -- 172.21.15.102:0/288275876 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe010153a70 msgr2=0x7fe010155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe0156f2700 1 --2- 172.21.15.102:0/288275876 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe010153a70 0x7fe010155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe0156f2700 1 -- 172.21.15.102:0/288275876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe010153e40 msgr2=0x7fe010167430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe0156f2700 1 --2- 172.21.15.102:0/288275876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe010153e40 0x7fe010167430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe0156f2700 1 -- 172.21.15.102:0/288275876 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe004009420 con 0x7fe01006e9c0 2024-08-17T02:26:32.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe0156f2700 1 --2- 172.21.15.102:0/288275876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe01006e9c0 0x7fe0101552e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe00400ec80 tx=0x7fe0040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe00d7fa700 1 -- 172.21.15.102:0/288275876 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00400c920 con 0x7fe01006e9c0 2024-08-17T02:26:32.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe00d7fa700 1 -- 172.21.15.102:0/288275876 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00400ca80 con 0x7fe01006e9c0 2024-08-17T02:26:32.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe017956700 1 -- 172.21.15.102:0/288275876 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0080094f0 con 0x7fe01006e9c0 2024-08-17T02:26:32.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe00d7fa700 1 -- 172.21.15.102:0/288275876 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00400ce00 con 0x7fe01006e9c0 2024-08-17T02:26:32.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.301+0000 7fe017956700 1 -- 172.21.15.102:0/288275876 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0100987f0 con 0x7fe01006e9c0 2024-08-17T02:26:32.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.305+0000 7fe017956700 1 -- 172.21.15.102:0/288275876 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0100645c0 con 0x7fe01006e9c0 2024-08-17T02:26:32.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.305+0000 7fe00d7fa700 1 -- 172.21.15.102:0/288275876 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe004013680 con 0x7fe01006e9c0 2024-08-17T02:26:32.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.305+0000 7fe00d7fa700 1 --2- 172.21.15.102:0/288275876 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fdffc060860 0x7fdffc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.305+0000 7fe014ef1700 1 --2- 172.21.15.102:0/288275876 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fdffc060860 0x7fdffc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.305+0000 7fe00d7fa700 1 -- 172.21.15.102:0/288275876 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe00407d2a0 con 0x7fe01006e9c0 2024-08-17T02:26:32.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.305+0000 7fe014ef1700 1 --2- 172.21.15.102:0/288275876 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fdffc060860 0x7fdffc062d10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe0100b18e0 tx=0x7fe000000f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.317+0000 7fe00d7fa700 1 -- 172.21.15.102:0/288275876 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe00404d6f0 con 0x7fe01006e9c0 2024-08-17T02:26:32.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.513+0000 7fe017956700 1 -- 172.21.15.102:0/288275876 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe01014bc00 con 0x7fe01006e9c0 2024-08-17T02:26:32.518 INFO:tasks.ceph.mon.a.smithi102.stderr:2024-08-17T02:26:32.517+0000 7fd2c6a69700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:26:32.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.525+0000 7fe00d7fa700 1 -- 172.21.15.102:0/288275876 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe004050d10 con 0x7fe01006e9c0 2024-08-17T02:26:32.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.529+0000 7fe017956700 1 -- 172.21.15.102:0/288275876 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fdffc060860 msgr2=0x7fdffc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.529+0000 7fe017956700 1 --2- 172.21.15.102:0/288275876 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fdffc060860 0x7fdffc062d10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe0100b18e0 tx=0x7fe000000f40 comp rx=0 tx=0).stop 2024-08-17T02:26:32.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.529+0000 7fe017956700 1 -- 172.21.15.102:0/288275876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe01006e9c0 msgr2=0x7fe0101552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.529+0000 7fe017956700 1 --2- 172.21.15.102:0/288275876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe01006e9c0 0x7fe0101552e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe00400ec80 tx=0x7fe0040091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.529+0000 7fe017956700 1 -- 172.21.15.102:0/288275876 shutdown_connections 2024-08-17T02:26:32.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.529+0000 7fe017956700 1 --2- 172.21.15.102:0/288275876 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fdffc060860 0x7fdffc062d10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.529+0000 7fe017956700 1 --2- 172.21.15.102:0/288275876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe010153e40 0x7fe010167430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.529+0000 7fe017956700 1 --2- 172.21.15.102:0/288275876 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe010153a70 0x7fe010155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.529+0000 7fe017956700 1 --2- 172.21.15.102:0/288275876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe01006e9c0 0x7fe0101552e0 secure :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe00400ec80 tx=0x7fe0040091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.529+0000 7fe017956700 1 -- 172.21.15.102:0/288275876 >> 172.21.15.102:0/288275876 conn(0x7fe010067810 msgr2=0x7fe01006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.529+0000 7fe017956700 1 -- 172.21.15.102:0/288275876 shutdown_connections 2024-08-17T02:26:32.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.529+0000 7fe017956700 1 -- 172.21.15.102:0/288275876 wait complete. 2024-08-17T02:26:32.534 INFO:tasks.ceph.mds.b.smithi121.stderr: -2269> 2024-08-17T02:26:00.348+0000 7fd531fb2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:32.534 INFO:teuthology.orchestra.run.smithi102.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:26:32.545 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:26:32.562 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-08-17T02:26:32.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.649+0000 7fa683fff700 1 Processor -- start 2024-08-17T02:26:32.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.649+0000 7fa683fff700 1 -- start start 2024-08-17T02:26:32.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa683fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa6841590b0 0x7fa684066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa683fff700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6840ce210 con 0x7fa684159480 2024-08-17T02:26:32.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa683fff700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68415dc20 con 0x7fa6840cd2b0 2024-08-17T02:26:32.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa683fff700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6840cba00 con 0x7fa6841590b0 2024-08-17T02:26:32.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa682ffd700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa6841590b0 0x7fa684066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa6827fc700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa684159480 0x7fa68415ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:58496/0 (socket says 172.21.15.102:58496) 2024-08-17T02:26:32.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa6827fc700 1 -- 172.21.15.102:0/3750147835 learned_addr learned my addr 172.21.15.102:0/3750147835 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:32.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa681ffb700 1 -- 172.21.15.102:0/3750147835 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176280806 0 0) 0x7fa6840ce210 con 0x7fa684159480 2024-08-17T02:26:32.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa681ffb700 1 -- 172.21.15.102:0/3750147835 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa66c003570 con 0x7fa684159480 2024-08-17T02:26:32.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa681ffb700 1 -- 172.21.15.102:0/3750147835 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 542839508 0 0) 0x7fa66c003570 con 0x7fa684159480 2024-08-17T02:26:32.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa682ffd700 1 -- 172.21.15.102:0/3750147835 >> v1:172.21.15.121:6789/0 conn(0x7fa6840cd2b0 legacy=0x7fa68415d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa682ffd700 1 -- 172.21.15.102:0/3750147835 >> v1:172.21.15.102:6789/0 conn(0x7fa684159480 legacy=0x7fa68415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa682ffd700 1 -- 172.21.15.102:0/3750147835 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6840cb440 con 0x7fa6841590b0 2024-08-17T02:26:32.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa682ffd700 1 --2- 172.21.15.102:0/3750147835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6841590b0 0x7fa684066e00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa6780098e0 tx=0x7fa6780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5396c50250669690 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa681ffb700 1 -- 172.21.15.102:0/3750147835 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674001470 con 0x7fa6841590b0 2024-08-17T02:26:32.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa681ffb700 1 -- 172.21.15.102:0/3750147835 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa678011420 con 0x7fa6841590b0 2024-08-17T02:26:32.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa681ffb700 1 -- 172.21.15.102:0/3750147835 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6780117c0 con 0x7fa6841590b0 2024-08-17T02:26:32.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa683fff700 1 -- 172.21.15.102:0/3750147835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6841590b0 msgr2=0x7fa684066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa683fff700 1 --2- 172.21.15.102:0/3750147835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6841590b0 0x7fa684066e00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa6780098e0 tx=0x7fa6780091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa683fff700 1 -- 172.21.15.102:0/3750147835 shutdown_connections 2024-08-17T02:26:32.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa683fff700 1 --2- 172.21.15.102:0/3750147835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6841590b0 0x7fa684066e00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa683fff700 1 -- 172.21.15.102:0/3750147835 >> 172.21.15.102:0/3750147835 conn(0x7fa6840d0b90 msgr2=0x7fa6840ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa683fff700 1 -- 172.21.15.102:0/3750147835 shutdown_connections 2024-08-17T02:26:32.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.653+0000 7fa683fff700 1 -- 172.21.15.102:0/3750147835 wait complete. 2024-08-17T02:26:32.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa683fff700 1 Processor -- start 2024-08-17T02:26:32.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa683fff700 1 -- start start 2024-08-17T02:26:32.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa683fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6840cd2b0 0x7fa6840c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa683fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6841590b0 0x7fa684154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa683fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa684159480 0x7fa6840c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa683fff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840c90e0 con 0x7fa6840cd2b0 2024-08-17T02:26:32.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa683fff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840c8ab0 con 0x7fa684159480 2024-08-17T02:26:32.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa683fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68415b170 con 0x7fa6841590b0 2024-08-17T02:26:32.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa682ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6840cd2b0 0x7fa6840c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa682ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6840cd2b0 0x7fa6840c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60164/0 (socket says 172.21.15.102:60164) 2024-08-17T02:26:32.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa682ffd700 1 -- 172.21.15.102:0/3935312673 learned_addr learned my addr 172.21.15.102:0/3935312673 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:32.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa6827fc700 1 --2- 172.21.15.102:0/3935312673 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6841590b0 0x7fa684154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa6837fe700 1 --2- 172.21.15.102:0/3935312673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa684159480 0x7fa6840c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa682ffd700 1 -- 172.21.15.102:0/3935312673 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6841590b0 msgr2=0x7fa684154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa682ffd700 1 --2- 172.21.15.102:0/3935312673 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6841590b0 0x7fa684154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa682ffd700 1 -- 172.21.15.102:0/3935312673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa684159480 msgr2=0x7fa6840c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa682ffd700 1 --2- 172.21.15.102:0/3935312673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa684159480 0x7fa6840c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa682ffd700 1 -- 172.21.15.102:0/3935312673 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa678009420 con 0x7fa6840cd2b0 2024-08-17T02:26:32.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa6837fe700 1 --2- 172.21.15.102:0/3935312673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa684159480 0x7fa6840c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:32.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa682ffd700 1 --2- 172.21.15.102:0/3935312673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6840cd2b0 0x7fa6840c8570 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa684069480 tx=0x7fa678016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa66affd700 1 -- 172.21.15.102:0/3935312673 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67801cba0 con 0x7fa6840cd2b0 2024-08-17T02:26:32.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa66affd700 1 -- 172.21.15.102:0/3935312673 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67801cd00 con 0x7fa6840cd2b0 2024-08-17T02:26:32.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa683fff700 1 -- 172.21.15.102:0/3935312673 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68415abb0 con 0x7fa6840cd2b0 2024-08-17T02:26:32.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa66affd700 1 -- 172.21.15.102:0/3935312673 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67801a6a0 con 0x7fa6840cd2b0 2024-08-17T02:26:32.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.657+0000 7fa683fff700 1 -- 172.21.15.102:0/3935312673 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6840c8d70 con 0x7fa6840cd2b0 2024-08-17T02:26:32.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.661+0000 7fa683fff700 1 -- 172.21.15.102:0/3935312673 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa684064330 con 0x7fa6840cd2b0 2024-08-17T02:26:32.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.661+0000 7fa66affd700 1 -- 172.21.15.102:0/3935312673 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa67801aa50 con 0x7fa6840cd2b0 2024-08-17T02:26:32.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.661+0000 7fa66affd700 1 --2- 172.21.15.102:0/3935312673 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa670060860 0x7fa670062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.661+0000 7fa66affd700 1 -- 172.21.15.102:0/3935312673 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fa67807e5c0 con 0x7fa6840cd2b0 2024-08-17T02:26:32.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.661+0000 7fa6827fc700 1 --2- 172.21.15.102:0/3935312673 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa670060860 0x7fa670062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.661+0000 7fa6827fc700 1 --2- 172.21.15.102:0/3935312673 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa670060860 0x7fa670062d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa6840cfd80 tx=0x7fa674000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.669+0000 7fa66affd700 1 -- 172.21.15.102:0/3935312673 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa67804e9c0 con 0x7fa6840cd2b0 2024-08-17T02:26:32.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:32.869+0000 7fa683fff700 1 -- 172.21.15.102:0/3935312673 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa684070cf0 con 0x7fa6840cd2b0 2024-08-17T02:26:33.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.533+0000 7fa66affd700 1 -- 172.21.15.102:0/3935312673 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa678051fe0 con 0x7fa6840cd2b0 2024-08-17T02:26:33.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.537+0000 7fa683fff700 1 -- 172.21.15.102:0/3935312673 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa670060860 msgr2=0x7fa670062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.537+0000 7fa683fff700 1 --2- 172.21.15.102:0/3935312673 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa670060860 0x7fa670062d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa6840cfd80 tx=0x7fa674000bc0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.537+0000 7fa683fff700 1 -- 172.21.15.102:0/3935312673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6840cd2b0 msgr2=0x7fa6840c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.537+0000 7fa683fff700 1 --2- 172.21.15.102:0/3935312673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6840cd2b0 0x7fa6840c8570 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa684069480 tx=0x7fa678016000 comp rx=0 tx=0).stop 2024-08-17T02:26:33.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.537+0000 7fa683fff700 1 -- 172.21.15.102:0/3935312673 shutdown_connections 2024-08-17T02:26:33.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.537+0000 7fa683fff700 1 --2- 172.21.15.102:0/3935312673 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa670060860 0x7fa670062d10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.537+0000 7fa683fff700 1 --2- 172.21.15.102:0/3935312673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa684159480 0x7fa6840c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.537+0000 7fa683fff700 1 --2- 172.21.15.102:0/3935312673 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6841590b0 0x7fa684154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.537+0000 7fa683fff700 1 --2- 172.21.15.102:0/3935312673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6840cd2b0 0x7fa6840c8570 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.537+0000 7fa683fff700 1 -- 172.21.15.102:0/3935312673 >> 172.21.15.102:0/3935312673 conn(0x7fa6840d0b90 msgr2=0x7fa684155ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:33.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.541+0000 7fa683fff700 1 -- 172.21.15.102:0/3935312673 shutdown_connections 2024-08-17T02:26:33.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.541+0000 7fa683fff700 1 -- 172.21.15.102:0/3935312673 wait complete. 2024-08-17T02:26:33.557 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:26:33.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.677+0000 7f69eb59e700 1 Processor -- start 2024-08-17T02:26:33.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.677+0000 7f69eb59e700 1 -- start start 2024-08-17T02:26:33.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69eb59e700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f69ec0b26d0 0x7f69ec0b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69eb59e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f69ec0c5fd0 0x7f69ec0c6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69eb59e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ec0c5b40 con 0x7f69ec0c6990 2024-08-17T02:26:33.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69eb59e700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ec0b2aa0 con 0x7f69ec0b26d0 2024-08-17T02:26:33.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69eb59e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ec159820 con 0x7f69ec0c5fd0 2024-08-17T02:26:33.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69ea59c700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f69ec0b26d0 0x7f69ec0b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69ea59c700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f69ec0b26d0 0x7f69ec0b2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60170/0 (socket says 172.21.15.102:60170) 2024-08-17T02:26:33.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69ea59c700 1 -- 172.21.15.102:0/3412911235 learned_addr learned my addr 172.21.15.102:0/3412911235 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:33.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69e9d9b700 1 --2- 172.21.15.102:0/3412911235 >> v2:172.21.15.121:3300/0 conn(0x7f69ec0c5fd0 0x7f69ec0c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69ea59c700 1 -- 172.21.15.102:0/3412911235 >> v2:172.21.15.121:3300/0 conn(0x7f69ec0c5fd0 msgr2=0x7f69ec0c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:33.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69ea59c700 1 --2- 172.21.15.102:0/3412911235 >> v2:172.21.15.121:3300/0 conn(0x7f69ec0c5fd0 0x7f69ec0c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69ea59c700 1 -- 172.21.15.102:0/3412911235 >> v1:172.21.15.121:6789/0 conn(0x7f69ec0c6990 legacy=0x7f69ec0cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69ea59c700 1 -- 172.21.15.102:0/3412911235 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec0c4f30 con 0x7f69ec0b26d0 2024-08-17T02:26:33.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69ea59c700 1 --2- 172.21.15.102:0/3412911235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69ec0b26d0 0x7f69ec0b2e90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f69e00099b0 tx=0x7f69e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9874c6b5d3aebaa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69e959a700 1 -- 172.21.15.102:0/3412911235 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0009ea0 con 0x7f69ec0b26d0 2024-08-17T02:26:33.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69e959a700 1 -- 172.21.15.102:0/3412911235 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e000b820 con 0x7f69ec0b26d0 2024-08-17T02:26:33.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69e959a700 1 -- 172.21.15.102:0/3412911235 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000bbc0 con 0x7f69ec0b26d0 2024-08-17T02:26:33.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69eb59e700 1 -- 172.21.15.102:0/3412911235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69ec0b26d0 msgr2=0x7f69ec0b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69eb59e700 1 --2- 172.21.15.102:0/3412911235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69ec0b26d0 0x7f69ec0b2e90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f69e00099b0 tx=0x7f69e0009250 comp rx=0 tx=0).stop 2024-08-17T02:26:33.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69eb59e700 1 -- 172.21.15.102:0/3412911235 shutdown_connections 2024-08-17T02:26:33.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69eb59e700 1 --2- 172.21.15.102:0/3412911235 >> v2:172.21.15.121:3300/0 conn(0x7f69ec0c5fd0 0x7f69ec0c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69eb59e700 1 --2- 172.21.15.102:0/3412911235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69ec0b26d0 0x7f69ec0b2e90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69eb59e700 1 -- 172.21.15.102:0/3412911235 >> 172.21.15.102:0/3412911235 conn(0x7f69ec067590 msgr2=0x7f69ec0d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:33.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69eb59e700 1 -- 172.21.15.102:0/3412911235 shutdown_connections 2024-08-17T02:26:33.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.681+0000 7f69eb59e700 1 -- 172.21.15.102:0/3412911235 wait complete. 2024-08-17T02:26:33.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.685+0000 7f69eb59e700 1 Processor -- start 2024-08-17T02:26:33.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.685+0000 7f69eb59e700 1 -- start start 2024-08-17T02:26:33.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.685+0000 7f69eb59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69ec0c5fd0 0x7f69ec15ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.685+0000 7f69eb59e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69ec0c6990 0x7f69ec169220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.685+0000 7f69eb59e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69ec158250 0x7f69ec0c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.685+0000 7f69eb59e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec15c3d0 con 0x7f69ec0c6990 2024-08-17T02:26:33.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.685+0000 7f69eb59e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec158a90 con 0x7f69ec158250 2024-08-17T02:26:33.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.685+0000 7f69eb59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec15d6b0 con 0x7f69ec0c5fd0 2024-08-17T02:26:33.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.685+0000 7f69e9d9b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69ec0c6990 0x7f69ec169220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.685+0000 7f69ea59c700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69ec0c5fd0 0x7f69ec15ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.685+0000 7f69e9d9b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69ec0c6990 0x7f69ec169220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60180/0 (socket says 172.21.15.102:60180) 2024-08-17T02:26:33.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.685+0000 7f69ea59c700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69ec0c5fd0 0x7f69ec15ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:42452/0 (socket says 172.21.15.102:42452) 2024-08-17T02:26:33.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.685+0000 7f69ea59c700 1 -- 172.21.15.102:0/3794065134 learned_addr learned my addr 172.21.15.102:0/3794065134 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:33.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.685+0000 7f69ead9d700 1 --2- 172.21.15.102:0/3794065134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69ec158250 0x7f69ec0c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.689+0000 7f69ea59c700 1 -- 172.21.15.102:0/3794065134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69ec158250 msgr2=0x7f69ec0c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.689+0000 7f69ea59c700 1 --2- 172.21.15.102:0/3794065134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69ec158250 0x7f69ec0c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.689+0000 7f69ea59c700 1 -- 172.21.15.102:0/3794065134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69ec0c6990 msgr2=0x7f69ec169220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.689+0000 7f69ea59c700 1 --2- 172.21.15.102:0/3794065134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69ec0c6990 0x7f69ec169220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.689+0000 7f69ea59c700 1 -- 172.21.15.102:0/3794065134 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e00094f0 con 0x7f69ec0c5fd0 2024-08-17T02:26:33.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.689+0000 7f69e9d9b700 1 --2- 172.21.15.102:0/3794065134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69ec0c6990 0x7f69ec169220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:33.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.689+0000 7f69ea59c700 1 --2- 172.21.15.102:0/3794065134 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69ec0c5fd0 0x7f69ec15ba40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f69e00094c0 tx=0x7f69e0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.689+0000 7f69da7fc700 1 -- 172.21.15.102:0/3794065134 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000b990 con 0x7f69ec0c5fd0 2024-08-17T02:26:33.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.689+0000 7f69da7fc700 1 -- 172.21.15.102:0/3794065134 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e000bb10 con 0x7f69ec0c5fd0 2024-08-17T02:26:33.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.689+0000 7f69eb59e700 1 -- 172.21.15.102:0/3794065134 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ec15c620 con 0x7f69ec0c5fd0 2024-08-17T02:26:33.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.689+0000 7f69da7fc700 1 -- 172.21.15.102:0/3794065134 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0011670 con 0x7f69ec0c5fd0 2024-08-17T02:26:33.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.689+0000 7f69eb59e700 1 -- 172.21.15.102:0/3794065134 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ec15d950 con 0x7f69ec0c5fd0 2024-08-17T02:26:33.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.689+0000 7f69eb59e700 1 -- 172.21.15.102:0/3794065134 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ec15db40 con 0x7f69ec0c5fd0 2024-08-17T02:26:33.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.689+0000 7f69da7fc700 1 -- 172.21.15.102:0/3794065134 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f69e0046b20 con 0x7f69ec0c5fd0 2024-08-17T02:26:33.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.693+0000 7f69da7fc700 1 --2- 172.21.15.102:0/3794065134 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f69cc060860 0x7f69cc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.693+0000 7f69da7fc700 1 -- 172.21.15.102:0/3794065134 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f69e007e4e0 con 0x7f69ec0c5fd0 2024-08-17T02:26:33.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.693+0000 7f69e9d9b700 1 --2- 172.21.15.102:0/3794065134 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f69cc060860 0x7f69cc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.693+0000 7f69e9d9b700 1 --2- 172.21.15.102:0/3794065134 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f69cc060860 0x7f69cc062d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0b3b40 tx=0x7f69dc009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.701+0000 7f69da7fc700 1 -- 172.21.15.102:0/3794065134 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f69e004e960 con 0x7f69ec0c5fd0 2024-08-17T02:26:33.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:33.865+0000 7f69eb59e700 1 -- 172.21.15.102:0/3794065134 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f69ec0644b0 con 0x7f69ec0c5fd0 2024-08-17T02:26:34.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.537+0000 7f69da7fc700 1 -- 172.21.15.102:0/3794065134 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f69e0051f80 con 0x7f69ec0c5fd0 2024-08-17T02:26:34.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.545+0000 7f69eb59e700 1 -- 172.21.15.102:0/3794065134 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f69cc060860 msgr2=0x7f69cc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.545+0000 7f69eb59e700 1 --2- 172.21.15.102:0/3794065134 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f69cc060860 0x7f69cc062d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0b3b40 tx=0x7f69dc009120 comp rx=0 tx=0).stop 2024-08-17T02:26:34.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.545+0000 7f69eb59e700 1 -- 172.21.15.102:0/3794065134 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69ec0c5fd0 msgr2=0x7f69ec15ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.545+0000 7f69eb59e700 1 --2- 172.21.15.102:0/3794065134 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69ec0c5fd0 0x7f69ec15ba40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f69e00094c0 tx=0x7f69e0017000 comp rx=0 tx=0).stop 2024-08-17T02:26:34.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.545+0000 7f69eb59e700 1 -- 172.21.15.102:0/3794065134 shutdown_connections 2024-08-17T02:26:34.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.545+0000 7f69eb59e700 1 --2- 172.21.15.102:0/3794065134 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f69cc060860 0x7f69cc062d10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.545+0000 7f69eb59e700 1 --2- 172.21.15.102:0/3794065134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69ec0c6990 0x7f69ec169220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.545+0000 7f69eb59e700 1 --2- 172.21.15.102:0/3794065134 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69ec158250 0x7f69ec0c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.545+0000 7f69eb59e700 1 --2- 172.21.15.102:0/3794065134 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f69ec0c5fd0 0x7f69ec15ba40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.545+0000 7f69eb59e700 1 -- 172.21.15.102:0/3794065134 >> 172.21.15.102:0/3794065134 conn(0x7f69ec067590 msgr2=0x7f69ec0b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.545+0000 7f69eb59e700 1 -- 172.21.15.102:0/3794065134 shutdown_connections 2024-08-17T02:26:34.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.545+0000 7f69eb59e700 1 -- 172.21.15.102:0/3794065134 wait complete. 2024-08-17T02:26:34.550 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:26:34.562 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:26:34.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7dd52e700 1 Processor -- start 2024-08-17T02:26:34.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7dd52e700 1 -- start start 2024-08-17T02:26:34.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7dd52e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff7d813fbc0 0x7ff7d80ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7dd52e700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d80b0660 con 0x7ff7d806f1d0 2024-08-17T02:26:34.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7dd52e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d80afd30 con 0x7ff7d813f7f0 2024-08-17T02:26:34.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7dd52e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d80abdc0 con 0x7ff7d813fbc0 2024-08-17T02:26:34.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d77fe700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff7d806f1d0 0x7ff7d8156700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:58502/0 (socket says 172.21.15.102:58502) 2024-08-17T02:26:34.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d77fe700 1 -- 172.21.15.102:0/3910001694 learned_addr learned my addr 172.21.15.102:0/3910001694 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:34.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7dcd2d700 1 --2- 172.21.15.102:0/3910001694 >> v2:172.21.15.121:3300/0 conn(0x7ff7d813fbc0 0x7ff7d80ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 -- 172.21.15.102:0/3910001694 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554391531 0 0) 0x7ff7d80b0660 con 0x7ff7d806f1d0 2024-08-17T02:26:34.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 -- 172.21.15.102:0/3910001694 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c4003570 con 0x7ff7d806f1d0 2024-08-17T02:26:34.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 -- 172.21.15.102:0/3910001694 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 471422375 0 0) 0x7ff7c4003570 con 0x7ff7d806f1d0 2024-08-17T02:26:34.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 -- 172.21.15.102:0/3910001694 >> v2:172.21.15.121:3300/0 conn(0x7ff7d813fbc0 msgr2=0x7ff7d80ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 --2- 172.21.15.102:0/3910001694 >> v2:172.21.15.121:3300/0 conn(0x7ff7d813fbc0 0x7ff7d80ab6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 -- 172.21.15.102:0/3910001694 >> v1:172.21.15.121:6789/0 conn(0x7ff7d813f7f0 legacy=0x7ff7d806eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 -- 172.21.15.102:0/3910001694 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d80b0010 con 0x7ff7d806f1d0 2024-08-17T02:26:34.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 -- 172.21.15.102:0/3910001694 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7ff7c0001470 con 0x7ff7d806f1d0 2024-08-17T02:26:34.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 -- 172.21.15.102:0/3910001694 >> v1:172.21.15.102:6789/0 conn(0x7ff7d806f1d0 legacy=0x7ff7d8156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 --2- 172.21.15.102:0/3910001694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c4003a60 0x7ff7c4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 --2- 172.21.15.102:0/3910001694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7c4004810 0x7ff7c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 --2- 172.21.15.102:0/3910001694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c40051c0 0x7ff7c400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 -- 172.21.15.102:0/3910001694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80abdc0 con 0x7ff7c4004810 2024-08-17T02:26:34.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 -- 172.21.15.102:0/3910001694 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c400c160 con 0x7ff7c4003a60 2024-08-17T02:26:34.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 -- 172.21.15.102:0/3910001694 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c400c320 con 0x7ff7c40051c0 2024-08-17T02:26:34.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d77fe700 1 --2- 172.21.15.102:0/3910001694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7c4004810 0x7ff7c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d7fff700 1 --2- 172.21.15.102:0/3910001694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c4003a60 0x7ff7c4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7dcd2d700 1 --2- 172.21.15.102:0/3910001694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c40051c0 0x7ff7c400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d77fe700 1 -- 172.21.15.102:0/3910001694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c40051c0 msgr2=0x7ff7c400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d77fe700 1 --2- 172.21.15.102:0/3910001694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c40051c0 0x7ff7c400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d77fe700 1 -- 172.21.15.102:0/3910001694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c4003a60 msgr2=0x7ff7c4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d77fe700 1 --2- 172.21.15.102:0/3910001694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c4003a60 0x7ff7c4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d77fe700 1 -- 172.21.15.102:0/3910001694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c4003570 con 0x7ff7c4004810 2024-08-17T02:26:34.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7dcd2d700 1 --2- 172.21.15.102:0/3910001694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7c40051c0 0x7ff7c400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:34.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7dcd2d700 1 -- 172.21.15.102:0/3910001694 reap_dead start 2024-08-17T02:26:34.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d77fe700 1 --2- 172.21.15.102:0/3910001694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7c4004810 0x7ff7c4004c80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff7d806f5d0 tx=0x7ff7c0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8637ea5d6919698 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 -- 172.21.15.102:0/3910001694 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c000cbb0 con 0x7ff7c4004810 2024-08-17T02:26:34.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 -- 172.21.15.102:0/3910001694 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c000cd10 con 0x7ff7c4004810 2024-08-17T02:26:34.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.673+0000 7ff7d6ffd700 1 -- 172.21.15.102:0/3910001694 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0005b50 con 0x7ff7c4004810 2024-08-17T02:26:34.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.677+0000 7ff7dd52e700 1 -- 172.21.15.102:0/3910001694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7c4004810 msgr2=0x7ff7c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.677+0000 7ff7dd52e700 1 --2- 172.21.15.102:0/3910001694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7c4004810 0x7ff7c4004c80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff7d806f5d0 tx=0x7ff7c0001e50 comp rx=0 tx=0).stop 2024-08-17T02:26:34.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.677+0000 7ff7dd52e700 1 -- 172.21.15.102:0/3910001694 shutdown_connections 2024-08-17T02:26:34.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.677+0000 7ff7dd52e700 1 --2- 172.21.15.102:0/3910001694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7c4004810 0x7ff7c4004c80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.677+0000 7ff7dd52e700 1 -- 172.21.15.102:0/3910001694 >> 172.21.15.102:0/3910001694 conn(0x7ff7d8066e00 msgr2=0x7ff7d8067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.677+0000 7ff7dd52e700 1 -- 172.21.15.102:0/3910001694 shutdown_connections 2024-08-17T02:26:34.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.677+0000 7ff7dd52e700 1 -- 172.21.15.102:0/3910001694 wait complete. 2024-08-17T02:26:34.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.677+0000 7ff7dd52e700 1 Processor -- start 2024-08-17T02:26:34.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.677+0000 7ff7dd52e700 1 -- start start 2024-08-17T02:26:34.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dd52e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c4004810 0x7ff7d816a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dd52e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7d80a9860 0x7ff7d815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dd52e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7d806d9b0 0x7ff7d806de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dd52e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80aa8e0 con 0x7ff7d806d9b0 2024-08-17T02:26:34.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dd52e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d806e340 con 0x7ff7c4004810 2024-08-17T02:26:34.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dd52e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80c17e0 con 0x7ff7d80a9860 2024-08-17T02:26:34.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dcd2d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7d806d9b0 0x7ff7d806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dcd2d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7d806d9b0 0x7ff7d806de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60192/0 (socket says 172.21.15.102:60192) 2024-08-17T02:26:34.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dcd2d700 1 -- 172.21.15.102:0/3673768680 learned_addr learned my addr 172.21.15.102:0/3673768680 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:34.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7d77fe700 1 --2- 172.21.15.102:0/3673768680 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7d80a9860 0x7ff7d815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7d7fff700 1 --2- 172.21.15.102:0/3673768680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c4004810 0x7ff7d816a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dcd2d700 1 -- 172.21.15.102:0/3673768680 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7d80a9860 msgr2=0x7ff7d815c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dcd2d700 1 --2- 172.21.15.102:0/3673768680 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7d80a9860 0x7ff7d815c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dcd2d700 1 -- 172.21.15.102:0/3673768680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c4004810 msgr2=0x7ff7d816a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dcd2d700 1 --2- 172.21.15.102:0/3673768680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c4004810 0x7ff7d816a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dcd2d700 1 -- 172.21.15.102:0/3673768680 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d816a930 con 0x7ff7d806d9b0 2024-08-17T02:26:34.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dcd2d700 1 --2- 172.21.15.102:0/3673768680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7d806d9b0 0x7ff7d806de00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80ae2e0 tx=0x7ff7d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7cffff700 1 -- 172.21.15.102:0/3673768680 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d001b070 con 0x7ff7d806d9b0 2024-08-17T02:26:34.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7cffff700 1 -- 172.21.15.102:0/3673768680 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d000f040 con 0x7ff7d806d9b0 2024-08-17T02:26:34.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dd52e700 1 -- 172.21.15.102:0/3673768680 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d80a9d60 con 0x7ff7d806d9b0 2024-08-17T02:26:34.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7cffff700 1 -- 172.21.15.102:0/3673768680 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d000e050 con 0x7ff7d806d9b0 2024-08-17T02:26:34.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.681+0000 7ff7dd52e700 1 -- 172.21.15.102:0/3673768680 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d80aa320 con 0x7ff7d806d9b0 2024-08-17T02:26:34.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.685+0000 7ff7dd52e700 1 -- 172.21.15.102:0/3673768680 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d815abd0 con 0x7ff7d806d9b0 2024-08-17T02:26:34.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.685+0000 7ff7cffff700 1 -- 172.21.15.102:0/3673768680 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff7d0003020 con 0x7ff7d806d9b0 2024-08-17T02:26:34.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.685+0000 7ff7cffff700 1 --2- 172.21.15.102:0/3673768680 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff7b8060860 0x7ff7b8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.685+0000 7ff7d7fff700 1 --2- 172.21.15.102:0/3673768680 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff7b8060860 0x7ff7b8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.685+0000 7ff7cffff700 1 -- 172.21.15.102:0/3673768680 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5353+0+0 (secure 0 0 0) 0x7ff7d007ce40 con 0x7ff7d806d9b0 2024-08-17T02:26:34.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.685+0000 7ff7d7fff700 1 --2- 172.21.15.102:0/3673768680 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff7b8060860 0x7ff7b8062d10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8000c00 tx=0x7ff7c8007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.693+0000 7ff7cffff700 1 -- 172.21.15.102:0/3673768680 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff7d815abd0 con 0x7ff7d806d9b0 2024-08-17T02:26:34.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:34.853+0000 7ff7dd52e700 1 -- 172.21.15.102:0/3673768680 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff7d815abd0 con 0x7ff7d806d9b0 2024-08-17T02:26:35.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.549+0000 7ff7cffff700 1 -- 172.21.15.102:0/3673768680 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff7d815abd0 con 0x7ff7d806d9b0 2024-08-17T02:26:35.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.553+0000 7ff7dd52e700 1 -- 172.21.15.102:0/3673768680 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff7b8060860 msgr2=0x7ff7b8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.553+0000 7ff7dd52e700 1 --2- 172.21.15.102:0/3673768680 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff7b8060860 0x7ff7b8062d10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8000c00 tx=0x7ff7c8007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:35.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.553+0000 7ff7dd52e700 1 -- 172.21.15.102:0/3673768680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7d806d9b0 msgr2=0x7ff7d806de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.553+0000 7ff7dd52e700 1 --2- 172.21.15.102:0/3673768680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7d806d9b0 0x7ff7d806de00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80ae2e0 tx=0x7ff7d000b040 comp rx=0 tx=0).stop 2024-08-17T02:26:35.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.553+0000 7ff7dd52e700 1 -- 172.21.15.102:0/3673768680 shutdown_connections 2024-08-17T02:26:35.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.553+0000 7ff7dd52e700 1 --2- 172.21.15.102:0/3673768680 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff7b8060860 0x7ff7b8062d10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.553+0000 7ff7dd52e700 1 --2- 172.21.15.102:0/3673768680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7d806d9b0 0x7ff7d806de00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.553+0000 7ff7dd52e700 1 --2- 172.21.15.102:0/3673768680 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff7d80a9860 0x7ff7d815c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.553+0000 7ff7dd52e700 1 --2- 172.21.15.102:0/3673768680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7c4004810 0x7ff7d816a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.553+0000 7ff7dd52e700 1 -- 172.21.15.102:0/3673768680 >> 172.21.15.102:0/3673768680 conn(0x7ff7d8066e00 msgr2=0x7ff7d806adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.553+0000 7ff7dd52e700 1 -- 172.21.15.102:0/3673768680 shutdown_connections 2024-08-17T02:26:35.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.553+0000 7ff7dd52e700 1 -- 172.21.15.102:0/3673768680 wait complete. 2024-08-17T02:26:35.558 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data' removed 2024-08-17T02:26:35.570 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:26:35.570 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:26:35.574 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:26:35.574 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:35.574 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:26:35.575 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:26:35.575 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:26:35.575 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:35.575 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:26:35.575 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:26:35.575 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:26:35.575 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:35.576 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:26:35.576 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:26:35.576 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:26:35.576 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:35.585 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:26:35.586 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:26:35.586 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:26:35.587 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:26:35.588 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:26:35.588 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:26:35.589 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:26:35.589 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:26:35.590 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:26:35.590 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:35.591 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:26:35.591 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:35.631 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:26:35.631 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:35.631 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:26:35.631 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:35.632 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:26:35.658 INFO:tasks.ceph.mds.c.smithi102.stdout:starting mds.c at 2024-08-17T02:26:35.662 INFO:tasks.ceph.mds.a.smithi102.stdout:starting mds.a at 2024-08-17T02:26:35.707 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-08-17T02:26:35.710 INFO:tasks.ceph.mds.d.smithi121.stdout:starting mds.d at 2024-08-17T02:26:35.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.737+0000 7fa5f7c5c700 1 Processor -- start 2024-08-17T02:26:35.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.737+0000 7fa5f7c5c700 1 -- start start 2024-08-17T02:26:35.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.737+0000 7fa5f7c5c700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f0159340 0x7fa5f0159710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.737+0000 7fa5f7c5c700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f00b1cf0 con 0x7fa5f0159c50 2024-08-17T02:26:35.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.737+0000 7fa5f7c5c700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f00b60d0 con 0x7fa5f00b4330 2024-08-17T02:26:35.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.737+0000 7fa5f7c5c700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00b10e0 con 0x7fa5f0159340 2024-08-17T02:26:35.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.737+0000 7fa5f51f7700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa5f0159c50 0x7fa5f00b3c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:58544/0 (socket says 172.21.15.102:58544) 2024-08-17T02:26:35.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.737+0000 7fa5f51f7700 1 -- 172.21.15.102:0/184198460 learned_addr learned my addr 172.21.15.102:0/184198460 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:35.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.737+0000 7fa5f59f8700 1 --2- 172.21.15.102:0/184198460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f0159340 0x7fa5f0159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.737+0000 7fa5f49f6700 1 -- 172.21.15.102:0/184198460 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058787584 0 0) 0x7fa5f00b1cf0 con 0x7fa5f0159c50 2024-08-17T02:26:35.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.737+0000 7fa5f49f6700 1 -- 172.21.15.102:0/184198460 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5dc003570 con 0x7fa5f0159c50 2024-08-17T02:26:35.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.737+0000 7fa5f59f8700 1 -- 172.21.15.102:0/184198460 >> v1:172.21.15.121:6789/0 conn(0x7fa5f00b4330 legacy=0x7fa5f00b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.737+0000 7fa5f59f8700 1 -- 172.21.15.102:0/184198460 >> v1:172.21.15.102:6789/0 conn(0x7fa5f0159c50 legacy=0x7fa5f00b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.737+0000 7fa5f59f8700 1 -- 172.21.15.102:0/184198460 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f00b13c0 con 0x7fa5f0159340 2024-08-17T02:26:35.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.737+0000 7fa5f59f8700 1 --2- 172.21.15.102:0/184198460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f0159340 0x7fa5f0159710 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009910 tx=0x7fa5ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d0893a5a80aba8c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f49f6700 1 -- 172.21.15.102:0/184198460 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec00b680 con 0x7fa5f0159340 2024-08-17T02:26:35.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f49f6700 1 -- 172.21.15.102:0/184198460 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec00b7e0 con 0x7fa5f0159340 2024-08-17T02:26:35.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f49f6700 1 -- 172.21.15.102:0/184198460 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec00bb60 con 0x7fa5f0159340 2024-08-17T02:26:35.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 -- 172.21.15.102:0/184198460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f0159340 msgr2=0x7fa5f0159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 --2- 172.21.15.102:0/184198460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f0159340 0x7fa5f0159710 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009910 tx=0x7fa5ec0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 -- 172.21.15.102:0/184198460 shutdown_connections 2024-08-17T02:26:35.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 --2- 172.21.15.102:0/184198460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f0159340 0x7fa5f0159710 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 -- 172.21.15.102:0/184198460 >> 172.21.15.102:0/184198460 conn(0x7fa5f00994f0 msgr2=0x7fa5f00675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 -- 172.21.15.102:0/184198460 shutdown_connections 2024-08-17T02:26:35.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 -- 172.21.15.102:0/184198460 wait complete. 2024-08-17T02:26:35.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 Processor -- start 2024-08-17T02:26:35.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 -- start start 2024-08-17T02:26:35.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f00b4330 0x7fa5f00696f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f0159340 0x7fa5f01563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5f0159c50 0x7fa5f01568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f009a000 con 0x7fa5f00b4330 2024-08-17T02:26:35.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f009a2e0 con 0x7fa5f0159c50 2024-08-17T02:26:35.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f009a5c0 con 0x7fa5f0159340 2024-08-17T02:26:35.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f59f8700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f00b4330 0x7fa5f00696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f59f8700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f00b4330 0x7fa5f00696f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60240/0 (socket says 172.21.15.102:60240) 2024-08-17T02:26:35.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f51f7700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f0159340 0x7fa5f01563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f59f8700 1 -- 172.21.15.102:0/295610638 learned_addr learned my addr 172.21.15.102:0/295610638 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:35.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f61f9700 1 --2- 172.21.15.102:0/295610638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5f0159c50 0x7fa5f01568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f59f8700 1 -- 172.21.15.102:0/295610638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f0159340 msgr2=0x7fa5f01563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f59f8700 1 --2- 172.21.15.102:0/295610638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f0159340 0x7fa5f01563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f59f8700 1 -- 172.21.15.102:0/295610638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5f0159c50 msgr2=0x7fa5f01568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f59f8700 1 --2- 172.21.15.102:0/295610638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5f0159c50 0x7fa5f01568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f59f8700 1 -- 172.21.15.102:0/295610638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec009420 con 0x7fa5f00b4330 2024-08-17T02:26:35.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f59f8700 1 --2- 172.21.15.102:0/295610638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f00b4330 0x7fa5f00696f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0091e0 tx=0x7fa5ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5e1ffb700 1 -- 172.21.15.102:0/295610638 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec00b950 con 0x7fa5f00b4330 2024-08-17T02:26:35.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5e1ffb700 1 -- 172.21.15.102:0/295610638 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec00baf0 con 0x7fa5f00b4330 2024-08-17T02:26:35.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 -- 172.21.15.102:0/295610638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f009a8a0 con 0x7fa5f00b4330 2024-08-17T02:26:35.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5e1ffb700 1 -- 172.21.15.102:0/295610638 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec01a680 con 0x7fa5f00b4330 2024-08-17T02:26:35.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.741+0000 7fa5f7c5c700 1 -- 172.21.15.102:0/295610638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f0156fc0 con 0x7fa5f00b4330 2024-08-17T02:26:35.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.745+0000 7fa5f7c5c700 1 -- 172.21.15.102:0/295610638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f00645c0 con 0x7fa5f00b4330 2024-08-17T02:26:35.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.745+0000 7fa5e1ffb700 1 -- 172.21.15.102:0/295610638 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa5ec01a9f0 con 0x7fa5f00b4330 2024-08-17T02:26:35.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.745+0000 7fa5e1ffb700 1 --2- 172.21.15.102:0/295610638 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa5d4060860 0x7fa5d4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.745+0000 7fa5e1ffb700 1 -- 172.21.15.102:0/295610638 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa5ec07e370 con 0x7fa5f00b4330 2024-08-17T02:26:35.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.745+0000 7fa5f51f7700 1 --2- 172.21.15.102:0/295610638 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa5d4060860 0x7fa5d4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.745+0000 7fa5f51f7700 1 --2- 172.21.15.102:0/295610638 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa5d4060860 0x7fa5d4062d10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00b53a0 tx=0x7fa5e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.753+0000 7fa5e1ffb700 1 -- 172.21.15.102:0/295610638 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa5ec04eb00 con 0x7fa5f00b4330 2024-08-17T02:26:35.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:35.925+0000 7fa5f7c5c700 1 -- 172.21.15.102:0/295610638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa5f0156fc0 con 0x7fa5f00b4330 2024-08-17T02:26:36.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.565+0000 7fa5e1ffb700 1 -- 172.21.15.102:0/295610638 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa5f0156fc0 con 0x7fa5f00b4330 2024-08-17T02:26:36.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.569+0000 7fa5f7c5c700 1 -- 172.21.15.102:0/295610638 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa5d4060860 msgr2=0x7fa5d4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.569+0000 7fa5f7c5c700 1 --2- 172.21.15.102:0/295610638 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa5d4060860 0x7fa5d4062d10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00b53a0 tx=0x7fa5e4009040 comp rx=0 tx=0).stop 2024-08-17T02:26:36.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.569+0000 7fa5f7c5c700 1 -- 172.21.15.102:0/295610638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f00b4330 msgr2=0x7fa5f00696f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.569+0000 7fa5f7c5c700 1 --2- 172.21.15.102:0/295610638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f00b4330 0x7fa5f00696f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0091e0 tx=0x7fa5ec017000 comp rx=0 tx=0).stop 2024-08-17T02:26:36.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.569+0000 7fa5f7c5c700 1 -- 172.21.15.102:0/295610638 shutdown_connections 2024-08-17T02:26:36.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.569+0000 7fa5f7c5c700 1 --2- 172.21.15.102:0/295610638 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa5d4060860 0x7fa5d4062d10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.569+0000 7fa5f7c5c700 1 --2- 172.21.15.102:0/295610638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5f0159c50 0x7fa5f01568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.569+0000 7fa5f7c5c700 1 --2- 172.21.15.102:0/295610638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa5f0159340 0x7fa5f01563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.569+0000 7fa5f7c5c700 1 --2- 172.21.15.102:0/295610638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f00b4330 0x7fa5f00696f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.569+0000 7fa5f7c5c700 1 -- 172.21.15.102:0/295610638 >> 172.21.15.102:0/295610638 conn(0x7fa5f00994f0 msgr2=0x7fa5f015af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.569+0000 7fa5f7c5c700 1 -- 172.21.15.102:0/295610638 shutdown_connections 2024-08-17T02:26:36.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.569+0000 7fa5f7c5c700 1 -- 172.21.15.102:0/295610638 wait complete. 2024-08-17T02:26:36.573 INFO:teuthology.orchestra.run.smithi102.stderr: removed all blocklist entries 2024-08-17T02:26:36.588 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:26:36.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.737+0000 7f30e96cd700 1 Processor -- start 2024-08-17T02:26:36.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.737+0000 7f30e96cd700 1 -- start start 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e96cd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f30e40ace80 0x7f30e4157350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e96cd700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f30e4157890 0x7f30e40aab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e96cd700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e40adf50 con 0x7f30e4156f80 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e96cd700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e40ad340 con 0x7f30e4157890 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e96cd700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e40ad620 con 0x7f30e40ace80 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e37fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f30e4157890 0x7f30e40aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e37fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f30e4157890 0x7f30e40aab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60252/0 (socket says 172.21.15.102:60252) 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e37fe700 1 -- 172.21.15.102:0/2326686736 learned_addr learned my addr 172.21.15.102:0/2326686736 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e27fc700 1 --2- 172.21.15.102:0/2326686736 >> v2:172.21.15.121:3300/0 conn(0x7f30e40ace80 0x7f30e4157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e37fe700 1 -- 172.21.15.102:0/2326686736 >> v2:172.21.15.121:3300/0 conn(0x7f30e40ace80 msgr2=0x7f30e4157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e37fe700 1 --2- 172.21.15.102:0/2326686736 >> v2:172.21.15.121:3300/0 conn(0x7f30e40ace80 0x7f30e4157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e37fe700 1 -- 172.21.15.102:0/2326686736 >> v1:172.21.15.121:6789/0 conn(0x7f30e4156f80 legacy=0x7f30e40ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e37fe700 1 -- 172.21.15.102:0/2326686736 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e40ad900 con 0x7f30e4157890 2024-08-17T02:26:36.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e27fc700 1 --2- 172.21.15.102:0/2326686736 >> v2:172.21.15.121:3300/0 conn(0x7f30e40ace80 0x7f30e4157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:36.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e37fe700 1 --2- 172.21.15.102:0/2326686736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4157890 0x7f30e40aab70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0099b0 tx=0x7f30dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24db8eed819b8242 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e1ffb700 1 -- 172.21.15.102:0/2326686736 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc00b820 con 0x7f30e4157890 2024-08-17T02:26:36.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e1ffb700 1 -- 172.21.15.102:0/2326686736 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc00b980 con 0x7f30e4157890 2024-08-17T02:26:36.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e1ffb700 1 -- 172.21.15.102:0/2326686736 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc00bd20 con 0x7f30e4157890 2024-08-17T02:26:36.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e96cd700 1 -- 172.21.15.102:0/2326686736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4157890 msgr2=0x7f30e40aab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e96cd700 1 --2- 172.21.15.102:0/2326686736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4157890 0x7f30e40aab70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0099b0 tx=0x7f30dc009250 comp rx=0 tx=0).stop 2024-08-17T02:26:36.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e96cd700 1 -- 172.21.15.102:0/2326686736 shutdown_connections 2024-08-17T02:26:36.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e96cd700 1 --2- 172.21.15.102:0/2326686736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4157890 0x7f30e40aab70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e96cd700 1 --2- 172.21.15.102:0/2326686736 >> v2:172.21.15.121:3300/0 conn(0x7f30e40ace80 0x7f30e4157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e96cd700 1 -- 172.21.15.102:0/2326686736 >> 172.21.15.102:0/2326686736 conn(0x7f30e4066e00 msgr2=0x7f30e4067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e96cd700 1 -- 172.21.15.102:0/2326686736 shutdown_connections 2024-08-17T02:26:36.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.741+0000 7f30e96cd700 1 -- 172.21.15.102:0/2326686736 wait complete. 2024-08-17T02:26:36.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.745+0000 7f30e96cd700 1 Processor -- start 2024-08-17T02:26:36.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.745+0000 7f30e96cd700 1 -- start start 2024-08-17T02:26:36.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.745+0000 7f30e96cd700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30e40ace80 0x7f30e40994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e96cd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30e4156f80 0x7f30e4142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e96cd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4157890 0x7f30e41674f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e96cd700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e41686d0 con 0x7f30e4157890 2024-08-17T02:26:36.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e96cd700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e414c210 con 0x7f30e4156f80 2024-08-17T02:26:36.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e96cd700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e4142fc0 con 0x7f30e40ace80 2024-08-17T02:26:36.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e37fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4157890 0x7f30e41674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e37fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4157890 0x7f30e41674f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60268/0 (socket says 172.21.15.102:60268) 2024-08-17T02:26:36.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e37fe700 1 -- 172.21.15.102:0/3249041749 learned_addr learned my addr 172.21.15.102:0/3249041749 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:36.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e27fc700 1 --2- 172.21.15.102:0/3249041749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30e4156f80 0x7f30e4142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e2ffd700 1 --2- 172.21.15.102:0/3249041749 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30e40ace80 0x7f30e40994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e37fe700 1 -- 172.21.15.102:0/3249041749 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30e40ace80 msgr2=0x7f30e40994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e37fe700 1 --2- 172.21.15.102:0/3249041749 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30e40ace80 0x7f30e40994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e37fe700 1 -- 172.21.15.102:0/3249041749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30e4156f80 msgr2=0x7f30e4142a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e37fe700 1 --2- 172.21.15.102:0/3249041749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30e4156f80 0x7f30e4142a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e37fe700 1 -- 172.21.15.102:0/3249041749 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc0094f0 con 0x7f30e4157890 2024-08-17T02:26:36.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e37fe700 1 --2- 172.21.15.102:0/3249041749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4157890 0x7f30e41674f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0094c0 tx=0x7f30dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30caffd700 1 -- 172.21.15.102:0/3249041749 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc011e30 con 0x7f30e4157890 2024-08-17T02:26:36.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30caffd700 1 -- 172.21.15.102:0/3249041749 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc01f070 con 0x7f30e4157890 2024-08-17T02:26:36.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30caffd700 1 -- 172.21.15.102:0/3249041749 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc01a870 con 0x7f30e4157890 2024-08-17T02:26:36.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e96cd700 1 -- 172.21.15.102:0/3249041749 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e4167dc0 con 0x7f30e4157890 2024-08-17T02:26:36.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e96cd700 1 -- 172.21.15.102:0/3249041749 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e4168380 con 0x7f30e4157890 2024-08-17T02:26:36.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.749+0000 7f30e96cd700 1 -- 172.21.15.102:0/3249041749 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e40645c0 con 0x7f30e4157890 2024-08-17T02:26:36.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.753+0000 7f30caffd700 1 -- 172.21.15.102:0/3249041749 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f30dc01aca0 con 0x7f30e4157890 2024-08-17T02:26:36.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.753+0000 7f30caffd700 1 --2- 172.21.15.102:0/3249041749 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f30d00608e0 0x7f30d0062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.753+0000 7f30caffd700 1 -- 172.21.15.102:0/3249041749 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f30dc021070 con 0x7f30e4157890 2024-08-17T02:26:36.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.757+0000 7f30e2ffd700 1 --2- 172.21.15.102:0/3249041749 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f30d00608e0 0x7f30d0062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.757+0000 7f30e2ffd700 1 --2- 172.21.15.102:0/3249041749 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f30d00608e0 0x7f30d0062d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f30d8003a80 tx=0x7f30d8007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.761+0000 7f30caffd700 1 -- 172.21.15.102:0/3249041749 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f30dc04ef20 con 0x7f30e4157890 2024-08-17T02:26:36.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.977+0000 7f30e96cd700 1 -- 172.21.15.102:0/3249041749 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f30e4153260 con 0x7f30e4157890 2024-08-17T02:26:36.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.977+0000 7f30caffd700 1 -- 172.21.15.102:0/3249041749 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f30dc052540 con 0x7f30e4157890 2024-08-17T02:26:36.979 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:36.979 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-08-17T02:26:36.979 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_dump": [ 2024-08-17T02:26:36.979 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.979 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mds.a", 2024-08-17T02:26:36.979 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQD9CcBmNcIIHhAADPhHoaez14XKXphkNY2sfw==", 2024-08-17T02:26:36.979 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.979 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2024-08-17T02:26:36.980 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow *", 2024-08-17T02:26:36.980 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow *", 2024-08-17T02:26:36.980 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2024-08-17T02:26:36.980 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.980 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.980 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mds.b", 2024-08-17T02:26:36.980 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQD9CcBmUrl5JxAAPEo2eEKc1Me8sZTbGmQrhA==", 2024-08-17T02:26:36.980 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.981 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2024-08-17T02:26:36.981 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow *", 2024-08-17T02:26:36.981 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow *", 2024-08-17T02:26:36.981 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2024-08-17T02:26:36.981 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.981 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.981 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mds.c", 2024-08-17T02:26:36.981 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQD9CcBmHFY5IRAAUeW5dVn2ce6u3LAJrQ4eHg==", 2024-08-17T02:26:36.981 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.981 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2024-08-17T02:26:36.981 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow *", 2024-08-17T02:26:36.982 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow *", 2024-08-17T02:26:36.982 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2024-08-17T02:26:36.982 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.982 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.982 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mds.d", 2024-08-17T02:26:36.982 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQD9CcBmccyeLRAAc2o9yMJaCO8ueNCFsi9RuA==", 2024-08-17T02:26:36.982 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.982 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2024-08-17T02:26:36.982 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow *", 2024-08-17T02:26:36.982 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow *", 2024-08-17T02:26:36.982 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.0", 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAACsBmIFl+IBAAkGaOEDibN0aW5ihngWiCIQ==", 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.983 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.1", 2024-08-17T02:26:36.984 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQADCsBma1S7IRAAd0sfUVkbF6HNSfAbabWr8Q==", 2024-08-17T02:26:36.984 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.984 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:36.984 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2024-08-17T02:26:36.984 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2024-08-17T02:26:36.984 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.984 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.984 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.2", 2024-08-17T02:26:36.984 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAGCsBmk4+iJxAAobLfanO2dDh2qfeLfedPig==", 2024-08-17T02:26:36.984 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.984 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:36.984 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2024-08-17T02:26:36.984 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.3", 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAJCsBmYhwmKhAAtd8Z2UwH19a7oEhSvP50wg==", 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.4", 2024-08-17T02:26:36.985 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAPCsBm2HCOCRAAb/b0YsNZDQGW3ams4o5OjQ==", 2024-08-17T02:26:36.986 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.986 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:36.986 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2024-08-17T02:26:36.986 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2024-08-17T02:26:36.986 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.986 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.986 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.5", 2024-08-17T02:26:36.986 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQASCsBmqYvvDBAAjd21KwVBVNdmf61bB1kD1w==", 2024-08-17T02:26:36.986 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.986 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:36.986 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2024-08-17T02:26:36.987 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2024-08-17T02:26:36.987 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.987 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.987 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.6", 2024-08-17T02:26:36.987 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAVCsBmsN2dERAARy8qXUd1PYCrOCaDxX41Ew==", 2024-08-17T02:26:36.987 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.987 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:36.987 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.7", 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAYCsBmV5LjFhAAHW2H7qHbd4sf0J/x50o7aA==", 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.988 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.989 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.0", 2024-08-17T02:26:36.989 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQD9CcBmO9XVMBAAIaDYcGwkyxygfAvY+VkwVA==", 2024-08-17T02:26:36.989 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.989 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2024-08-17T02:26:36.989 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow r", 2024-08-17T02:26:36.989 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow rw", 2024-08-17T02:26:36.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow rwx" 2024-08-17T02:26:36.989 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.989 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.989 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.1", 2024-08-17T02:26:36.989 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQD9CcBmCn+NNhAA5UjRBu/QUG9eKJgoc1m3rQ==", 2024-08-17T02:26:36.989 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.989 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow r", 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow rw", 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow rwx" 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.2", 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQD9CcBm7HelMxAABEkjlhK3Stjj/JIt848sxg==", 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow r", 2024-08-17T02:26:36.990 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow rw", 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow rwx" 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.3", 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQD+CcBmbIkxABAAzi8G0Z2RP5SNPyID2CwRYQ==", 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow r", 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow rw", 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow rwx" 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.admin", 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQD9CcBmHN2JEBAAlF7HNvjSg8fN4xop3ZZBMQ==", 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow *", 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow *", 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow *", 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAiCsBmstu4LxAARnIkzILEJlvU9PFF5MccoQ==", 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAiCsBmT/a4LxAAzY7NxnWYrLUqCXZ11UulqA==", 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAiCsBm7A+5LxAAesfPWxZkbxRzmrGKvs+swg==", 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAiCsBmjSa5LxAAFy6ivNoWmVkL2SaZCDh3Mg==", 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAiCsBmWj25LxAAqIn8VBK/x35TwTstdbZV/g==", 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQAiCsBmw1S5LxAAPDe6dCRHQWzc9Mlte13S0Q==", 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.996 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mgr.x", 2024-08-17T02:26:36.996 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQD9CcBm0A1FGxAAP/gtKgo0amWr/y8m2U8rsQ==", 2024-08-17T02:26:36.996 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.996 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow *", 2024-08-17T02:26:36.996 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile mgr", 2024-08-17T02:26:36.996 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2024-08-17T02:26:36.996 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.996 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:36.996 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:36.996 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mgr.y", 2024-08-17T02:26:36.996 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQD9CcBmGuNoGBAA4A8/06fGZH2ePaLLCVR27Q==", 2024-08-17T02:26:36.996 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2024-08-17T02:26:36.996 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow *", 2024-08-17T02:26:36.997 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile mgr", 2024-08-17T02:26:36.997 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2024-08-17T02:26:36.997 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.997 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:36.997 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-08-17T02:26:36.997 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-08-17T02:26:36.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.977+0000 7f30e96cd700 1 -- 172.21.15.102:0/3249041749 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f30d00608e0 msgr2=0x7f30d0062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.977+0000 7f30e96cd700 1 --2- 172.21.15.102:0/3249041749 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f30d00608e0 0x7f30d0062d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f30d8003a80 tx=0x7f30d8007ec0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.977+0000 7f30e96cd700 1 -- 172.21.15.102:0/3249041749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4157890 msgr2=0x7f30e41674f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.977+0000 7f30e96cd700 1 --2- 172.21.15.102:0/3249041749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4157890 0x7f30e41674f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0094c0 tx=0x7f30dc017000 comp rx=0 tx=0).stop 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.977+0000 7f30e96cd700 1 -- 172.21.15.102:0/3249041749 shutdown_connections 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.977+0000 7f30e96cd700 1 --2- 172.21.15.102:0/3249041749 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f30d00608e0 0x7f30d0062d90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.977+0000 7f30e96cd700 1 --2- 172.21.15.102:0/3249041749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30e4157890 0x7f30e41674f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.977+0000 7f30e96cd700 1 --2- 172.21.15.102:0/3249041749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30e4156f80 0x7f30e4142a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.977+0000 7f30e96cd700 1 --2- 172.21.15.102:0/3249041749 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30e40ace80 0x7f30e40994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.977+0000 7f30e96cd700 1 -- 172.21.15.102:0/3249041749 >> 172.21.15.102:0/3249041749 conn(0x7f30e4066e00 msgr2=0x7f30e4155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.977+0000 7f30e96cd700 1 -- 172.21.15.102:0/3249041749 shutdown_connections 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:36.977+0000 7f30e96cd700 1 -- 172.21.15.102:0/3249041749 wait complete. 2024-08-17T02:26:37.000 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:26:37.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.105+0000 7f1492678700 1 Processor -- start 2024-08-17T02:26:37.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.105+0000 7f1492678700 1 -- start start 2024-08-17T02:26:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.105+0000 7f1492678700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f148c155b30 0x7f148c06eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.105+0000 7f1492678700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f148c0aa580 0x7f148c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.105+0000 7f1492678700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c0c87d0 con 0x7f148c155760 2024-08-17T02:26:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.105+0000 7f1492678700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148c0ac7d0 con 0x7f148c0aa580 2024-08-17T02:26:37.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.105+0000 7f1492678700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0acab0 con 0x7f148c155b30 2024-08-17T02:26:37.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f148b7fe700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f148c155b30 0x7f148c06eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f1490c15700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f148c0aa580 0x7f148c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f148b7fe700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f148c155b30 0x7f148c06eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:42552/0 (socket says 172.21.15.102:42552) 2024-08-17T02:26:37.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f148b7fe700 1 -- 172.21.15.102:0/4082858227 learned_addr learned my addr 172.21.15.102:0/4082858227 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:37.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f1490c15700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f148c0aa580 0x7f148c06f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:43316/0 (socket says 172.21.15.102:43316) 2024-08-17T02:26:37.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f1490c15700 1 -- 172.21.15.102:0/4082858227 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f148c155b30 msgr2=0x7f148c06eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f1490c15700 1 --2- 172.21.15.102:0/4082858227 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f148c155b30 0x7f148c06eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f1490c15700 1 -- 172.21.15.102:0/4082858227 >> v1:172.21.15.121:6789/0 conn(0x7f148c155760 legacy=0x7f148c0abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f1490c15700 1 -- 172.21.15.102:0/4082858227 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0acd90 con 0x7f148c0aa580 2024-08-17T02:26:37.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f148b7fe700 1 --2- 172.21.15.102:0/4082858227 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f148c155b30 0x7f148c06eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:37.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f1490c15700 1 --2- 172.21.15.102:0/4082858227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f148c0aa580 0x7f148c06f080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f148400aa90 tx=0x7f148400a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d72a2542434339eb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f148affd700 1 -- 172.21.15.102:0/4082858227 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148400c970 con 0x7f148c0aa580 2024-08-17T02:26:37.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f148affd700 1 -- 172.21.15.102:0/4082858227 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148400cad0 con 0x7f148c0aa580 2024-08-17T02:26:37.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f148affd700 1 -- 172.21.15.102:0/4082858227 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148400ce70 con 0x7f148c0aa580 2024-08-17T02:26:37.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f1492678700 1 -- 172.21.15.102:0/4082858227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f148c0aa580 msgr2=0x7f148c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f1492678700 1 --2- 172.21.15.102:0/4082858227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f148c0aa580 0x7f148c06f080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f148400aa90 tx=0x7f148400a330 comp rx=0 tx=0).stop 2024-08-17T02:26:37.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f1492678700 1 -- 172.21.15.102:0/4082858227 shutdown_connections 2024-08-17T02:26:37.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f1492678700 1 --2- 172.21.15.102:0/4082858227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f148c0aa580 0x7f148c06f080 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f1492678700 1 --2- 172.21.15.102:0/4082858227 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f148c155b30 0x7f148c06eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f1492678700 1 -- 172.21.15.102:0/4082858227 >> 172.21.15.102:0/4082858227 conn(0x7f148c067810 msgr2=0x7f148c067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f1492678700 1 -- 172.21.15.102:0/4082858227 shutdown_connections 2024-08-17T02:26:37.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.109+0000 7f1492678700 1 -- 172.21.15.102:0/4082858227 wait complete. 2024-08-17T02:26:37.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1492678700 1 Processor -- start 2024-08-17T02:26:37.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1492678700 1 -- start start 2024-08-17T02:26:37.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1492678700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f148c0aa580 0x7f148c0af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1492678700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f148c155760 0x7f148c0afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1492678700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f148c155b30 0x7f148c0b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1492678700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c157960 con 0x7f148c155b30 2024-08-17T02:26:37.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1492678700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c158770 con 0x7f148c0aa580 2024-08-17T02:26:37.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1492678700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c157b60 con 0x7f148c155760 2024-08-17T02:26:37.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1490c15700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f148c155b30 0x7f148c0b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f148bfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f148c0aa580 0x7f148c0af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f148bfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f148c0aa580 0x7f148c0af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:43320/0 (socket says 172.21.15.102:43320) 2024-08-17T02:26:37.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f148b7fe700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f148c155760 0x7f148c0afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f148bfff700 1 -- 172.21.15.102:0/1669278920 learned_addr learned my addr 172.21.15.102:0/1669278920 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:37.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1490c15700 1 -- 172.21.15.102:0/1669278920 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f148c155760 msgr2=0x7f148c0afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1490c15700 1 --2- 172.21.15.102:0/1669278920 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f148c155760 0x7f148c0afcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1490c15700 1 -- 172.21.15.102:0/1669278920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f148c0aa580 msgr2=0x7f148c0af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1490c15700 1 --2- 172.21.15.102:0/1669278920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f148c0aa580 0x7f148c0af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1490c15700 1 -- 172.21.15.102:0/1669278920 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c009ae0 con 0x7f148c155b30 2024-08-17T02:26:37.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1490c15700 1 --2- 172.21.15.102:0/1669278920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f148c155b30 0x7f148c0b01f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1484017000 tx=0x7f148401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1473fff700 1 -- 172.21.15.102:0/1669278920 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484019e90 con 0x7f148c155b30 2024-08-17T02:26:37.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1473fff700 1 -- 172.21.15.102:0/1669278920 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1484010600 con 0x7f148c155b30 2024-08-17T02:26:37.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1473fff700 1 -- 172.21.15.102:0/1669278920 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840109c0 con 0x7f148c155b30 2024-08-17T02:26:37.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1492678700 1 -- 172.21.15.102:0/1669278920 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148400a5d0 con 0x7f148c155b30 2024-08-17T02:26:37.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.113+0000 7f1492678700 1 -- 172.21.15.102:0/1669278920 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148c158120 con 0x7f148c155b30 2024-08-17T02:26:37.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.117+0000 7f1492678700 1 -- 172.21.15.102:0/1669278920 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148c158900 con 0x7f148c155b30 2024-08-17T02:26:37.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.117+0000 7f1473fff700 1 -- 172.21.15.102:0/1669278920 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f148402b3f0 con 0x7f148c155b30 2024-08-17T02:26:37.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.117+0000 7f1473fff700 1 --2- 172.21.15.102:0/1669278920 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1478060860 0x7f1478062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.117+0000 7f1473fff700 1 -- 172.21.15.102:0/1669278920 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f148407ddf0 con 0x7f148c155b30 2024-08-17T02:26:37.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.117+0000 7f148bfff700 1 --2- 172.21.15.102:0/1669278920 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1478060860 0x7f1478062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.117+0000 7f148bfff700 1 --2- 172.21.15.102:0/1669278920 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1478060860 0x7f1478062d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f14800078a0 tx=0x7f1480007830 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.125+0000 7f1473fff700 1 -- 172.21.15.102:0/1669278920 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f148404e590 con 0x7f148c155b30 2024-08-17T02:26:37.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.345+0000 7f1492678700 1 -- 172.21.15.102:0/1669278920 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f148c0645c0 con 0x7f148c155b30 2024-08-17T02:26:37.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.353+0000 7f1473fff700 1 -- 172.21.15.102:0/1669278920 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1484051bb0 con 0x7f148c155b30 2024-08-17T02:26:37.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.357+0000 7f1492678700 1 -- 172.21.15.102:0/1669278920 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1478060860 msgr2=0x7f1478062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.357+0000 7f1492678700 1 --2- 172.21.15.102:0/1669278920 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1478060860 0x7f1478062d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f14800078a0 tx=0x7f1480007830 comp rx=0 tx=0).stop 2024-08-17T02:26:37.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.357+0000 7f1492678700 1 -- 172.21.15.102:0/1669278920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f148c155b30 msgr2=0x7f148c0b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.357+0000 7f1492678700 1 --2- 172.21.15.102:0/1669278920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f148c155b30 0x7f148c0b01f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1484017000 tx=0x7f148401a000 comp rx=0 tx=0).stop 2024-08-17T02:26:37.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.357+0000 7f1492678700 1 -- 172.21.15.102:0/1669278920 shutdown_connections 2024-08-17T02:26:37.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.357+0000 7f1492678700 1 --2- 172.21.15.102:0/1669278920 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1478060860 0x7f1478062d10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.357+0000 7f1492678700 1 --2- 172.21.15.102:0/1669278920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f148c155b30 0x7f148c0b01f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.357+0000 7f1492678700 1 --2- 172.21.15.102:0/1669278920 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f148c155760 0x7f148c0afcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.357+0000 7f1492678700 1 --2- 172.21.15.102:0/1669278920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f148c0aa580 0x7f148c0af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.357+0000 7f1492678700 1 -- 172.21.15.102:0/1669278920 >> 172.21.15.102:0/1669278920 conn(0x7f148c067810 msgr2=0x7f148c069270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.357+0000 7f1492678700 1 -- 172.21.15.102:0/1669278920 shutdown_connections 2024-08-17T02:26:37.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.357+0000 7f1492678700 1 -- 172.21.15.102:0/1669278920 wait complete. 2024-08-17T02:26:37.371 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:26:37.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddddde4700 1 Processor -- start 2024-08-17T02:26:37.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddddde4700 1 -- start start 2024-08-17T02:26:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddddde4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fddd80cb450 0x7fddd806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddddde4700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd80cb870 con 0x7fddd80adf10 2024-08-17T02:26:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddddde4700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd81610c0 con 0x7fddd806e470 2024-08-17T02:26:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddddde4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd8158290 con 0x7fddd80cb450 2024-08-17T02:26:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd77fe700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fddd80adf10 0x7fddd80ae2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:58546/0 (socket says 172.21.15.102:58546) 2024-08-17T02:26:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd77fe700 1 -- 172.21.15.102:0/1693043724 learned_addr learned my addr 172.21.15.102:0/1693043724 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd7fff700 1 --2- 172.21.15.102:0/1693043724 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fddd80cb450 0x7fddd806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd67fc700 1 -- 172.21.15.102:0/1693043724 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814366702 0 0) 0x7fddd80cb870 con 0x7fddd80adf10 2024-08-17T02:26:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd67fc700 1 -- 172.21.15.102:0/1693043724 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddc4003570 con 0x7fddd80adf10 2024-08-17T02:26:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd67fc700 1 -- 172.21.15.102:0/1693043724 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3915381752 0 0) 0x7fddc4003570 con 0x7fddd80adf10 2024-08-17T02:26:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd67fc700 1 -- 172.21.15.102:0/1693043724 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fddd80cb450 msgr2=0x7fddd806e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd67fc700 1 --2- 172.21.15.102:0/1693043724 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fddd80cb450 0x7fddd806e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd67fc700 1 -- 172.21.15.102:0/1693043724 >> v1:172.21.15.121:6789/0 conn(0x7fddd806e470 legacy=0x7fddd80cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd67fc700 1 -- 172.21.15.102:0/1693043724 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd815dff0 con 0x7fddd80adf10 2024-08-17T02:26:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd67fc700 1 -- 172.21.15.102:0/1693043724 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7fddc0001490 con 0x7fddd80adf10 2024-08-17T02:26:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd67fc700 1 -- 172.21.15.102:0/1693043724 >> v1:172.21.15.102:6789/0 conn(0x7fddd80adf10 legacy=0x7fddd80ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd67fc700 1 --2- 172.21.15.102:0/1693043724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddc4003a90 0x7fddc4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd67fc700 1 --2- 172.21.15.102:0/1693043724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc4004810 0x7fddc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd67fc700 1 --2- 172.21.15.102:0/1693043724 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fddd80cb450 0x7fddc40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd67fc700 1 -- 172.21.15.102:0/1693043724 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc400bb60 con 0x7fddc4004810 2024-08-17T02:26:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd67fc700 1 -- 172.21.15.102:0/1693043724 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc400bcd0 con 0x7fddc4003a90 2024-08-17T02:26:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd67fc700 1 -- 172.21.15.102:0/1693043724 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc400be90 con 0x7fddd80cb450 2024-08-17T02:26:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd6ffd700 1 --2- 172.21.15.102:0/1693043724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc4004810 0x7fddc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd7fff700 1 --2- 172.21.15.102:0/1693043724 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fddd80cb450 0x7fddc40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd77fe700 1 --2- 172.21.15.102:0/1693043724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddc4003a90 0x7fddc4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd6ffd700 1 -- 172.21.15.102:0/1693043724 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fddd80cb450 msgr2=0x7fddc40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd6ffd700 1 --2- 172.21.15.102:0/1693043724 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fddd80cb450 0x7fddc40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd6ffd700 1 -- 172.21.15.102:0/1693043724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddc4003a90 msgr2=0x7fddc4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd6ffd700 1 --2- 172.21.15.102:0/1693043724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddc4003a90 0x7fddc4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.477+0000 7fddd6ffd700 1 -- 172.21.15.102:0/1693043724 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc4003570 con 0x7fddc4004810 2024-08-17T02:26:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddd6ffd700 1 --2- 172.21.15.102:0/1693043724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc4004810 0x7fddc4004c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fddd0001fc0 tx=0x7fddd0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6e7e91ecb8af6a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddd67fc700 1 -- 172.21.15.102:0/1693043724 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0001950 con 0x7fddc4004810 2024-08-17T02:26:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddd67fc700 1 -- 172.21.15.102:0/1693043724 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd000c8b0 con 0x7fddc4004810 2024-08-17T02:26:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddd67fc700 1 -- 172.21.15.102:0/1693043724 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd000cc50 con 0x7fddc4004810 2024-08-17T02:26:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddddde4700 1 -- 172.21.15.102:0/1693043724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc4004810 msgr2=0x7fddc4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddddde4700 1 --2- 172.21.15.102:0/1693043724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc4004810 0x7fddc4004c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fddd0001fc0 tx=0x7fddd0001640 comp rx=0 tx=0).stop 2024-08-17T02:26:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddd7fff700 1 -- 172.21.15.102:0/1693043724 reap_dead start 2024-08-17T02:26:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddddde4700 1 -- 172.21.15.102:0/1693043724 shutdown_connections 2024-08-17T02:26:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddddde4700 1 -- 172.21.15.102:0/1693043724 >> 172.21.15.102:0/1693043724 conn(0x7fddd8067810 msgr2=0x7fddd8067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddddde4700 1 -- 172.21.15.102:0/1693043724 shutdown_connections 2024-08-17T02:26:37.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddddde4700 1 -- 172.21.15.102:0/1693043724 wait complete. 2024-08-17T02:26:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddddde4700 1 Processor -- start 2024-08-17T02:26:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddddde4700 1 -- start start 2024-08-17T02:26:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddddde4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc4004810 0x7fddd8155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddddde4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fddd816d5e0 0x7fddd80a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddddde4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddd816da30 0x7fddd80ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddddde4700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80aa670 con 0x7fddc4004810 2024-08-17T02:26:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddddde4700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd81558d0 con 0x7fddd816da30 2024-08-17T02:26:37.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddddde4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd8097af0 con 0x7fddd816d5e0 2024-08-17T02:26:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddd77fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc4004810 0x7fddd8155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddd77fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc4004810 0x7fddd8155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60292/0 (socket says 172.21.15.102:60292) 2024-08-17T02:26:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddd77fe700 1 -- 172.21.15.102:0/2211193008 learned_addr learned my addr 172.21.15.102:0/2211193008 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddd6ffd700 1 --2- 172.21.15.102:0/2211193008 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fddd816d5e0 0x7fddd80a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.481+0000 7fddd7fff700 1 --2- 172.21.15.102:0/2211193008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddd816da30 0x7fddd80ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.485+0000 7fddd77fe700 1 -- 172.21.15.102:0/2211193008 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fddd816d5e0 msgr2=0x7fddd80a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.485+0000 7fddd77fe700 1 --2- 172.21.15.102:0/2211193008 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fddd816d5e0 0x7fddd80a9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.485+0000 7fddd77fe700 1 -- 172.21.15.102:0/2211193008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddd816da30 msgr2=0x7fddd80ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.485+0000 7fddd77fe700 1 --2- 172.21.15.102:0/2211193008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddd816da30 0x7fddd80ab010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.485+0000 7fddd77fe700 1 -- 172.21.15.102:0/2211193008 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8097dd0 con 0x7fddc4004810 2024-08-17T02:26:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.485+0000 7fddd77fe700 1 --2- 172.21.15.102:0/2211193008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc4004810 0x7fddd8155390 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fddc00073c0 tx=0x7fddc0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.485+0000 7fddcf7fe700 1 -- 172.21.15.102:0/2211193008 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0018030 con 0x7fddc4004810 2024-08-17T02:26:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.485+0000 7fddcf7fe700 1 -- 172.21.15.102:0/2211193008 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc000f660 con 0x7fddc4004810 2024-08-17T02:26:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.485+0000 7fddddde4700 1 -- 172.21.15.102:0/2211193008 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd80980b0 con 0x7fddc4004810 2024-08-17T02:26:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.485+0000 7fddcf7fe700 1 -- 172.21.15.102:0/2211193008 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc000fa20 con 0x7fddc4004810 2024-08-17T02:26:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.485+0000 7fddddde4700 1 -- 172.21.15.102:0/2211193008 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd80a8ee0 con 0x7fddc4004810 2024-08-17T02:26:37.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.485+0000 7fddddde4700 1 -- 172.21.15.102:0/2211193008 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd80645c0 con 0x7fddc4004810 2024-08-17T02:26:37.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.485+0000 7fddcf7fe700 1 -- 172.21.15.102:0/2211193008 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fddc001b070 con 0x7fddc4004810 2024-08-17T02:26:37.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.489+0000 7fddcf7fe700 1 --2- 172.21.15.102:0/2211193008 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fddb8060860 0x7fddb8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.489+0000 7fddcf7fe700 1 -- 172.21.15.102:0/2211193008 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fddc0019070 con 0x7fddc4004810 2024-08-17T02:26:37.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.489+0000 7fddd6ffd700 1 --2- 172.21.15.102:0/2211193008 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fddb8060860 0x7fddb8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.489+0000 7fddd6ffd700 1 --2- 172.21.15.102:0/2211193008 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fddb8060860 0x7fddb8062d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fddd815d9b0 tx=0x7fddd0015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.493+0000 7fddcf7fe700 1 -- 172.21.15.102:0/2211193008 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fddc004d880 con 0x7fddc4004810 2024-08-17T02:26:37.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.716+0000 7fddddde4700 1 -- 172.21.15.102:0/2211193008 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fddd806efa0 con 0x7fddc4004810 2024-08-17T02:26:37.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.724+0000 7fddcf7fe700 1 -- 172.21.15.102:0/2211193008 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fddc0050ea0 con 0x7fddc4004810 2024-08-17T02:26:37.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.728+0000 7fddddde4700 1 -- 172.21.15.102:0/2211193008 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fddb8060860 msgr2=0x7fddb8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.728+0000 7fddddde4700 1 --2- 172.21.15.102:0/2211193008 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fddb8060860 0x7fddb8062d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fddd815d9b0 tx=0x7fddd0015000 comp rx=0 tx=0).stop 2024-08-17T02:26:37.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.728+0000 7fddddde4700 1 -- 172.21.15.102:0/2211193008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc4004810 msgr2=0x7fddd8155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.728+0000 7fddddde4700 1 --2- 172.21.15.102:0/2211193008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc4004810 0x7fddd8155390 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fddc00073c0 tx=0x7fddc0001e70 comp rx=0 tx=0).stop 2024-08-17T02:26:37.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.728+0000 7fddddde4700 1 -- 172.21.15.102:0/2211193008 shutdown_connections 2024-08-17T02:26:37.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.728+0000 7fddddde4700 1 --2- 172.21.15.102:0/2211193008 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fddb8060860 0x7fddb8062d10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.728+0000 7fddddde4700 1 --2- 172.21.15.102:0/2211193008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddd816da30 0x7fddd80ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.728+0000 7fddddde4700 1 --2- 172.21.15.102:0/2211193008 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fddd816d5e0 0x7fddd80a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.728+0000 7fddddde4700 1 --2- 172.21.15.102:0/2211193008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddc4004810 0x7fddd8155390 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.728+0000 7fddddde4700 1 -- 172.21.15.102:0/2211193008 >> 172.21.15.102:0/2211193008 conn(0x7fddd8067810 msgr2=0x7fddd80b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.728+0000 7fddddde4700 1 -- 172.21.15.102:0/2211193008 shutdown_connections 2024-08-17T02:26:37.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.728+0000 7fddddde4700 1 -- 172.21.15.102:0/2211193008 wait complete. 2024-08-17T02:26:37.744 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:26:37.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bffff700 1 Processor -- start 2024-08-17T02:26:37.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bffff700 1 -- start start 2024-08-17T02:26:37.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bffff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f80c00cd1b0 0x7f80c01536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bffff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f80c015a190 0x7f80c015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bffff700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c015a5f0 con 0x7f80c0153320 2024-08-17T02:26:37.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bffff700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c00ce430 con 0x7f80c015a190 2024-08-17T02:26:37.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bffff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c015dbd0 con 0x7f80c00cd1b0 2024-08-17T02:26:37.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80beffd700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f80c0153320 0x7f80c00ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:58556/0 (socket says 172.21.15.102:58556) 2024-08-17T02:26:37.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80beffd700 1 -- 172.21.15.102:0/1905946428 learned_addr learned my addr 172.21.15.102:0/1905946428 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:37.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bf7fe700 1 --2- 172.21.15.102:0/1905946428 >> v2:172.21.15.102:3300/0 conn(0x7f80c015a190 0x7f80c015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80be7fc700 1 --2- 172.21.15.102:0/1905946428 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f80c00cd1b0 0x7f80c01536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bdffb700 1 -- 172.21.15.102:0/1905946428 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436589261 0 0) 0x7f80c015a5f0 con 0x7f80c0153320 2024-08-17T02:26:37.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bdffb700 1 -- 172.21.15.102:0/1905946428 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a0003570 con 0x7f80c0153320 2024-08-17T02:26:37.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bf7fe700 1 -- 172.21.15.102:0/1905946428 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f80c00cd1b0 msgr2=0x7f80c01536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bf7fe700 1 --2- 172.21.15.102:0/1905946428 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f80c00cd1b0 0x7f80c01536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bf7fe700 1 -- 172.21.15.102:0/1905946428 >> v1:172.21.15.102:6789/0 conn(0x7f80c0153320 legacy=0x7f80c00ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bdffb700 1 -- 172.21.15.102:0/1905946428 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3354469695 0 0) 0x7f80a0003570 con 0x7f80c0153320 2024-08-17T02:26:37.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bf7fe700 1 -- 172.21.15.102:0/1905946428 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c015d370 con 0x7f80c015a190 2024-08-17T02:26:37.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bf7fe700 1 --2- 172.21.15.102:0/1905946428 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80c015a190 0x7f80c015cc60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f80b00098e0 tx=0x7f80b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1323f3b16e189b18 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bdffb700 1 -- 172.21.15.102:0/1905946428 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0011630 con 0x7f80c015a190 2024-08-17T02:26:37.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bdffb700 1 -- 172.21.15.102:0/1905946428 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b0011790 con 0x7f80c015a190 2024-08-17T02:26:37.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.856+0000 7f80bdffb700 1 -- 172.21.15.102:0/1905946428 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0011b30 con 0x7f80c015a190 2024-08-17T02:26:37.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80bffff700 1 -- 172.21.15.102:0/1905946428 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80c015a190 msgr2=0x7f80c015cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80bffff700 1 --2- 172.21.15.102:0/1905946428 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80c015a190 0x7f80c015cc60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f80b00098e0 tx=0x7f80b00091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80bffff700 1 -- 172.21.15.102:0/1905946428 shutdown_connections 2024-08-17T02:26:37.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80bffff700 1 --2- 172.21.15.102:0/1905946428 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80c015a190 0x7f80c015cc60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80bffff700 1 --2- 172.21.15.102:0/1905946428 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f80c00cd1b0 0x7f80c01536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80bffff700 1 -- 172.21.15.102:0/1905946428 >> 172.21.15.102:0/1905946428 conn(0x7f80c00d00a0 msgr2=0x7f80c00d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80bffff700 1 -- 172.21.15.102:0/1905946428 shutdown_connections 2024-08-17T02:26:37.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80bffff700 1 -- 172.21.15.102:0/1905946428 wait complete. 2024-08-17T02:26:37.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80bffff700 1 Processor -- start 2024-08-17T02:26:37.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80bffff700 1 -- start start 2024-08-17T02:26:37.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80bffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80c00cd1b0 0x7f80c016b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80bffff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80c0153320 0x7f80c00b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80bffff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f80c015a190 0x7f80c00b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80bffff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c01698c0 con 0x7f80c0153320 2024-08-17T02:26:37.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80bffff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c0168a30 con 0x7f80c00cd1b0 2024-08-17T02:26:37.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80bffff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c0168cb0 con 0x7f80c015a190 2024-08-17T02:26:37.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.860+0000 7f80be7fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80c0153320 0x7f80c00b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.864+0000 7f80be7fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80c0153320 0x7f80c00b0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60316/0 (socket says 172.21.15.102:60316) 2024-08-17T02:26:37.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.864+0000 7f80be7fc700 1 -- 172.21.15.102:0/516925694 learned_addr learned my addr 172.21.15.102:0/516925694 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:37.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.864+0000 7f80beffd700 1 --2- 172.21.15.102:0/516925694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80c00cd1b0 0x7f80c016b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.864+0000 7f80bf7fe700 1 --2- 172.21.15.102:0/516925694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f80c015a190 0x7f80c00b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.864+0000 7f80be7fc700 1 -- 172.21.15.102:0/516925694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f80c015a190 msgr2=0x7f80c00b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.864+0000 7f80be7fc700 1 --2- 172.21.15.102:0/516925694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f80c015a190 0x7f80c00b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.864+0000 7f80be7fc700 1 -- 172.21.15.102:0/516925694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80c00cd1b0 msgr2=0x7f80c016b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.864+0000 7f80be7fc700 1 --2- 172.21.15.102:0/516925694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80c00cd1b0 0x7f80c016b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.864+0000 7f80be7fc700 1 -- 172.21.15.102:0/516925694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b0009420 con 0x7f80c0153320 2024-08-17T02:26:37.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.864+0000 7f80be7fc700 1 --2- 172.21.15.102:0/516925694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80c0153320 0x7f80c00b0de0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f80b800ec80 tx=0x7f80b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.864+0000 7f80b6ffd700 1 -- 172.21.15.102:0/516925694 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b800c850 con 0x7f80c0153320 2024-08-17T02:26:37.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.864+0000 7f80b6ffd700 1 -- 172.21.15.102:0/516925694 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b800c9b0 con 0x7f80c0153320 2024-08-17T02:26:37.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.864+0000 7f80bffff700 1 -- 172.21.15.102:0/516925694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c0168f90 con 0x7f80c0153320 2024-08-17T02:26:37.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.864+0000 7f80b6ffd700 1 -- 172.21.15.102:0/516925694 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b800cd50 con 0x7f80c0153320 2024-08-17T02:26:37.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.864+0000 7f80bffff700 1 -- 172.21.15.102:0/516925694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c0169550 con 0x7f80c0153320 2024-08-17T02:26:37.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.864+0000 7f80bffff700 1 -- 172.21.15.102:0/516925694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c00638f0 con 0x7f80c0153320 2024-08-17T02:26:37.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.868+0000 7f80b6ffd700 1 -- 172.21.15.102:0/516925694 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f80b8013680 con 0x7f80c0153320 2024-08-17T02:26:37.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.868+0000 7f80b6ffd700 1 --2- 172.21.15.102:0/516925694 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f80a4060860 0x7f80a4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.868+0000 7f80b6ffd700 1 -- 172.21.15.102:0/516925694 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f80b807cae0 con 0x7f80c0153320 2024-08-17T02:26:37.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.868+0000 7f80beffd700 1 --2- 172.21.15.102:0/516925694 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f80a4060860 0x7f80a4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.868+0000 7f80beffd700 1 --2- 172.21.15.102:0/516925694 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f80a4060860 0x7f80a4062d10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f80a8007fd0 tx=0x7f80a8007e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:37.872+0000 7f80b6ffd700 1 -- 172.21.15.102:0/516925694 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f80b804d280 con 0x7f80c0153320 2024-08-17T02:26:38.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.100+0000 7f80bffff700 1 -- 172.21.15.102:0/516925694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f80c0169a00 con 0x7f80c0153320 2024-08-17T02:26:38.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.104+0000 7f80b6ffd700 1 -- 172.21.15.102:0/516925694 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f80c0169a00 con 0x7f80c0153320 2024-08-17T02:26:38.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.108+0000 7f80bffff700 1 -- 172.21.15.102:0/516925694 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f80a4060860 msgr2=0x7f80a4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.108+0000 7f80bffff700 1 --2- 172.21.15.102:0/516925694 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f80a4060860 0x7f80a4062d10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f80a8007fd0 tx=0x7f80a8007e70 comp rx=0 tx=0).stop 2024-08-17T02:26:38.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.108+0000 7f80bffff700 1 -- 172.21.15.102:0/516925694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80c0153320 msgr2=0x7f80c00b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.108+0000 7f80bffff700 1 --2- 172.21.15.102:0/516925694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80c0153320 0x7f80c00b0de0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f80b800ec80 tx=0x7f80b80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.108+0000 7f80bffff700 1 -- 172.21.15.102:0/516925694 shutdown_connections 2024-08-17T02:26:38.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.108+0000 7f80bffff700 1 --2- 172.21.15.102:0/516925694 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f80a4060860 0x7f80a4062d10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.108+0000 7f80bffff700 1 --2- 172.21.15.102:0/516925694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80c0153320 0x7f80c00b0de0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.108+0000 7f80bffff700 1 --2- 172.21.15.102:0/516925694 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f80c015a190 0x7f80c00b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.108+0000 7f80bffff700 1 --2- 172.21.15.102:0/516925694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80c00cd1b0 0x7f80c016b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.108+0000 7f80bffff700 1 -- 172.21.15.102:0/516925694 >> 172.21.15.102:0/516925694 conn(0x7f80c00d00a0 msgr2=0x7f80c015ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.108+0000 7f80bffff700 1 -- 172.21.15.102:0/516925694 shutdown_connections 2024-08-17T02:26:38.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.108+0000 7f80bffff700 1 -- 172.21.15.102:0/516925694 wait complete. 2024-08-17T02:26:38.124 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:26:38.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.232+0000 7fa703223700 1 Processor -- start 2024-08-17T02:26:38.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.232+0000 7fa703223700 1 -- start start 2024-08-17T02:26:38.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.232+0000 7fa703223700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa6fc154900 0x7fa6fc0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.232+0000 7fa703223700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6fc0b12d0 0x7fa6fc0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.232+0000 7fa703223700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6fc0cbaa0 con 0x7fa6fc0cb390 2024-08-17T02:26:38.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.232+0000 7fa703223700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6fc068790 con 0x7fa6fc154900 2024-08-17T02:26:38.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.232+0000 7fa703223700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc1583f0 con 0x7fa6fc0b12d0 2024-08-17T02:26:38.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.232+0000 7fa702a22700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa6fc0cb390 0x7fa6fc06df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:58564/0 (socket says 172.21.15.102:58564) 2024-08-17T02:26:38.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.232+0000 7fa702a22700 1 -- 172.21.15.102:0/3550587314 learned_addr learned my addr 172.21.15.102:0/3550587314 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:38.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.232+0000 7fa702221700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa6fc154900 0x7fa6fc0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa701a20700 1 --2- 172.21.15.102:0/3550587314 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6fc0b12d0 0x7fa6fc0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa70121f700 1 -- 172.21.15.102:0/3550587314 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207688450 0 0) 0x7fa6fc0cbaa0 con 0x7fa6fc0cb390 2024-08-17T02:26:38.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa70121f700 1 -- 172.21.15.102:0/3550587314 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6e8003570 con 0x7fa6fc0cb390 2024-08-17T02:26:38.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa702221700 1 -- 172.21.15.102:0/3550587314 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6fc0b12d0 msgr2=0x7fa6fc0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa702221700 1 --2- 172.21.15.102:0/3550587314 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6fc0b12d0 0x7fa6fc0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa702221700 1 -- 172.21.15.102:0/3550587314 >> v1:172.21.15.102:6789/0 conn(0x7fa6fc0cb390 legacy=0x7fa6fc06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa702221700 1 -- 172.21.15.102:0/3550587314 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6fc0b1700 con 0x7fa6fc154900 2024-08-17T02:26:38.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa702221700 1 --2- 172.21.15.102:0/3550587314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc154900 0x7fa6fc0b0d90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80098e0 tx=0x7fa6f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84de058a8505cd5e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa70121f700 1 -- 172.21.15.102:0/3550587314 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8011630 con 0x7fa6fc154900 2024-08-17T02:26:38.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa70121f700 1 -- 172.21.15.102:0/3550587314 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f8011790 con 0x7fa6fc154900 2024-08-17T02:26:38.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa70121f700 1 -- 172.21.15.102:0/3550587314 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8011b30 con 0x7fa6fc154900 2024-08-17T02:26:38.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa703223700 1 -- 172.21.15.102:0/3550587314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc154900 msgr2=0x7fa6fc0b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa703223700 1 --2- 172.21.15.102:0/3550587314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc154900 0x7fa6fc0b0d90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80098e0 tx=0x7fa6f80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa703223700 1 -- 172.21.15.102:0/3550587314 shutdown_connections 2024-08-17T02:26:38.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa703223700 1 --2- 172.21.15.102:0/3550587314 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6fc0b12d0 0x7fa6fc0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa703223700 1 --2- 172.21.15.102:0/3550587314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc154900 0x7fa6fc0b0d90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa703223700 1 -- 172.21.15.102:0/3550587314 >> 172.21.15.102:0/3550587314 conn(0x7fa6fc0678d0 msgr2=0x7fa6fc067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa703223700 1 -- 172.21.15.102:0/3550587314 shutdown_connections 2024-08-17T02:26:38.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.236+0000 7fa703223700 1 -- 172.21.15.102:0/3550587314 wait complete. 2024-08-17T02:26:38.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa703223700 1 Processor -- start 2024-08-17T02:26:38.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa703223700 1 -- start start 2024-08-17T02:26:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa703223700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6fc0b12d0 0x7fa6fc140790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa703223700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc0cb390 0x7fa6fc06a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa703223700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6fc154900 0x7fa6fc06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa703223700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc15d9d0 con 0x7fa6fc0cb390 2024-08-17T02:26:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa703223700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc15bcd0 con 0x7fa6fc0b12d0 2024-08-17T02:26:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa703223700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc15bfb0 con 0x7fa6fc154900 2024-08-17T02:26:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa701a20700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc0cb390 0x7fa6fc06a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa701a20700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc0cb390 0x7fa6fc06a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60330/0 (socket says 172.21.15.102:60330) 2024-08-17T02:26:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa701a20700 1 -- 172.21.15.102:0/616075394 learned_addr learned my addr 172.21.15.102:0/616075394 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa702a22700 1 --2- 172.21.15.102:0/616075394 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6fc154900 0x7fa6fc06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa702221700 1 --2- 172.21.15.102:0/616075394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6fc0b12d0 0x7fa6fc140790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa701a20700 1 -- 172.21.15.102:0/616075394 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6fc154900 msgr2=0x7fa6fc06a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa701a20700 1 --2- 172.21.15.102:0/616075394 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6fc154900 0x7fa6fc06a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa701a20700 1 -- 172.21.15.102:0/616075394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6fc0b12d0 msgr2=0x7fa6fc140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa701a20700 1 --2- 172.21.15.102:0/616075394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6fc0b12d0 0x7fa6fc140790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa701a20700 1 -- 172.21.15.102:0/616075394 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f8009420 con 0x7fa6fc0cb390 2024-08-17T02:26:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.240+0000 7fa702221700 1 --2- 172.21.15.102:0/616075394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6fc0b12d0 0x7fa6fc140790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.244+0000 7fa701a20700 1 --2- 172.21.15.102:0/616075394 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc0cb390 0x7fa6fc06a3d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00ec80 tx=0x7fa6ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.244+0000 7fa6f27fc700 1 -- 172.21.15.102:0/616075394 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec00c9d0 con 0x7fa6fc0cb390 2024-08-17T02:26:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.244+0000 7fa6f27fc700 1 -- 172.21.15.102:0/616075394 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec00cb30 con 0x7fa6fc0cb390 2024-08-17T02:26:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.244+0000 7fa703223700 1 -- 172.21.15.102:0/616075394 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6fc15c290 con 0x7fa6fc0cb390 2024-08-17T02:26:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.244+0000 7fa6f27fc700 1 -- 172.21.15.102:0/616075394 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec013470 con 0x7fa6fc0cb390 2024-08-17T02:26:38.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.244+0000 7fa703223700 1 -- 172.21.15.102:0/616075394 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6fc15c850 con 0x7fa6fc0cb390 2024-08-17T02:26:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.244+0000 7fa6f27fc700 1 -- 172.21.15.102:0/616075394 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa6ec013820 con 0x7fa6fc0cb390 2024-08-17T02:26:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.244+0000 7fa703223700 1 -- 172.21.15.102:0/616075394 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6fc0643a0 con 0x7fa6fc0cb390 2024-08-17T02:26:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.248+0000 7fa6f27fc700 1 --2- 172.21.15.102:0/616075394 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa6e0060860 0x7fa6e0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.248+0000 7fa702221700 1 --2- 172.21.15.102:0/616075394 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa6e0060860 0x7fa6e0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.248+0000 7fa6f27fc700 1 -- 172.21.15.102:0/616075394 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa6ec07cba0 con 0x7fa6fc0cb390 2024-08-17T02:26:38.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.248+0000 7fa702221700 1 --2- 172.21.15.102:0/616075394 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa6e0060860 0x7fa6e0062d10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80091e0 tx=0x7fa6f8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.252+0000 7fa6f27fc700 1 -- 172.21.15.102:0/616075394 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa6ec04d340 con 0x7fa6fc0cb390 2024-08-17T02:26:38.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.468+0000 7fa703223700 1 -- 172.21.15.102:0/616075394 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fa6fc067ca0 con 0x7fa6fc0cb390 2024-08-17T02:26:38.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.480+0000 7fa6f27fc700 1 -- 172.21.15.102:0/616075394 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa6ec050960 con 0x7fa6fc0cb390 2024-08-17T02:26:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.480+0000 7fa703223700 1 -- 172.21.15.102:0/616075394 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa6e0060860 msgr2=0x7fa6e0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.480+0000 7fa703223700 1 --2- 172.21.15.102:0/616075394 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa6e0060860 0x7fa6e0062d10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80091e0 tx=0x7fa6f8017000 comp rx=0 tx=0).stop 2024-08-17T02:26:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.480+0000 7fa703223700 1 -- 172.21.15.102:0/616075394 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc0cb390 msgr2=0x7fa6fc06a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.480+0000 7fa703223700 1 --2- 172.21.15.102:0/616075394 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc0cb390 0x7fa6fc06a3d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00ec80 tx=0x7fa6ec0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.484+0000 7fa703223700 1 -- 172.21.15.102:0/616075394 shutdown_connections 2024-08-17T02:26:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.484+0000 7fa703223700 1 --2- 172.21.15.102:0/616075394 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa6e0060860 0x7fa6e0062d10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.484+0000 7fa703223700 1 --2- 172.21.15.102:0/616075394 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc0cb390 0x7fa6fc06a3d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.484+0000 7fa703223700 1 --2- 172.21.15.102:0/616075394 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa6fc154900 0x7fa6fc06a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.484+0000 7fa703223700 1 --2- 172.21.15.102:0/616075394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6fc0b12d0 0x7fa6fc140790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.484+0000 7fa703223700 1 -- 172.21.15.102:0/616075394 >> 172.21.15.102:0/616075394 conn(0x7fa6fc0678d0 msgr2=0x7fa6fc06e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.484+0000 7fa703223700 1 -- 172.21.15.102:0/616075394 shutdown_connections 2024-08-17T02:26:38.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.484+0000 7fa703223700 1 -- 172.21.15.102:0/616075394 wait complete. 2024-08-17T02:26:38.501 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:26:38.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa40b1fc700 1 Processor -- start 2024-08-17T02:26:38.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa40b1fc700 1 -- start start 2024-08-17T02:26:38.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa40b1fc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa4040b0d20 0x7fa40406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa40b1fc700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa40406e450 0x7fa4040b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa40b1fc700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa404141a00 con 0x7fa4040b1630 2024-08-17T02:26:38.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa40b1fc700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa40406e8a0 con 0x7fa4040b0d20 2024-08-17T02:26:38.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa40b1fc700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa404140b10 con 0x7fa40406e450 2024-08-17T02:26:38.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa4099f9700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa40406e450 0x7fa4040b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa40a1fa700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa4040b0d20 0x7fa40406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa4099f9700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa40406e450 0x7fa4040b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:42632/0 (socket says 172.21.15.102:42632) 2024-08-17T02:26:38.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa4099f9700 1 -- 172.21.15.102:0/4139139917 learned_addr learned my addr 172.21.15.102:0/4139139917 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:38.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa4091f8700 1 -- 172.21.15.102:0/4139139917 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344440962 0 0) 0x7fa404141a00 con 0x7fa4040b1630 2024-08-17T02:26:38.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa4099f9700 1 -- 172.21.15.102:0/4139139917 >> v2:172.21.15.121:3300/0 conn(0x7fa4040b0d20 msgr2=0x7fa40406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa4099f9700 1 --2- 172.21.15.102:0/4139139917 >> v2:172.21.15.121:3300/0 conn(0x7fa4040b0d20 0x7fa40406df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa4099f9700 1 -- 172.21.15.102:0/4139139917 >> v1:172.21.15.121:6789/0 conn(0x7fa4040b1630 legacy=0x7fa4041610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa4099f9700 1 -- 172.21.15.102:0/4139139917 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa404140df0 con 0x7fa40406e450 2024-08-17T02:26:38.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.604+0000 7fa4099f9700 1 --2- 172.21.15.102:0/4139139917 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa40406e450 0x7fa4040b10f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40099b0 tx=0x7fa3f4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2df8e483a6e20af7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.608+0000 7fa4091f8700 1 -- 172.21.15.102:0/4139139917 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4009ea0 con 0x7fa40406e450 2024-08-17T02:26:38.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.608+0000 7fa4091f8700 1 -- 172.21.15.102:0/4139139917 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f400b860 con 0x7fa40406e450 2024-08-17T02:26:38.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.608+0000 7fa4091f8700 1 -- 172.21.15.102:0/4139139917 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400bc00 con 0x7fa40406e450 2024-08-17T02:26:38.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.608+0000 7fa40b1fc700 1 -- 172.21.15.102:0/4139139917 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa40406e450 msgr2=0x7fa4040b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.608+0000 7fa40b1fc700 1 --2- 172.21.15.102:0/4139139917 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa40406e450 0x7fa4040b10f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40099b0 tx=0x7fa3f4009250 comp rx=0 tx=0).stop 2024-08-17T02:26:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.608+0000 7fa40b1fc700 1 -- 172.21.15.102:0/4139139917 shutdown_connections 2024-08-17T02:26:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.608+0000 7fa40b1fc700 1 --2- 172.21.15.102:0/4139139917 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa40406e450 0x7fa4040b10f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.608+0000 7fa40b1fc700 1 --2- 172.21.15.102:0/4139139917 >> v2:172.21.15.121:3300/0 conn(0x7fa4040b0d20 0x7fa40406df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.608+0000 7fa40b1fc700 1 -- 172.21.15.102:0/4139139917 >> 172.21.15.102:0/4139139917 conn(0x7fa4040678d0 msgr2=0x7fa404067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.608+0000 7fa40b1fc700 1 -- 172.21.15.102:0/4139139917 shutdown_connections 2024-08-17T02:26:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.608+0000 7fa40b1fc700 1 -- 172.21.15.102:0/4139139917 wait complete. 2024-08-17T02:26:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.608+0000 7fa40b1fc700 1 Processor -- start 2024-08-17T02:26:38.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.608+0000 7fa40b1fc700 1 -- start start 2024-08-17T02:26:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40b1fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa40406e450 0x7fa40415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40b1fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4040b0d20 0x7fa4040a7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40b1fc700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4040b1630 0x7fa4040a82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40b1fc700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40415ffb0 con 0x7fa40406e450 2024-08-17T02:26:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40b1fc700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40415f120 con 0x7fa4040b0d20 2024-08-17T02:26:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40b1fc700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40415f3a0 con 0x7fa4040b1630 2024-08-17T02:26:38.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40a1fa700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa40406e450 0x7fa40415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40a1fa700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa40406e450 0x7fa40415ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60342/0 (socket says 172.21.15.102:60342) 2024-08-17T02:26:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40a1fa700 1 -- 172.21.15.102:0/3281020492 learned_addr learned my addr 172.21.15.102:0/3281020492 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa4099f9700 1 --2- 172.21.15.102:0/3281020492 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4040b0d20 0x7fa4040a7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40a9fb700 1 --2- 172.21.15.102:0/3281020492 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4040b1630 0x7fa4040a82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40a1fa700 1 -- 172.21.15.102:0/3281020492 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4040b1630 msgr2=0x7fa4040a82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40a1fa700 1 --2- 172.21.15.102:0/3281020492 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4040b1630 0x7fa4040a82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40a1fa700 1 -- 172.21.15.102:0/3281020492 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4040b0d20 msgr2=0x7fa4040a7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40a1fa700 1 --2- 172.21.15.102:0/3281020492 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4040b0d20 0x7fa4040a7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40a1fa700 1 -- 172.21.15.102:0/3281020492 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f40094f0 con 0x7fa40406e450 2024-08-17T02:26:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40a1fa700 1 --2- 172.21.15.102:0/3281020492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa40406e450 0x7fa40415ebe0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009f20 tx=0x7fa3fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa3fa7fc700 1 -- 172.21.15.102:0/3281020492 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc00cbd0 con 0x7fa40406e450 2024-08-17T02:26:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa3fa7fc700 1 -- 172.21.15.102:0/3281020492 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc00f040 con 0x7fa40406e450 2024-08-17T02:26:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40b1fc700 1 -- 172.21.15.102:0/3281020492 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40415f680 con 0x7fa40406e450 2024-08-17T02:26:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa3fa7fc700 1 -- 172.21.15.102:0/3281020492 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc014480 con 0x7fa40406e450 2024-08-17T02:26:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40b1fc700 1 -- 172.21.15.102:0/3281020492 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40415fc40 con 0x7fa40406e450 2024-08-17T02:26:38.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa40b1fc700 1 -- 172.21.15.102:0/3281020492 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4040643a0 con 0x7fa40406e450 2024-08-17T02:26:38.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.612+0000 7fa3fa7fc700 1 -- 172.21.15.102:0/3281020492 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa3fc0147f0 con 0x7fa40406e450 2024-08-17T02:26:38.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.616+0000 7fa3fa7fc700 1 --2- 172.21.15.102:0/3281020492 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa3e8060860 0x7fa3e8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.616+0000 7fa4099f9700 1 --2- 172.21.15.102:0/3281020492 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa3e8060860 0x7fa3e8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.616+0000 7fa3fa7fc700 1 -- 172.21.15.102:0/3281020492 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa3fc07d1d0 con 0x7fa40406e450 2024-08-17T02:26:38.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.616+0000 7fa4099f9700 1 --2- 172.21.15.102:0/3281020492 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa3e8060860 0x7fa3e8062d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40099b0 tx=0x7fa3f4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.620+0000 7fa3fa7fc700 1 -- 172.21.15.102:0/3281020492 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa3fc04d970 con 0x7fa40406e450 2024-08-17T02:26:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.840+0000 7fa40b1fc700 1 -- 172.21.15.102:0/3281020492 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fa4040639f0 con 0x7fa40406e450 2024-08-17T02:26:38.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.844+0000 7fa3fa7fc700 1 -- 172.21.15.102:0/3281020492 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa3fc07be60 con 0x7fa40406e450 2024-08-17T02:26:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.848+0000 7fa40b1fc700 1 -- 172.21.15.102:0/3281020492 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa3e8060860 msgr2=0x7fa3e8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.848+0000 7fa40b1fc700 1 --2- 172.21.15.102:0/3281020492 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa3e8060860 0x7fa3e8062d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40099b0 tx=0x7fa3f4017000 comp rx=0 tx=0).stop 2024-08-17T02:26:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.848+0000 7fa40b1fc700 1 -- 172.21.15.102:0/3281020492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa40406e450 msgr2=0x7fa40415ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.848+0000 7fa40b1fc700 1 --2- 172.21.15.102:0/3281020492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa40406e450 0x7fa40415ebe0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009f20 tx=0x7fa3fc00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:38.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.848+0000 7fa40b1fc700 1 -- 172.21.15.102:0/3281020492 shutdown_connections 2024-08-17T02:26:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.848+0000 7fa40b1fc700 1 --2- 172.21.15.102:0/3281020492 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa3e8060860 0x7fa3e8062d10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.848+0000 7fa40b1fc700 1 --2- 172.21.15.102:0/3281020492 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa4040b1630 0x7fa4040a82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.848+0000 7fa40b1fc700 1 --2- 172.21.15.102:0/3281020492 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4040b0d20 0x7fa4040a7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.848+0000 7fa40b1fc700 1 --2- 172.21.15.102:0/3281020492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa40406e450 0x7fa40415ebe0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.848+0000 7fa40b1fc700 1 -- 172.21.15.102:0/3281020492 >> 172.21.15.102:0/3281020492 conn(0x7fa4040678d0 msgr2=0x7fa40415cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.848+0000 7fa40b1fc700 1 -- 172.21.15.102:0/3281020492 shutdown_connections 2024-08-17T02:26:38.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.848+0000 7fa40b1fc700 1 -- 172.21.15.102:0/3281020492 wait complete. 2024-08-17T02:26:38.866 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:26:38.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca6e09d700 1 Processor -- start 2024-08-17T02:26:38.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca6e09d700 1 -- start start 2024-08-17T02:26:38.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca6e09d700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fca680adf10 0x7fca680ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca6e09d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca6806e470 0x7fca6806e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca6e09d700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca680cb890 con 0x7fca680cad40 2024-08-17T02:26:38.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca6e09d700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca68158290 con 0x7fca680adf10 2024-08-17T02:26:38.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca6e09d700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca681610c0 con 0x7fca6806e470 2024-08-17T02:26:38.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca677fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fca680adf10 0x7fca680ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca67fff700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fca680cad40 0x7fca680cb180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:58568/0 (socket says 172.21.15.102:58568) 2024-08-17T02:26:38.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca67fff700 1 -- 172.21.15.102:0/3750295947 learned_addr learned my addr 172.21.15.102:0/3750295947 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:38.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca677fe700 1 --2- 172.21.15.102:0/3750295947 >> v2:172.21.15.102:3300/0 conn(0x7fca680adf10 0x7fca680ae2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60356/0 (socket says 172.21.15.102:60356) 2024-08-17T02:26:38.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca66ffd700 1 --2- 172.21.15.102:0/3750295947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca6806e470 0x7fca6806e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca677fe700 1 -- 172.21.15.102:0/3750295947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca6806e470 msgr2=0x7fca6806e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca677fe700 1 --2- 172.21.15.102:0/3750295947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca6806e470 0x7fca6806e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca677fe700 1 -- 172.21.15.102:0/3750295947 >> v1:172.21.15.102:6789/0 conn(0x7fca680cad40 legacy=0x7fca680cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca667fc700 1 -- 172.21.15.102:0/3750295947 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299685133 0 0) 0x7fca680cb890 con 0x7fca680cad40 2024-08-17T02:26:38.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca677fe700 1 -- 172.21.15.102:0/3750295947 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca680ae820 con 0x7fca680adf10 2024-08-17T02:26:38.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.972+0000 7fca677fe700 1 --2- 172.21.15.102:0/3750295947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca680adf10 0x7fca680ae2e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fca580098e0 tx=0x7fca580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a2a933bd9b3f59 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca667fc700 1 -- 172.21.15.102:0/3750295947 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5800b640 con 0x7fca680adf10 2024-08-17T02:26:38.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca667fc700 1 -- 172.21.15.102:0/3750295947 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5800b7a0 con 0x7fca680adf10 2024-08-17T02:26:38.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca667fc700 1 -- 172.21.15.102:0/3750295947 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5800bb40 con 0x7fca680adf10 2024-08-17T02:26:38.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca6e09d700 1 -- 172.21.15.102:0/3750295947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca680adf10 msgr2=0x7fca680ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca6e09d700 1 --2- 172.21.15.102:0/3750295947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca680adf10 0x7fca680ae2e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fca580098e0 tx=0x7fca580091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca6e09d700 1 -- 172.21.15.102:0/3750295947 shutdown_connections 2024-08-17T02:26:38.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca6e09d700 1 --2- 172.21.15.102:0/3750295947 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca6806e470 0x7fca6806e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca6e09d700 1 --2- 172.21.15.102:0/3750295947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca680adf10 0x7fca680ae2e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca6e09d700 1 -- 172.21.15.102:0/3750295947 >> 172.21.15.102:0/3750295947 conn(0x7fca68067810 msgr2=0x7fca68067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca6e09d700 1 -- 172.21.15.102:0/3750295947 shutdown_connections 2024-08-17T02:26:38.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca6e09d700 1 -- 172.21.15.102:0/3750295947 wait complete. 2024-08-17T02:26:38.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca6e09d700 1 Processor -- start 2024-08-17T02:26:38.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca6e09d700 1 -- start start 2024-08-17T02:26:38.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca6e09d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca6806e470 0x7fca680b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca6e09d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca680adf10 0x7fca6816e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca6e09d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca680cad40 0x7fca680b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca6e09d700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca68156740 con 0x7fca6806e470 2024-08-17T02:26:38.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.976+0000 7fca6e09d700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca680b0680 con 0x7fca680cad40 2024-08-17T02:26:38.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca6e09d700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca680b1b00 con 0x7fca680adf10 2024-08-17T02:26:38.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca677fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca6806e470 0x7fca680b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca677fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca6806e470 0x7fca680b1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60364/0 (socket says 172.21.15.102:60364) 2024-08-17T02:26:38.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca677fe700 1 -- 172.21.15.102:0/199385897 learned_addr learned my addr 172.21.15.102:0/199385897 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:38.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca67fff700 1 --2- 172.21.15.102:0/199385897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca680cad40 0x7fca680b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca66ffd700 1 --2- 172.21.15.102:0/199385897 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca680adf10 0x7fca6816e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca677fe700 1 -- 172.21.15.102:0/199385897 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca680adf10 msgr2=0x7fca6816e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca677fe700 1 --2- 172.21.15.102:0/199385897 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca680adf10 0x7fca6816e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca677fe700 1 -- 172.21.15.102:0/199385897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca680cad40 msgr2=0x7fca680b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca677fe700 1 --2- 172.21.15.102:0/199385897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca680cad40 0x7fca680b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca677fe700 1 -- 172.21.15.102:0/199385897 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca58009420 con 0x7fca6806e470 2024-08-17T02:26:38.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca677fe700 1 --2- 172.21.15.102:0/199385897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca6806e470 0x7fca680b1520 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fca6806ccb0 tx=0x7fca58017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca5f7fe700 1 -- 172.21.15.102:0/199385897 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5800bb20 con 0x7fca6806e470 2024-08-17T02:26:38.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca5f7fe700 1 -- 172.21.15.102:0/199385897 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca58000c90 con 0x7fca6806e470 2024-08-17T02:26:38.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca5f7fe700 1 -- 172.21.15.102:0/199385897 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58011650 con 0x7fca6806e470 2024-08-17T02:26:38.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca6e09d700 1 -- 172.21.15.102:0/199385897 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca68158950 con 0x7fca6806e470 2024-08-17T02:26:38.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca6e09d700 1 -- 172.21.15.102:0/199385897 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca68158f10 con 0x7fca6806e470 2024-08-17T02:26:38.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca6e09d700 1 -- 172.21.15.102:0/199385897 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca680645c0 con 0x7fca6806e470 2024-08-17T02:26:38.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca5f7fe700 1 -- 172.21.15.102:0/199385897 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fca58011a00 con 0x7fca6806e470 2024-08-17T02:26:38.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca5f7fe700 1 --2- 172.21.15.102:0/199385897 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fca48060860 0x7fca48062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca5f7fe700 1 -- 172.21.15.102:0/199385897 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fca5807ded0 con 0x7fca6806e470 2024-08-17T02:26:38.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.980+0000 7fca66ffd700 1 --2- 172.21.15.102:0/199385897 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fca48060860 0x7fca48062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.984+0000 7fca66ffd700 1 --2- 172.21.15.102:0/199385897 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fca48060860 0x7fca48062d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fca50009fd0 tx=0x7fca5000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:38.988+0000 7fca5f7fe700 1 -- 172.21.15.102:0/199385897 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fca5804e670 con 0x7fca6806e470 2024-08-17T02:26:39.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.216+0000 7fca6e09d700 1 -- 172.21.15.102:0/199385897 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fca68158690 con 0x7fca6806e470 2024-08-17T02:26:39.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.224+0000 7fca5f7fe700 1 -- 172.21.15.102:0/199385897 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fca58011cb0 con 0x7fca6806e470 2024-08-17T02:26:39.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.228+0000 7fca6e09d700 1 -- 172.21.15.102:0/199385897 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fca48060860 msgr2=0x7fca48062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.228+0000 7fca6e09d700 1 --2- 172.21.15.102:0/199385897 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fca48060860 0x7fca48062d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fca50009fd0 tx=0x7fca5000b040 comp rx=0 tx=0).stop 2024-08-17T02:26:39.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.228+0000 7fca6e09d700 1 -- 172.21.15.102:0/199385897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca6806e470 msgr2=0x7fca680b1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.228+0000 7fca6e09d700 1 --2- 172.21.15.102:0/199385897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca6806e470 0x7fca680b1520 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fca6806ccb0 tx=0x7fca58017000 comp rx=0 tx=0).stop 2024-08-17T02:26:39.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.228+0000 7fca6e09d700 1 -- 172.21.15.102:0/199385897 shutdown_connections 2024-08-17T02:26:39.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.228+0000 7fca6e09d700 1 --2- 172.21.15.102:0/199385897 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fca48060860 0x7fca48062d10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.228+0000 7fca6e09d700 1 --2- 172.21.15.102:0/199385897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca680cad40 0x7fca680b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.228+0000 7fca6e09d700 1 --2- 172.21.15.102:0/199385897 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca680adf10 0x7fca6816e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.228+0000 7fca6e09d700 1 --2- 172.21.15.102:0/199385897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca6806e470 0x7fca680b1520 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.228+0000 7fca6e09d700 1 -- 172.21.15.102:0/199385897 >> 172.21.15.102:0/199385897 conn(0x7fca68067810 msgr2=0x7fca6815f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.228+0000 7fca6e09d700 1 -- 172.21.15.102:0/199385897 shutdown_connections 2024-08-17T02:26:39.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.228+0000 7fca6e09d700 1 -- 172.21.15.102:0/199385897 wait complete. 2024-08-17T02:26:39.244 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:39.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.344+0000 7f41c2300700 1 Processor -- start 2024-08-17T02:26:39.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.344+0000 7f41c2300700 1 -- start start 2024-08-17T02:26:39.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c2300700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f41bc155d20 0x7f41bc0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c2300700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41bc0ad7c0 0x7f41bc0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c2300700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41bc0af2b0 con 0x7f41bc06df10 2024-08-17T02:26:39.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c2300700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41bc0adc10 con 0x7f41bc155d20 2024-08-17T02:26:39.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c2300700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc0af590 con 0x7f41bc0ad7c0 2024-08-17T02:26:39.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c12fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f41bc155d20 0x7f41bc0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c12fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f41bc155d20 0x7f41bc0b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60376/0 (socket says 172.21.15.102:60376) 2024-08-17T02:26:39.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c12fe700 1 -- 172.21.15.102:0/119814331 learned_addr learned my addr 172.21.15.102:0/119814331 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:39.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c0afd700 1 --2- 172.21.15.102:0/119814331 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41bc0ad7c0 0x7f41bc0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41bbfff700 1 -- 172.21.15.102:0/119814331 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461519115 0 0) 0x7f41bc0af2b0 con 0x7f41bc06df10 2024-08-17T02:26:39.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41bbfff700 1 -- 172.21.15.102:0/119814331 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41a4003570 con 0x7f41bc06df10 2024-08-17T02:26:39.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c12fe700 1 -- 172.21.15.102:0/119814331 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41bc0ad7c0 msgr2=0x7f41bc0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:39.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c12fe700 1 --2- 172.21.15.102:0/119814331 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41bc0ad7c0 0x7f41bc0aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c12fe700 1 -- 172.21.15.102:0/119814331 >> v1:172.21.15.121:6789/0 conn(0x7f41bc06df10 legacy=0x7f41bc1599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c12fe700 1 -- 172.21.15.102:0/119814331 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41bc0af870 con 0x7f41bc155d20 2024-08-17T02:26:39.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c12fe700 1 --2- 172.21.15.102:0/119814331 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41bc155d20 0x7f41bc0b0350 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0099b0 tx=0x7f41ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f89d52106230cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41bbfff700 1 -- 172.21.15.102:0/119814331 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac00b680 con 0x7f41bc155d20 2024-08-17T02:26:39.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41bbfff700 1 -- 172.21.15.102:0/119814331 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac00b7e0 con 0x7f41bc155d20 2024-08-17T02:26:39.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41bbfff700 1 -- 172.21.15.102:0/119814331 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac00bb80 con 0x7f41bc155d20 2024-08-17T02:26:39.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c2300700 1 -- 172.21.15.102:0/119814331 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41bc155d20 msgr2=0x7f41bc0b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c2300700 1 --2- 172.21.15.102:0/119814331 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41bc155d20 0x7f41bc0b0350 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0099b0 tx=0x7f41ac009250 comp rx=0 tx=0).stop 2024-08-17T02:26:39.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c2300700 1 -- 172.21.15.102:0/119814331 shutdown_connections 2024-08-17T02:26:39.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c2300700 1 --2- 172.21.15.102:0/119814331 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41bc0ad7c0 0x7f41bc0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c2300700 1 --2- 172.21.15.102:0/119814331 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41bc155d20 0x7f41bc0b0350 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c2300700 1 -- 172.21.15.102:0/119814331 >> 172.21.15.102:0/119814331 conn(0x7f41bc0678d0 msgr2=0x7f41bc067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c2300700 1 -- 172.21.15.102:0/119814331 shutdown_connections 2024-08-17T02:26:39.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.348+0000 7f41c2300700 1 -- 172.21.15.102:0/119814331 wait complete. 2024-08-17T02:26:39.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.352+0000 7f41c2300700 1 Processor -- start 2024-08-17T02:26:39.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.352+0000 7f41c2300700 1 -- start start 2024-08-17T02:26:39.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c2300700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41bc06df10 0x7f41bc150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c2300700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41bc0ad7c0 0x7f41bc151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c2300700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41bc155d20 0x7f41bc06a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c2300700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc141b60 con 0x7f41bc155d20 2024-08-17T02:26:39.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c2300700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc156220 con 0x7f41bc0ad7c0 2024-08-17T02:26:39.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c2300700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc156500 con 0x7f41bc06df10 2024-08-17T02:26:39.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c1aff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41bc155d20 0x7f41bc06a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c1aff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41bc155d20 0x7f41bc06a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60382/0 (socket says 172.21.15.102:60382) 2024-08-17T02:26:39.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c1aff700 1 -- 172.21.15.102:0/2960068830 learned_addr learned my addr 172.21.15.102:0/2960068830 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:39.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c0afd700 1 --2- 172.21.15.102:0/2960068830 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41bc0ad7c0 0x7f41bc151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c12fe700 1 --2- 172.21.15.102:0/2960068830 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41bc06df10 0x7f41bc150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c1aff700 1 -- 172.21.15.102:0/2960068830 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41bc06df10 msgr2=0x7f41bc150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c1aff700 1 --2- 172.21.15.102:0/2960068830 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41bc06df10 0x7f41bc150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c1aff700 1 -- 172.21.15.102:0/2960068830 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41bc0ad7c0 msgr2=0x7f41bc151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c1aff700 1 --2- 172.21.15.102:0/2960068830 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41bc0ad7c0 0x7f41bc151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c1aff700 1 -- 172.21.15.102:0/2960068830 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac0094f0 con 0x7f41bc155d20 2024-08-17T02:26:39.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c0afd700 1 --2- 172.21.15.102:0/2960068830 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41bc0ad7c0 0x7f41bc151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:39.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c12fe700 1 --2- 172.21.15.102:0/2960068830 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41bc06df10 0x7f41bc150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:39.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c1aff700 1 --2- 172.21.15.102:0/2960068830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41bc155d20 0x7f41bc06a550 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f41b400c590 tx=0x7f41b4007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41b97fa700 1 -- 172.21.15.102:0/2960068830 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4016070 con 0x7f41bc155d20 2024-08-17T02:26:39.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41b97fa700 1 -- 172.21.15.102:0/2960068830 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b4011590 con 0x7f41bc155d20 2024-08-17T02:26:39.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c2300700 1 -- 172.21.15.102:0/2960068830 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41bc1567e0 con 0x7f41bc155d20 2024-08-17T02:26:39.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41b97fa700 1 -- 172.21.15.102:0/2960068830 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4011970 con 0x7f41bc155d20 2024-08-17T02:26:39.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c2300700 1 -- 172.21.15.102:0/2960068830 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41bc156da0 con 0x7f41bc155d20 2024-08-17T02:26:39.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41c2300700 1 -- 172.21.15.102:0/2960068830 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41bc156fc0 con 0x7f41bc155d20 2024-08-17T02:26:39.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.356+0000 7f41b97fa700 1 -- 172.21.15.102:0/2960068830 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f41b4012420 con 0x7f41bc155d20 2024-08-17T02:26:39.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.360+0000 7f41b97fa700 1 --2- 172.21.15.102:0/2960068830 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f41a8060860 0x7f41a8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.360+0000 7f41b97fa700 1 -- 172.21.15.102:0/2960068830 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f41b407c430 con 0x7f41bc155d20 2024-08-17T02:26:39.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.360+0000 7f41c12fe700 1 --2- 172.21.15.102:0/2960068830 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f41a8060860 0x7f41a8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.360+0000 7f41c12fe700 1 --2- 172.21.15.102:0/2960068830 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f41a8060860 0x7f41a8062d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0099b0 tx=0x7f41ac017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.364+0000 7f41b97fa700 1 -- 172.21.15.102:0/2960068830 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f41b404cbd0 con 0x7f41bc155d20 2024-08-17T02:26:39.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.532+0000 7f41c2300700 1 -- 172.21.15.102:0/2960068830 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41bc0643a0 con 0x7f41bc155d20 2024-08-17T02:26:39.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.536+0000 7f41b97fa700 1 -- 172.21.15.102:0/2960068830 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12182 (secure 0 0 0) 0x7f41b40501f0 con 0x7f41bc155d20 2024-08-17T02:26:39.538 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:39.538 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":28,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:26:36.571828+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:39.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.536+0000 7f41c2300700 1 -- 172.21.15.102:0/2960068830 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f41a8060860 msgr2=0x7f41a8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.536+0000 7f41c2300700 1 --2- 172.21.15.102:0/2960068830 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f41a8060860 0x7f41a8062d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0099b0 tx=0x7f41ac017000 comp rx=0 tx=0).stop 2024-08-17T02:26:39.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.536+0000 7f41c2300700 1 -- 172.21.15.102:0/2960068830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41bc155d20 msgr2=0x7f41bc06a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.536+0000 7f41c2300700 1 --2- 172.21.15.102:0/2960068830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41bc155d20 0x7f41bc06a550 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f41b400c590 tx=0x7f41b4007d80 comp rx=0 tx=0).stop 2024-08-17T02:26:39.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.536+0000 7f41c2300700 1 -- 172.21.15.102:0/2960068830 shutdown_connections 2024-08-17T02:26:39.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.536+0000 7f41c2300700 1 --2- 172.21.15.102:0/2960068830 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f41a8060860 0x7f41a8062d10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.536+0000 7f41c2300700 1 --2- 172.21.15.102:0/2960068830 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41bc155d20 0x7f41bc06a550 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.536+0000 7f41c2300700 1 --2- 172.21.15.102:0/2960068830 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41bc0ad7c0 0x7f41bc151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.540+0000 7f41c2300700 1 --2- 172.21.15.102:0/2960068830 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f41bc06df10 0x7f41bc150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.540+0000 7f41c2300700 1 -- 172.21.15.102:0/2960068830 >> 172.21.15.102:0/2960068830 conn(0x7f41bc0678d0 msgr2=0x7f41bc0acd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.540+0000 7f41c2300700 1 -- 172.21.15.102:0/2960068830 shutdown_connections 2024-08-17T02:26:39.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.540+0000 7f41c2300700 1 -- 172.21.15.102:0/2960068830 wait complete. 2024-08-17T02:26:39.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:49.236728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:26:39.559 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:39.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.672+0000 7f5013b31700 1 Processor -- start 2024-08-17T02:26:39.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.672+0000 7f5013b31700 1 -- start start 2024-08-17T02:26:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f5013b31700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f500c0adb60 0x7f500c0cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f5013b31700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500c0c8cd0 con 0x7f500c0cbc30 2024-08-17T02:26:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f5013b31700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500c0c89f0 con 0x7f500c0ad6e0 2024-08-17T02:26:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f5013b31700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500c0c3940 con 0x7f500c0adb60 2024-08-17T02:26:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50118cd700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f500c0cbc30 0x7f500c0ca2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:58578/0 (socket says 172.21.15.102:58578) 2024-08-17T02:26:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50118cd700 1 -- 172.21.15.102:0/744037509 learned_addr learned my addr 172.21.15.102:0/744037509 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50120ce700 1 --2- 172.21.15.102:0/744037509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f500c0adb60 0x7f500c0cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 -- 172.21.15.102:0/744037509 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390043811 0 0) 0x7f500c0c8cd0 con 0x7f500c0cbc30 2024-08-17T02:26:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 -- 172.21.15.102:0/744037509 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ff8003570 con 0x7f500c0cbc30 2024-08-17T02:26:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 -- 172.21.15.102:0/744037509 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063172582 0 0) 0x7f500c0c89f0 con 0x7f500c0ad6e0 2024-08-17T02:26:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 -- 172.21.15.102:0/744037509 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f500c0c8cd0 con 0x7f500c0ad6e0 2024-08-17T02:26:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 -- 172.21.15.102:0/744037509 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 641382782 0 0) 0x7f4ff8003570 con 0x7f500c0cbc30 2024-08-17T02:26:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 -- 172.21.15.102:0/744037509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f500c0adb60 msgr2=0x7f500c0cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 --2- 172.21.15.102:0/744037509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f500c0adb60 0x7f500c0cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 -- 172.21.15.102:0/744037509 >> v1:172.21.15.121:6789/0 conn(0x7f500c0ad6e0 legacy=0x7f500c0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 -- 172.21.15.102:0/744037509 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c0c3c20 con 0x7f500c0cbc30 2024-08-17T02:26:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 -- 172.21.15.102:0/744037509 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7f4ffc0013f0 con 0x7f500c0cbc30 2024-08-17T02:26:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 -- 172.21.15.102:0/744037509 >> v1:172.21.15.102:6789/0 conn(0x7f500c0cbc30 legacy=0x7f500c0ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 --2- 172.21.15.102:0/744037509 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ff8003c20 0x7f4ff8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 --2- 172.21.15.102:0/744037509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f500c0adb60 0x7f4ff8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 --2- 172.21.15.102:0/744037509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ff8004d50 0x7f4ff80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 -- 172.21.15.102:0/744037509 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c0c3940 con 0x7f4ff8003c20 2024-08-17T02:26:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 -- 172.21.15.102:0/744037509 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff800bbf0 con 0x7f4ff8004d50 2024-08-17T02:26:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 -- 172.21.15.102:0/744037509 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff800bdb0 con 0x7f500c0adb60 2024-08-17T02:26:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50120ce700 1 --2- 172.21.15.102:0/744037509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ff8004d50 0x7f4ff80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50118cd700 1 --2- 172.21.15.102:0/744037509 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ff8003c20 0x7f4ff8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50110cc700 1 --2- 172.21.15.102:0/744037509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f500c0adb60 0x7f4ff8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50120ce700 1 -- 172.21.15.102:0/744037509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f500c0adb60 msgr2=0x7f4ff8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50120ce700 1 --2- 172.21.15.102:0/744037509 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f500c0adb60 0x7f4ff8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50120ce700 1 -- 172.21.15.102:0/744037509 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ff8003c20 msgr2=0x7f4ff8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50120ce700 1 --2- 172.21.15.102:0/744037509 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ff8003c20 0x7f4ff8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50120ce700 1 -- 172.21.15.102:0/744037509 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff8003570 con 0x7f4ff8004d50 2024-08-17T02:26:39.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50120ce700 1 --2- 172.21.15.102:0/744037509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ff8004d50 0x7f4ff80051c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f50040094d0 tx=0x7f500400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1862aa8589eff6f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 -- 172.21.15.102:0/744037509 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500400ea60 con 0x7f4ff8004d50 2024-08-17T02:26:39.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 -- 172.21.15.102:0/744037509 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500400f040 con 0x7f4ff8004d50 2024-08-17T02:26:39.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.676+0000 7f50108cb700 1 -- 172.21.15.102:0/744037509 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500400edf0 con 0x7f4ff8004d50 2024-08-17T02:26:39.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.680+0000 7f5013b31700 1 -- 172.21.15.102:0/744037509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ff8004d50 msgr2=0x7f4ff80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.680+0000 7f5013b31700 1 --2- 172.21.15.102:0/744037509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ff8004d50 0x7f4ff80051c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f50040094d0 tx=0x7f500400b040 comp rx=0 tx=0).stop 2024-08-17T02:26:39.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.680+0000 7f50120ce700 1 -- 172.21.15.102:0/744037509 reap_dead start 2024-08-17T02:26:39.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.680+0000 7f5013b31700 1 -- 172.21.15.102:0/744037509 shutdown_connections 2024-08-17T02:26:39.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.680+0000 7f5013b31700 1 -- 172.21.15.102:0/744037509 >> 172.21.15.102:0/744037509 conn(0x7f500c0caad0 msgr2=0x7f500c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.680+0000 7f5013b31700 1 -- 172.21.15.102:0/744037509 shutdown_connections 2024-08-17T02:26:39.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.680+0000 7f5013b31700 1 -- 172.21.15.102:0/744037509 wait complete. 2024-08-17T02:26:39.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.680+0000 7f5013b31700 1 Processor -- start 2024-08-17T02:26:39.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.680+0000 7f5013b31700 1 -- start start 2024-08-17T02:26:39.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f5013b31700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ff8004d50 0x7f500c1577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f5013b31700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f500c0ac730 0x7f500c0a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f5013b31700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f500c0acba0 0x7f500c0c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f5013b31700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c0b1da0 con 0x7f4ff8004d50 2024-08-17T02:26:39.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f5013b31700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c0c6090 con 0x7f500c0acba0 2024-08-17T02:26:39.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f5013b31700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500c0b1190 con 0x7f500c0ac730 2024-08-17T02:26:39.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f50118cd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ff8004d50 0x7f500c1577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f50118cd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ff8004d50 0x7f500c1577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60406/0 (socket says 172.21.15.102:60406) 2024-08-17T02:26:39.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f50118cd700 1 -- 172.21.15.102:0/590532043 learned_addr learned my addr 172.21.15.102:0/590532043 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:39.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f50110cc700 1 --2- 172.21.15.102:0/590532043 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f500c0ac730 0x7f500c0a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f50120ce700 1 --2- 172.21.15.102:0/590532043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f500c0acba0 0x7f500c0c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f50118cd700 1 -- 172.21.15.102:0/590532043 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f500c0ac730 msgr2=0x7f500c0a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f50118cd700 1 --2- 172.21.15.102:0/590532043 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f500c0ac730 0x7f500c0a9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f50118cd700 1 -- 172.21.15.102:0/590532043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f500c0acba0 msgr2=0x7f500c0c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f50118cd700 1 --2- 172.21.15.102:0/590532043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f500c0acba0 0x7f500c0c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f50118cd700 1 -- 172.21.15.102:0/590532043 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c0b1470 con 0x7f4ff8004d50 2024-08-17T02:26:39.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f50118cd700 1 --2- 172.21.15.102:0/590532043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ff8004d50 0x7f500c1577c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc001030 tx=0x7f4ffc001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f5001ffb700 1 -- 172.21.15.102:0/590532043 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc018030 con 0x7f4ff8004d50 2024-08-17T02:26:39.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f5001ffb700 1 -- 172.21.15.102:0/590532043 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc00f690 con 0x7f4ff8004d50 2024-08-17T02:26:39.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f5013b31700 1 -- 172.21.15.102:0/590532043 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500c0b1750 con 0x7f4ff8004d50 2024-08-17T02:26:39.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f5001ffb700 1 -- 172.21.15.102:0/590532043 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc00fa50 con 0x7f4ff8004d50 2024-08-17T02:26:39.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.684+0000 7f5013b31700 1 -- 172.21.15.102:0/590532043 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500c0b0e60 con 0x7f4ff8004d50 2024-08-17T02:26:39.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.688+0000 7f5013b31700 1 -- 172.21.15.102:0/590532043 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500c0645c0 con 0x7f4ff8004d50 2024-08-17T02:26:39.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.688+0000 7f5001ffb700 1 -- 172.21.15.102:0/590532043 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4ffc01b070 con 0x7f4ff8004d50 2024-08-17T02:26:39.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.688+0000 7f5001ffb700 1 --2- 172.21.15.102:0/590532043 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4ff0060860 0x7f4ff0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.688+0000 7f5001ffb700 1 -- 172.21.15.102:0/590532043 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4ffc019070 con 0x7f4ff8004d50 2024-08-17T02:26:39.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.688+0000 7f50110cc700 1 --2- 172.21.15.102:0/590532043 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4ff0060860 0x7f4ff0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.688+0000 7f50110cc700 1 --2- 172.21.15.102:0/590532043 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4ff0060860 0x7f4ff0062d10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5008007e40 tx=0x7f5008007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.700+0000 7f5001ffb700 1 -- 172.21.15.102:0/590532043 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4ffc04d050 con 0x7f4ff8004d50 2024-08-17T02:26:39.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.864+0000 7f5013b31700 1 -- 172.21.15.102:0/590532043 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f500c0cd910 con 0x7f4ff8004d50 2024-08-17T02:26:39.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.864+0000 7f5001ffb700 1 -- 172.21.15.102:0/590532043 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ffc050670 con 0x7f4ff8004d50 2024-08-17T02:26:39.867 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-08-17T02:26:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.868+0000 7f5013b31700 1 -- 172.21.15.102:0/590532043 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4ff0060860 msgr2=0x7f4ff0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.868+0000 7f5013b31700 1 --2- 172.21.15.102:0/590532043 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4ff0060860 0x7f4ff0062d10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5008007e40 tx=0x7f5008007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.868+0000 7f5013b31700 1 -- 172.21.15.102:0/590532043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ff8004d50 msgr2=0x7f500c1577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.868+0000 7f5013b31700 1 --2- 172.21.15.102:0/590532043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ff8004d50 0x7f500c1577c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc001030 tx=0x7f4ffc001cc0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.868+0000 7f5013b31700 1 -- 172.21.15.102:0/590532043 shutdown_connections 2024-08-17T02:26:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.868+0000 7f5013b31700 1 --2- 172.21.15.102:0/590532043 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4ff0060860 0x7f4ff0062d10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.868+0000 7f5013b31700 1 --2- 172.21.15.102:0/590532043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f500c0acba0 0x7f500c0c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.868+0000 7f5013b31700 1 --2- 172.21.15.102:0/590532043 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f500c0ac730 0x7f500c0a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.868+0000 7f5013b31700 1 --2- 172.21.15.102:0/590532043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ff8004d50 0x7f500c1577c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.868+0000 7f5013b31700 1 -- 172.21.15.102:0/590532043 >> 172.21.15.102:0/590532043 conn(0x7f500c0caad0 msgr2=0x7f500c13f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.868+0000 7f5013b31700 1 -- 172.21.15.102:0/590532043 shutdown_connections 2024-08-17T02:26:39.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.868+0000 7f5013b31700 1 -- 172.21.15.102:0/590532043 wait complete. 2024-08-17T02:26:39.887 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:26:39.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.984+0000 7f5e8ec9a700 1 Processor -- start 2024-08-17T02:26:39.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.984+0000 7f5e8ec9a700 1 -- start start 2024-08-17T02:26:39.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8ec9a700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5e88158eb0 0x7f5e880aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8ec9a700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5e8806e620 0x7f5e880ac490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8ec9a700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e880ac000 con 0x7f5e880aecc0 2024-08-17T02:26:39.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8ec9a700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e880ab3f0 con 0x7f5e88158eb0 2024-08-17T02:26:39.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8ec9a700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e880ab6d0 con 0x7f5e8806e620 2024-08-17T02:26:39.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8dc98700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5e88158eb0 0x7f5e880aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8dc98700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5e88158eb0 0x7f5e880aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60422/0 (socket says 172.21.15.102:60422) 2024-08-17T02:26:39.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8dc98700 1 -- 172.21.15.102:0/931723674 learned_addr learned my addr 172.21.15.102:0/931723674 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:39.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8e499700 1 --2- 172.21.15.102:0/931723674 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5e8806e620 0x7f5e880ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8dc98700 1 -- 172.21.15.102:0/931723674 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5e8806e620 msgr2=0x7f5e880ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:39.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8dc98700 1 --2- 172.21.15.102:0/931723674 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5e8806e620 0x7f5e880ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8dc98700 1 -- 172.21.15.102:0/931723674 >> v1:172.21.15.121:6789/0 conn(0x7f5e880aecc0 legacy=0x7f5e8806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8dc98700 1 -- 172.21.15.102:0/931723674 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e880ab9b0 con 0x7f5e88158eb0 2024-08-17T02:26:39.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8cc96700 1 -- 172.21.15.102:0/931723674 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962438002 0 0) 0x7f5e880ac000 con 0x7f5e880aecc0 2024-08-17T02:26:39.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8dc98700 1 --2- 172.21.15.102:0/931723674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e88158eb0 0x7f5e880aaa80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5e840099b0 tx=0x7f5e84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12592388eaf3b513 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8cc96700 1 -- 172.21.15.102:0/931723674 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84009ea0 con 0x7f5e88158eb0 2024-08-17T02:26:39.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8cc96700 1 -- 172.21.15.102:0/931723674 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8400b860 con 0x7f5e88158eb0 2024-08-17T02:26:39.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8cc96700 1 -- 172.21.15.102:0/931723674 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8400bc00 con 0x7f5e88158eb0 2024-08-17T02:26:39.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8ec9a700 1 -- 172.21.15.102:0/931723674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e88158eb0 msgr2=0x7f5e880aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8ec9a700 1 --2- 172.21.15.102:0/931723674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e88158eb0 0x7f5e880aaa80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5e840099b0 tx=0x7f5e84009250 comp rx=0 tx=0).stop 2024-08-17T02:26:39.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8ec9a700 1 -- 172.21.15.102:0/931723674 shutdown_connections 2024-08-17T02:26:39.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8ec9a700 1 --2- 172.21.15.102:0/931723674 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5e8806e620 0x7f5e880ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8ec9a700 1 --2- 172.21.15.102:0/931723674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e88158eb0 0x7f5e880aaa80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8ec9a700 1 -- 172.21.15.102:0/931723674 >> 172.21.15.102:0/931723674 conn(0x7f5e880678d0 msgr2=0x7f5e88067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8ec9a700 1 -- 172.21.15.102:0/931723674 shutdown_connections 2024-08-17T02:26:39.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.988+0000 7f5e8ec9a700 1 -- 172.21.15.102:0/931723674 wait complete. 2024-08-17T02:26:39.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.992+0000 7f5e8ec9a700 1 Processor -- start 2024-08-17T02:26:39.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.992+0000 7f5e8ec9a700 1 -- start start 2024-08-17T02:26:39.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.992+0000 7f5e8ec9a700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e8806e620 0x7f5e880cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.992+0000 7f5e8ec9a700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5e880aecc0 0x7f5e88156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.992+0000 7f5e8ec9a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e88158eb0 0x7f5e88156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.992+0000 7f5e8ec9a700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e880c9ca0 con 0x7f5e8806e620 2024-08-17T02:26:39.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.992+0000 7f5e8ec9a700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e880c9370 con 0x7f5e88158eb0 2024-08-17T02:26:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.992+0000 7f5e8ec9a700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e880c9650 con 0x7f5e880aecc0 2024-08-17T02:26:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.992+0000 7f5e8dc98700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e8806e620 0x7f5e880cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.992+0000 7f5e8dc98700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e8806e620 0x7f5e880cb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60428/0 (socket says 172.21.15.102:60428) 2024-08-17T02:26:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.992+0000 7f5e8dc98700 1 -- 172.21.15.102:0/716093205 learned_addr learned my addr 172.21.15.102:0/716093205 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.992+0000 7f5e8e499700 1 --2- 172.21.15.102:0/716093205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e88158eb0 0x7f5e88156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.996+0000 7f5e8dc98700 1 -- 172.21.15.102:0/716093205 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5e880aecc0 msgr2=0x7f5e88156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.996+0000 7f5e8d497700 1 --2- 172.21.15.102:0/716093205 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5e880aecc0 0x7f5e88156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.996+0000 7f5e8dc98700 1 --2- 172.21.15.102:0/716093205 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5e880aecc0 0x7f5e88156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.996+0000 7f5e8dc98700 1 -- 172.21.15.102:0/716093205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e88158eb0 msgr2=0x7f5e88156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.996+0000 7f5e8dc98700 1 --2- 172.21.15.102:0/716093205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e88158eb0 0x7f5e88156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.996+0000 7f5e8dc98700 1 -- 172.21.15.102:0/716093205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e840094f0 con 0x7f5e8806e620 2024-08-17T02:26:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.996+0000 7f5e8e499700 1 --2- 172.21.15.102:0/716093205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e88158eb0 0x7f5e88156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.996+0000 7f5e8d497700 1 --2- 172.21.15.102:0/716093205 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5e880aecc0 0x7f5e88156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.996+0000 7f5e8dc98700 1 --2- 172.21.15.102:0/716093205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e8806e620 0x7f5e880cb020 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009290 tx=0x7f5e84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.996+0000 7f5e79ffb700 1 -- 172.21.15.102:0/716093205 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8400baa0 con 0x7f5e8806e620 2024-08-17T02:26:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.996+0000 7f5e79ffb700 1 -- 172.21.15.102:0/716093205 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e84025420 con 0x7f5e8806e620 2024-08-17T02:26:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.996+0000 7f5e8ec9a700 1 -- 172.21.15.102:0/716093205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e880c9930 con 0x7f5e8806e620 2024-08-17T02:26:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.996+0000 7f5e79ffb700 1 -- 172.21.15.102:0/716093205 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8400bc00 con 0x7f5e8806e620 2024-08-17T02:26:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.996+0000 7f5e8ec9a700 1 -- 172.21.15.102:0/716093205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e88152170 con 0x7f5e8806e620 2024-08-17T02:26:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.996+0000 7f5e737fe700 1 -- 172.21.15.102:0/716093205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e600052b0 con 0x7f5e8806e620 2024-08-17T02:26:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:39.996+0000 7f5e79ffb700 1 -- 172.21.15.102:0/716093205 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5e84023070 con 0x7f5e8806e620 2024-08-17T02:26:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.000+0000 7f5e79ffb700 1 --2- 172.21.15.102:0/716093205 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5e6c060860 0x7f5e6c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.000+0000 7f5e8d497700 1 --2- 172.21.15.102:0/716093205 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5e6c060860 0x7f5e6c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.000+0000 7f5e79ffb700 1 -- 172.21.15.102:0/716093205 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5e8407df80 con 0x7f5e8806e620 2024-08-17T02:26:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.000+0000 7f5e8d497700 1 --2- 172.21.15.102:0/716093205 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5e6c060860 0x7f5e6c062d10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c007fd0 tx=0x7f5e7c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.004+0000 7f5e79ffb700 1 -- 172.21.15.102:0/716093205 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5e8404e680 con 0x7f5e8806e620 2024-08-17T02:26:40.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.168+0000 7f5e737fe700 1 -- 172.21.15.102:0/716093205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5e60005560 con 0x7f5e8806e620 2024-08-17T02:26:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.168+0000 7f5e79ffb700 1 -- 172.21.15.102:0/716093205 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5e8402a090 con 0x7f5e8806e620 2024-08-17T02:26:40.172 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:40.172 INFO:teuthology.orchestra.run.smithi102.stdout:[ 2024-08-17T02:26:40.172 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:40.172 INFO:teuthology.orchestra.run.smithi102.stdout: "poolnum": 1, 2024-08-17T02:26:40.172 INFO:teuthology.orchestra.run.smithi102.stdout: "poolname": ".mgr" 2024-08-17T02:26:40.173 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:40.173 INFO:teuthology.orchestra.run.smithi102.stdout:] 2024-08-17T02:26:40.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.172+0000 7f5e737fe700 1 -- 172.21.15.102:0/716093205 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5e6c060860 msgr2=0x7f5e6c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.172+0000 7f5e737fe700 1 --2- 172.21.15.102:0/716093205 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5e6c060860 0x7f5e6c062d10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c007fd0 tx=0x7f5e7c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.172+0000 7f5e737fe700 1 -- 172.21.15.102:0/716093205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e8806e620 msgr2=0x7f5e880cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.172+0000 7f5e737fe700 1 --2- 172.21.15.102:0/716093205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e8806e620 0x7f5e880cb020 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009290 tx=0x7f5e84017000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.172+0000 7f5e737fe700 1 -- 172.21.15.102:0/716093205 shutdown_connections 2024-08-17T02:26:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.172+0000 7f5e737fe700 1 --2- 172.21.15.102:0/716093205 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5e6c060860 0x7f5e6c062d10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.172+0000 7f5e737fe700 1 --2- 172.21.15.102:0/716093205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e88158eb0 0x7f5e88156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.172+0000 7f5e737fe700 1 --2- 172.21.15.102:0/716093205 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5e880aecc0 0x7f5e88156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.172+0000 7f5e737fe700 1 --2- 172.21.15.102:0/716093205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e8806e620 0x7f5e880cb020 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.172+0000 7f5e737fe700 1 -- 172.21.15.102:0/716093205 >> 172.21.15.102:0/716093205 conn(0x7f5e880678d0 msgr2=0x7f5e880a9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.172+0000 7f5e737fe700 1 -- 172.21.15.102:0/716093205 shutdown_connections 2024-08-17T02:26:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.172+0000 7f5e737fe700 1 -- 172.21.15.102:0/716093205 wait complete. 2024-08-17T02:26:40.186 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:26:40.186 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:26:40.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.300+0000 7f836d4a3700 1 Processor -- start 2024-08-17T02:26:40.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.300+0000 7f836d4a3700 1 -- start start 2024-08-17T02:26:40.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f836d4a3700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f83680ce640 0x7f83680b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f836d4a3700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83680cea10 0x7f83680cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f836d4a3700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83680c5bb0 con 0x7f83680cc230 2024-08-17T02:26:40.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f836d4a3700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83680cc670 con 0x7f83680ce640 2024-08-17T02:26:40.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f836d4a3700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83680c4fa0 con 0x7f83680cea10 2024-08-17T02:26:40.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f836cca2700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f83680cc230 0x7f83680c6040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:58588/0 (socket says 172.21.15.102:58588) 2024-08-17T02:26:40.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f836cca2700 1 -- 172.21.15.102:0/3030755759 learned_addr learned my addr 172.21.15.102:0/3030755759 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:40.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f8367fff700 1 --2- 172.21.15.102:0/3030755759 >> v2:172.21.15.102:3300/0 conn(0x7f83680ce640 0x7f83680b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f83677fe700 1 --2- 172.21.15.102:0/3030755759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83680cea10 0x7f83680cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f8366ffd700 1 -- 172.21.15.102:0/3030755759 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456228129 0 0) 0x7f83680c5bb0 con 0x7f83680cc230 2024-08-17T02:26:40.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f8366ffd700 1 -- 172.21.15.102:0/3030755759 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8350003570 con 0x7f83680cc230 2024-08-17T02:26:40.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f8366ffd700 1 -- 172.21.15.102:0/3030755759 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 173305498 0 0) 0x7f8350003570 con 0x7f83680cc230 2024-08-17T02:26:40.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f83677fe700 1 -- 172.21.15.102:0/3030755759 >> v2:172.21.15.102:3300/0 conn(0x7f83680ce640 msgr2=0x7f83680b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f83677fe700 1 --2- 172.21.15.102:0/3030755759 >> v2:172.21.15.102:3300/0 conn(0x7f83680ce640 0x7f83680b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f83677fe700 1 -- 172.21.15.102:0/3030755759 >> v1:172.21.15.102:6789/0 conn(0x7f83680cc230 legacy=0x7f83680c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f83677fe700 1 -- 172.21.15.102:0/3030755759 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83680c5280 con 0x7f83680cea10 2024-08-17T02:26:40.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f83677fe700 1 --2- 172.21.15.102:0/3030755759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83680cea10 0x7f83680cbcf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f83580098e0 tx=0x7f83580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3583cda66a565fd2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f8366ffd700 1 -- 172.21.15.102:0/3030755759 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83600017f0 con 0x7f83680cea10 2024-08-17T02:26:40.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f8366ffd700 1 -- 172.21.15.102:0/3030755759 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8358011420 con 0x7f83680cea10 2024-08-17T02:26:40.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f8366ffd700 1 -- 172.21.15.102:0/3030755759 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83580117c0 con 0x7f83680cea10 2024-08-17T02:26:40.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f836d4a3700 1 -- 172.21.15.102:0/3030755759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83680cea10 msgr2=0x7f83680cbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f836d4a3700 1 --2- 172.21.15.102:0/3030755759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83680cea10 0x7f83680cbcf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f83580098e0 tx=0x7f83580091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f836d4a3700 1 -- 172.21.15.102:0/3030755759 shutdown_connections 2024-08-17T02:26:40.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f836d4a3700 1 --2- 172.21.15.102:0/3030755759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83680cea10 0x7f83680cbcf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f836d4a3700 1 --2- 172.21.15.102:0/3030755759 >> v2:172.21.15.102:3300/0 conn(0x7f83680ce640 0x7f83680b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f836d4a3700 1 -- 172.21.15.102:0/3030755759 >> 172.21.15.102:0/3030755759 conn(0x7f8368099410 msgr2=0x7f83680675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f836d4a3700 1 -- 172.21.15.102:0/3030755759 shutdown_connections 2024-08-17T02:26:40.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.304+0000 7f836d4a3700 1 -- 172.21.15.102:0/3030755759 wait complete. 2024-08-17T02:26:40.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f836d4a3700 1 Processor -- start 2024-08-17T02:26:40.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f836d4a3700 1 -- start start 2024-08-17T02:26:40.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f836d4a3700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83680cc230 0x7f836809a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f836d4a3700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83680ce640 0x7f8368158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f836d4a3700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83680cea10 0x7f8368145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f836d4a3700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8368169fa0 con 0x7f83680cc230 2024-08-17T02:26:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f836d4a3700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836809aa00 con 0x7f83680cea10 2024-08-17T02:26:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f836d4a3700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8368169390 con 0x7f83680ce640 2024-08-17T02:26:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f8367fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83680cc230 0x7f836809a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f8367fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83680cc230 0x7f836809a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60444/0 (socket says 172.21.15.102:60444) 2024-08-17T02:26:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f8367fff700 1 -- 172.21.15.102:0/419130750 learned_addr learned my addr 172.21.15.102:0/419130750 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f83677fe700 1 --2- 172.21.15.102:0/419130750 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83680ce640 0x7f8368158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f836cca2700 1 --2- 172.21.15.102:0/419130750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83680cea10 0x7f8368145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f8367fff700 1 -- 172.21.15.102:0/419130750 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83680ce640 msgr2=0x7f8368158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f8367fff700 1 --2- 172.21.15.102:0/419130750 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83680ce640 0x7f8368158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f8367fff700 1 -- 172.21.15.102:0/419130750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83680cea10 msgr2=0x7f8368145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f8367fff700 1 --2- 172.21.15.102:0/419130750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83680cea10 0x7f8368145730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f8367fff700 1 -- 172.21.15.102:0/419130750 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8358009420 con 0x7f83680cc230 2024-08-17T02:26:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f8367fff700 1 --2- 172.21.15.102:0/419130750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83680cc230 0x7f836809a4c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f835c00ec80 tx=0x7f835c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f834ffff700 1 -- 172.21.15.102:0/419130750 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c00c850 con 0x7f83680cc230 2024-08-17T02:26:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f834ffff700 1 -- 172.21.15.102:0/419130750 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c00c9b0 con 0x7f83680cc230 2024-08-17T02:26:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f836d4a3700 1 -- 172.21.15.102:0/419130750 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8368169670 con 0x7f83680cc230 2024-08-17T02:26:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f836d4a3700 1 -- 172.21.15.102:0/419130750 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8368169c30 con 0x7f83680cc230 2024-08-17T02:26:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.308+0000 7f834ffff700 1 -- 172.21.15.102:0/419130750 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c00cd50 con 0x7f83680cc230 2024-08-17T02:26:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.312+0000 7f836d4a3700 1 -- 172.21.15.102:0/419130750 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83680644b0 con 0x7f83680cc230 2024-08-17T02:26:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.312+0000 7f834ffff700 1 -- 172.21.15.102:0/419130750 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f835c013680 con 0x7f83680cc230 2024-08-17T02:26:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.312+0000 7f834ffff700 1 --2- 172.21.15.102:0/419130750 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8354060860 0x7f8354062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.312+0000 7f834ffff700 1 -- 172.21.15.102:0/419130750 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f835c07cba0 con 0x7f83680cc230 2024-08-17T02:26:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.312+0000 7f83677fe700 1 --2- 172.21.15.102:0/419130750 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8354060860 0x7f8354062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.312+0000 7f83677fe700 1 --2- 172.21.15.102:0/419130750 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8354060860 0x7f8354062d10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f83580030c0 tx=0x7f8358016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.320+0000 7f834ffff700 1 -- 172.21.15.102:0/419130750 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f835c04d2a0 con 0x7f83680cc230 2024-08-17T02:26:40.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.484+0000 7f836d4a3700 1 -- 172.21.15.102:0/419130750 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8368070560 con 0x7f83680cc230 2024-08-17T02:26:40.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.856+0000 7f834ffff700 1 -- 172.21.15.102:0/419130750 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f835c0508c0 con 0x7f83680cc230 2024-08-17T02:26:40.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.864+0000 7f836d4a3700 1 -- 172.21.15.102:0/419130750 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8354060860 msgr2=0x7f8354062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.864+0000 7f836d4a3700 1 --2- 172.21.15.102:0/419130750 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8354060860 0x7f8354062d10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f83580030c0 tx=0x7f8358016000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.864+0000 7f836d4a3700 1 -- 172.21.15.102:0/419130750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83680cc230 msgr2=0x7f836809a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.864+0000 7f836d4a3700 1 --2- 172.21.15.102:0/419130750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83680cc230 0x7f836809a4c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f835c00ec80 tx=0x7f835c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.868+0000 7f836d4a3700 1 -- 172.21.15.102:0/419130750 shutdown_connections 2024-08-17T02:26:40.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.868+0000 7f836d4a3700 1 --2- 172.21.15.102:0/419130750 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8354060860 0x7f8354062d10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.868+0000 7f836d4a3700 1 --2- 172.21.15.102:0/419130750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83680cea10 0x7f8368145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.868+0000 7f836d4a3700 1 --2- 172.21.15.102:0/419130750 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83680ce640 0x7f8368158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.868+0000 7f836d4a3700 1 --2- 172.21.15.102:0/419130750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83680cc230 0x7f836809a4c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.868+0000 7f836d4a3700 1 -- 172.21.15.102:0/419130750 >> 172.21.15.102:0/419130750 conn(0x7f8368099410 msgr2=0x7f83680cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.868+0000 7f836d4a3700 1 -- 172.21.15.102:0/419130750 shutdown_connections 2024-08-17T02:26:40.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.868+0000 7f836d4a3700 1 -- 172.21.15.102:0/419130750 wait complete. 2024-08-17T02:26:40.872 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_metadata' created 2024-08-17T02:26:40.884 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:26:41.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.996+0000 7f6c8c936700 1 Processor -- start 2024-08-17T02:26:41.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:40.996+0000 7f6c8c936700 1 -- start start 2024-08-17T02:26:41.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c8c936700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c88066e00 0x7f6c880671d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c8c936700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6c880b2720 0x7f6c880b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c8c936700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c880cbbf0 con 0x7f6c880cc080 2024-08-17T02:26:41.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c8c936700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c88067710 con 0x7f6c880b2720 2024-08-17T02:26:41.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c8c936700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880cd440 con 0x7f6c88066e00 2024-08-17T02:26:41.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c87fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6c880b2720 0x7f6c880b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c87fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6c880b2720 0x7f6c880b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60446/0 (socket says 172.21.15.102:60446) 2024-08-17T02:26:41.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c87fff700 1 -- 172.21.15.102:0/2375774282 learned_addr learned my addr 172.21.15.102:0/2375774282 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:41.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c86ffd700 1 --1- 172.21.15.102:0/2375774282 >> v1:172.21.15.102:6789/0 conn(0x7f6c880cc080 0x7f6c880b2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:58592/0 (socket says 172.21.15.102:58592) 2024-08-17T02:26:41.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c877fe700 1 --2- 172.21.15.102:0/2375774282 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c88066e00 0x7f6c880671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c87fff700 1 -- 172.21.15.102:0/2375774282 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c88066e00 msgr2=0x7f6c880671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c87fff700 1 --2- 172.21.15.102:0/2375774282 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c88066e00 0x7f6c880671d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c87fff700 1 -- 172.21.15.102:0/2375774282 >> v1:172.21.15.102:6789/0 conn(0x7f6c880cc080 legacy=0x7f6c880b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c87fff700 1 -- 172.21.15.102:0/2375774282 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c880cafe0 con 0x7f6c880b2720 2024-08-17T02:26:41.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c87fff700 1 --2- 172.21.15.102:0/2375774282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c880b2720 0x7f6c880b2ea0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6c80009f20 tx=0x7f6c80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480804526c88c7d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c867fc700 1 -- 172.21.15.102:0/2375774282 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8000e070 con 0x7f6c880b2720 2024-08-17T02:26:41.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c867fc700 1 -- 172.21.15.102:0/2375774282 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8000ba80 con 0x7f6c880b2720 2024-08-17T02:26:41.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c867fc700 1 -- 172.21.15.102:0/2375774282 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c800092e0 con 0x7f6c880b2720 2024-08-17T02:26:41.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c8c936700 1 -- 172.21.15.102:0/2375774282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c880b2720 msgr2=0x7f6c880b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c8c936700 1 --2- 172.21.15.102:0/2375774282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c880b2720 0x7f6c880b2ea0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6c80009f20 tx=0x7f6c80009840 comp rx=0 tx=0).stop 2024-08-17T02:26:41.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c8c936700 1 -- 172.21.15.102:0/2375774282 shutdown_connections 2024-08-17T02:26:41.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c8c936700 1 --2- 172.21.15.102:0/2375774282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c880b2720 0x7f6c880b2ea0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c8c936700 1 --2- 172.21.15.102:0/2375774282 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c88066e00 0x7f6c880671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c8c936700 1 -- 172.21.15.102:0/2375774282 >> 172.21.15.102:0/2375774282 conn(0x7f6c880682c0 msgr2=0x7f6c880686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c8c936700 1 -- 172.21.15.102:0/2375774282 shutdown_connections 2024-08-17T02:26:41.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.000+0000 7f6c8c936700 1 -- 172.21.15.102:0/2375774282 wait complete. 2024-08-17T02:26:41.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.004+0000 7f6c8c936700 1 Processor -- start 2024-08-17T02:26:41.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.004+0000 7f6c8c936700 1 -- start start 2024-08-17T02:26:41.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.004+0000 7f6c8c936700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c88066e00 0x7f6c8816ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.004+0000 7f6c8c936700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c880b2720 0x7f6c8816cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.004+0000 7f6c8c936700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c880cc080 0x7f6c88146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.004+0000 7f6c8c936700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880c62e0 con 0x7f6c880cc080 2024-08-17T02:26:41.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.004+0000 7f6c8c936700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880c5d20 con 0x7f6c880b2720 2024-08-17T02:26:41.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.004+0000 7f6c8c936700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880c6000 con 0x7f6c88066e00 2024-08-17T02:26:41.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.004+0000 7f6c87fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c880cc080 0x7f6c88146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.004+0000 7f6c87fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c880cc080 0x7f6c88146c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60456/0 (socket says 172.21.15.102:60456) 2024-08-17T02:26:41.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.004+0000 7f6c87fff700 1 -- 172.21.15.102:0/1125381235 learned_addr learned my addr 172.21.15.102:0/1125381235 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:41.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.004+0000 7f6c877fe700 1 --2- 172.21.15.102:0/1125381235 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c88066e00 0x7f6c8816ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.004+0000 7f6c86ffd700 1 --2- 172.21.15.102:0/1125381235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c880b2720 0x7f6c8816cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.004+0000 7f6c87fff700 1 -- 172.21.15.102:0/1125381235 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c88066e00 msgr2=0x7f6c8816ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.004+0000 7f6c87fff700 1 --2- 172.21.15.102:0/1125381235 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c88066e00 0x7f6c8816ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.004+0000 7f6c87fff700 1 -- 172.21.15.102:0/1125381235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c880b2720 msgr2=0x7f6c8816cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.008+0000 7f6c87fff700 1 --2- 172.21.15.102:0/1125381235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c880b2720 0x7f6c8816cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.008+0000 7f6c87fff700 1 -- 172.21.15.102:0/1125381235 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c80009ae0 con 0x7f6c880cc080 2024-08-17T02:26:41.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.008+0000 7f6c87fff700 1 --2- 172.21.15.102:0/1125381235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c880cc080 0x7f6c88146c00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6c880891a0 tx=0x7f6c80018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.008+0000 7f6c7f7fe700 1 -- 172.21.15.102:0/1125381235 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c800032f0 con 0x7f6c880cc080 2024-08-17T02:26:41.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.008+0000 7f6c7f7fe700 1 -- 172.21.15.102:0/1125381235 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c80008dd0 con 0x7f6c880cc080 2024-08-17T02:26:41.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.008+0000 7f6c8c936700 1 -- 172.21.15.102:0/1125381235 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8816a7a0 con 0x7f6c880cc080 2024-08-17T02:26:41.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.008+0000 7f6c7f7fe700 1 -- 172.21.15.102:0/1125381235 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80026690 con 0x7f6c880cc080 2024-08-17T02:26:41.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.008+0000 7f6c8c936700 1 -- 172.21.15.102:0/1125381235 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c880ca540 con 0x7f6c880cc080 2024-08-17T02:26:41.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.008+0000 7f6c8c936700 1 -- 172.21.15.102:0/1125381235 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8816a600 con 0x7f6c880cc080 2024-08-17T02:26:41.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.008+0000 7f6c7f7fe700 1 -- 172.21.15.102:0/1125381235 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6c80003040 con 0x7f6c880cc080 2024-08-17T02:26:41.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.008+0000 7f6c7f7fe700 1 --2- 172.21.15.102:0/1125381235 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6c68060860 0x7f6c68062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.008+0000 7f6c877fe700 1 --2- 172.21.15.102:0/1125381235 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6c68060860 0x7f6c68062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.008+0000 7f6c7f7fe700 1 -- 172.21.15.102:0/1125381235 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f6c8007e9d0 con 0x7f6c880cc080 2024-08-17T02:26:41.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.012+0000 7f6c877fe700 1 --2- 172.21.15.102:0/1125381235 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6c68060860 0x7f6c68062d10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6c70006fd0 tx=0x7f6c70008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.016+0000 7f6c7f7fe700 1 -- 172.21.15.102:0/1125381235 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6c8816a600 con 0x7f6c880cc080 2024-08-17T02:26:41.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.184+0000 7f6c8c936700 1 -- 172.21.15.102:0/1125381235 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6c8816a600 con 0x7f6c880cc080 2024-08-17T02:26:41.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.860+0000 7f6c7f7fe700 1 -- 172.21.15.102:0/1125381235 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6c8816a600 con 0x7f6c880cc080 2024-08-17T02:26:41.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.872+0000 7f6c8c936700 1 -- 172.21.15.102:0/1125381235 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6c68060860 msgr2=0x7f6c68062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.872+0000 7f6c8c936700 1 --2- 172.21.15.102:0/1125381235 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6c68060860 0x7f6c68062d10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6c70006fd0 tx=0x7f6c70008040 comp rx=0 tx=0).stop 2024-08-17T02:26:41.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.872+0000 7f6c8c936700 1 -- 172.21.15.102:0/1125381235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c880cc080 msgr2=0x7f6c88146c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.872+0000 7f6c8c936700 1 --2- 172.21.15.102:0/1125381235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c880cc080 0x7f6c88146c00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6c880891a0 tx=0x7f6c80018000 comp rx=0 tx=0).stop 2024-08-17T02:26:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.876+0000 7f6c8c936700 1 -- 172.21.15.102:0/1125381235 shutdown_connections 2024-08-17T02:26:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.876+0000 7f6c8c936700 1 --2- 172.21.15.102:0/1125381235 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6c68060860 0x7f6c68062d10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.876+0000 7f6c8c936700 1 --2- 172.21.15.102:0/1125381235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c880cc080 0x7f6c88146c00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.876+0000 7f6c8c936700 1 --2- 172.21.15.102:0/1125381235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c880b2720 0x7f6c8816cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.876+0000 7f6c8c936700 1 --2- 172.21.15.102:0/1125381235 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f6c88066e00 0x7f6c8816ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.876+0000 7f6c8c936700 1 -- 172.21.15.102:0/1125381235 >> 172.21.15.102:0/1125381235 conn(0x7f6c880682c0 msgr2=0x7f6c880b5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.876+0000 7f6c8c936700 1 -- 172.21.15.102:0/1125381235 shutdown_connections 2024-08-17T02:26:41.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.876+0000 7f6c8c936700 1 -- 172.21.15.102:0/1125381235 wait complete. 2024-08-17T02:26:41.885 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data' created 2024-08-17T02:26:41.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:26:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.996+0000 7f581d655700 1 Processor -- start 2024-08-17T02:26:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:41.996+0000 7f581d655700 1 -- start start 2024-08-17T02:26:42.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f581d655700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f581806ead0 0x7f581806eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f581d655700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58180b1830 0x7f5818155c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f581d655700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58180ace30 con 0x7f581806e010 2024-08-17T02:26:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f581d655700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58180b1c80 con 0x7f581806ead0 2024-08-17T02:26:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f581d655700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58180ae6b0 con 0x7f58180b1830 2024-08-17T02:26:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f581ce54700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f581806e010 0x7f5818152bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48162/0 (socket says 172.21.15.102:48162) 2024-08-17T02:26:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f581ce54700 1 -- 172.21.15.102:0/3403238442 learned_addr learned my addr 172.21.15.102:0/3403238442 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f58177fe700 1 --2- 172.21.15.102:0/3403238442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58180b1830 0x7f5818155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f5817fff700 1 --2- 172.21.15.102:0/3403238442 >> v2:172.21.15.121:3300/0 conn(0x7f581806ead0 0x7f581806eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f5816ffd700 1 -- 172.21.15.102:0/3403238442 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 858406697 0 0) 0x7f58180ace30 con 0x7f581806e010 2024-08-17T02:26:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f5816ffd700 1 -- 172.21.15.102:0/3403238442 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f8003570 con 0x7f581806e010 2024-08-17T02:26:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f58177fe700 1 -- 172.21.15.102:0/3403238442 >> v2:172.21.15.121:3300/0 conn(0x7f581806ead0 msgr2=0x7f581806eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f58177fe700 1 --2- 172.21.15.102:0/3403238442 >> v2:172.21.15.121:3300/0 conn(0x7f581806ead0 0x7f581806eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f58177fe700 1 -- 172.21.15.102:0/3403238442 >> v1:172.21.15.102:6789/0 conn(0x7f581806e010 legacy=0x7f5818152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f58177fe700 1 -- 172.21.15.102:0/3403238442 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5818156dd0 con 0x7f58180b1830 2024-08-17T02:26:42.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f58177fe700 1 --2- 172.21.15.102:0/3403238442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58180b1830 0x7f5818155c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5800009e60 tx=0x7f5800009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3878bbb61af521d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f5816ffd700 1 -- 172.21.15.102:0/3403238442 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580000e070 con 0x7f58180b1830 2024-08-17T02:26:42.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f5816ffd700 1 -- 172.21.15.102:0/3403238442 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580000bab0 con 0x7f58180b1830 2024-08-17T02:26:42.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f5816ffd700 1 -- 172.21.15.102:0/3403238442 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580000be70 con 0x7f58180b1830 2024-08-17T02:26:42.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f581d655700 1 -- 172.21.15.102:0/3403238442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58180b1830 msgr2=0x7f5818155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f581d655700 1 --2- 172.21.15.102:0/3403238442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58180b1830 0x7f5818155c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5800009e60 tx=0x7f5800009780 comp rx=0 tx=0).stop 2024-08-17T02:26:42.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f581d655700 1 -- 172.21.15.102:0/3403238442 shutdown_connections 2024-08-17T02:26:42.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f581d655700 1 --2- 172.21.15.102:0/3403238442 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58180b1830 0x7f5818155c00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f581d655700 1 --2- 172.21.15.102:0/3403238442 >> v2:172.21.15.121:3300/0 conn(0x7f581806ead0 0x7f581806eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f581d655700 1 -- 172.21.15.102:0/3403238442 >> 172.21.15.102:0/3403238442 conn(0x7f58180678a0 msgr2=0x7f5818067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f581d655700 1 -- 172.21.15.102:0/3403238442 shutdown_connections 2024-08-17T02:26:42.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.000+0000 7f581d655700 1 -- 172.21.15.102:0/3403238442 wait complete. 2024-08-17T02:26:42.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f581d655700 1 Processor -- start 2024-08-17T02:26:42.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f581d655700 1 -- start start 2024-08-17T02:26:42.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f581d655700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f581806e010 0x7f5818157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f581d655700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f581806ead0 0x7f58180adc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f581d655700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58180b1830 0x7f5818142350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f581d655700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5818150ea0 con 0x7f581806e010 2024-08-17T02:26:42.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f581d655700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581814b670 con 0x7f581806ead0 2024-08-17T02:26:42.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f581d655700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581814b950 con 0x7f58180b1830 2024-08-17T02:26:42.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f5817fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f581806e010 0x7f5818157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f5817fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f581806e010 0x7f5818157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55020/0 (socket says 172.21.15.102:55020) 2024-08-17T02:26:42.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f5817fff700 1 -- 172.21.15.102:0/921464460 learned_addr learned my addr 172.21.15.102:0/921464460 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:42.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f58177fe700 1 --2- 172.21.15.102:0/921464460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f581806ead0 0x7f58180adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f581ce54700 1 --2- 172.21.15.102:0/921464460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58180b1830 0x7f5818142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f581ce54700 1 -- 172.21.15.102:0/921464460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f581806ead0 msgr2=0x7f58180adc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f581ce54700 1 --2- 172.21.15.102:0/921464460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f581806ead0 0x7f58180adc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f581ce54700 1 -- 172.21.15.102:0/921464460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f581806e010 msgr2=0x7f5818157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f581ce54700 1 --2- 172.21.15.102:0/921464460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f581806e010 0x7f5818157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f581ce54700 1 -- 172.21.15.102:0/921464460 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5800009a20 con 0x7f58180b1830 2024-08-17T02:26:42.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.004+0000 7f581ce54700 1 --2- 172.21.15.102:0/921464460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58180b1830 0x7f5818142350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f58080058d0 tx=0x7f5808007d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.008+0000 7f580ffff700 1 -- 172.21.15.102:0/921464460 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580800ce10 con 0x7f58180b1830 2024-08-17T02:26:42.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.008+0000 7f580ffff700 1 -- 172.21.15.102:0/921464460 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5808005b30 con 0x7f58180b1830 2024-08-17T02:26:42.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.008+0000 7f581d655700 1 -- 172.21.15.102:0/921464460 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58181510d0 con 0x7f58180b1830 2024-08-17T02:26:42.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.008+0000 7f580ffff700 1 -- 172.21.15.102:0/921464460 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58080070d0 con 0x7f58180b1830 2024-08-17T02:26:42.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.008+0000 7f581d655700 1 -- 172.21.15.102:0/921464460 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58180ae190 con 0x7f58180b1830 2024-08-17T02:26:42.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.008+0000 7f581d655700 1 -- 172.21.15.102:0/921464460 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58180ae3e0 con 0x7f58180b1830 2024-08-17T02:26:42.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.008+0000 7f580ffff700 1 -- 172.21.15.102:0/921464460 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5808007480 con 0x7f58180b1830 2024-08-17T02:26:42.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.008+0000 7f580ffff700 1 --2- 172.21.15.102:0/921464460 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f57fc060860 0x7f57fc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.008+0000 7f580ffff700 1 -- 172.21.15.102:0/921464460 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f580807bcf0 con 0x7f58180b1830 2024-08-17T02:26:42.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.008+0000 7f5817fff700 1 --2- 172.21.15.102:0/921464460 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f57fc060860 0x7f57fc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.008+0000 7f5817fff700 1 --2- 172.21.15.102:0/921464460 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f57fc060860 0x7f57fc062d10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5810009dd0 tx=0x7f58100091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.020+0000 7f580ffff700 1 -- 172.21.15.102:0/921464460 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f580804a480 con 0x7f58180b1830 2024-08-17T02:26:42.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.216+0000 7f581d655700 1 -- 172.21.15.102:0/921464460 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f58180643a0 con 0x7f58180b1830 2024-08-17T02:26:42.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.904+0000 7f580ffff700 1 -- 172.21.15.102:0/921464460 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f58180643a0 con 0x7f58180b1830 2024-08-17T02:26:42.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.916+0000 7f581d655700 1 -- 172.21.15.102:0/921464460 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f57fc060860 msgr2=0x7f57fc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.916+0000 7f581d655700 1 --2- 172.21.15.102:0/921464460 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f57fc060860 0x7f57fc062d10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5810009dd0 tx=0x7f58100091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.916+0000 7f581d655700 1 -- 172.21.15.102:0/921464460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58180b1830 msgr2=0x7f5818142350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.916+0000 7f581d655700 1 --2- 172.21.15.102:0/921464460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58180b1830 0x7f5818142350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f58080058d0 tx=0x7f5808007d10 comp rx=0 tx=0).stop 2024-08-17T02:26:42.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.916+0000 7f581d655700 1 -- 172.21.15.102:0/921464460 shutdown_connections 2024-08-17T02:26:42.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.916+0000 7f581d655700 1 --2- 172.21.15.102:0/921464460 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f57fc060860 0x7f57fc062d10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.916+0000 7f581d655700 1 --2- 172.21.15.102:0/921464460 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58180b1830 0x7f5818142350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.916+0000 7f581d655700 1 --2- 172.21.15.102:0/921464460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f581806ead0 0x7f58180adc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.916+0000 7f581d655700 1 --2- 172.21.15.102:0/921464460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f581806e010 0x7f5818157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.916+0000 7f581d655700 1 -- 172.21.15.102:0/921464460 >> 172.21.15.102:0/921464460 conn(0x7f58180678a0 msgr2=0x7f581814d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.916+0000 7f581d655700 1 -- 172.21.15.102:0/921464460 shutdown_connections 2024-08-17T02:26:42.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:42.916+0000 7f581d655700 1 -- 172.21.15.102:0/921464460 wait complete. 2024-08-17T02:26:42.923 INFO:teuthology.orchestra.run.smithi102.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:26:42.934 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:43.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.032+0000 7f7f56cc5700 1 Processor -- start 2024-08-17T02:26:43.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.032+0000 7f7f56cc5700 1 -- start start 2024-08-17T02:26:43.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.032+0000 7f7f56cc5700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7f50154900 0x7f7f500b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.032+0000 7f7f56cc5700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f500b1730 con 0x7f7f500cb560 2024-08-17T02:26:43.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.032+0000 7f7f56cc5700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f500cbaa0 con 0x7f7f500b12d0 2024-08-17T02:26:43.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.032+0000 7f7f56cc5700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f50068790 con 0x7f7f50154900 2024-08-17T02:26:43.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f55cc3700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7f50154900 0x7f7f500b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f564c4700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f7f500cb560 0x7f7f50160ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48178/0 (socket says 172.21.15.102:48178) 2024-08-17T02:26:43.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f564c4700 1 -- 172.21.15.102:0/493735207 learned_addr learned my addr 172.21.15.102:0/493735207 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:43.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f55cc3700 1 -- 172.21.15.102:0/493735207 >> v1:172.21.15.121:6789/0 conn(0x7f7f500b12d0 legacy=0x7f7f500cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f55cc3700 1 -- 172.21.15.102:0/493735207 >> v1:172.21.15.102:6789/0 conn(0x7f7f500cb560 legacy=0x7f7f50160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f54cc1700 1 -- 172.21.15.102:0/493735207 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652114295 0 0) 0x7f7f48001490 con 0x7f7f500cb560 2024-08-17T02:26:43.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f55cc3700 1 -- 172.21.15.102:0/493735207 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f50157630 con 0x7f7f50154900 2024-08-17T02:26:43.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f55cc3700 1 --2- 172.21.15.102:0/493735207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f50154900 0x7f7f500b0d90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7f400098e0 tx=0x7f7f400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb5ace66200bff7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f54cc1700 1 -- 172.21.15.102:0/493735207 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40009e80 con 0x7f7f50154900 2024-08-17T02:26:43.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f54cc1700 1 -- 172.21.15.102:0/493735207 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4000b860 con 0x7f7f50154900 2024-08-17T02:26:43.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f54cc1700 1 -- 172.21.15.102:0/493735207 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4000bbe0 con 0x7f7f50154900 2024-08-17T02:26:43.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f56cc5700 1 -- 172.21.15.102:0/493735207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f50154900 msgr2=0x7f7f500b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f56cc5700 1 --2- 172.21.15.102:0/493735207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f50154900 0x7f7f500b0d90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7f400098e0 tx=0x7f7f400091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f56cc5700 1 -- 172.21.15.102:0/493735207 shutdown_connections 2024-08-17T02:26:43.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f56cc5700 1 --2- 172.21.15.102:0/493735207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f50154900 0x7f7f500b0d90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f56cc5700 1 -- 172.21.15.102:0/493735207 >> 172.21.15.102:0/493735207 conn(0x7f7f500678d0 msgr2=0x7f7f50067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f56cc5700 1 -- 172.21.15.102:0/493735207 shutdown_connections 2024-08-17T02:26:43.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.036+0000 7f7f56cc5700 1 -- 172.21.15.102:0/493735207 wait complete. 2024-08-17T02:26:43.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f56cc5700 1 Processor -- start 2024-08-17T02:26:43.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f56cc5700 1 -- start start 2024-08-17T02:26:43.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f56cc5700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f500b12d0 0x7f7f50156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f56cc5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f500cb560 0x7f7f500aae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f56cc5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f50154900 0x7f7f500a8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f56cc5700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f50156a90 con 0x7f7f50154900 2024-08-17T02:26:43.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f56cc5700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5016b660 con 0x7f7f500cb560 2024-08-17T02:26:43.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f56cc5700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f500a6840 con 0x7f7f500b12d0 2024-08-17T02:26:43.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f564c4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f50154900 0x7f7f500a8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f55cc3700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f500b12d0 0x7f7f50156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f554c2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f500cb560 0x7f7f500aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f564c4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f50154900 0x7f7f500a8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55034/0 (socket says 172.21.15.102:55034) 2024-08-17T02:26:43.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f554c2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f500cb560 0x7f7f500aae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:39044/0 (socket says 172.21.15.102:39044) 2024-08-17T02:26:43.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f55cc3700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f500b12d0 0x7f7f50156550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:54812/0 (socket says 172.21.15.102:54812) 2024-08-17T02:26:43.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f564c4700 1 -- 172.21.15.102:0/3453611565 learned_addr learned my addr 172.21.15.102:0/3453611565 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:43.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f554c2700 1 -- 172.21.15.102:0/3453611565 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f500b12d0 msgr2=0x7f7f50156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f554c2700 1 --2- 172.21.15.102:0/3453611565 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f500b12d0 0x7f7f50156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f554c2700 1 -- 172.21.15.102:0/3453611565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f50154900 msgr2=0x7f7f500a8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f554c2700 1 --2- 172.21.15.102:0/3453611565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f50154900 0x7f7f500a8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f554c2700 1 -- 172.21.15.102:0/3453611565 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f40009420 con 0x7f7f500cb560 2024-08-17T02:26:43.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f554c2700 1 --2- 172.21.15.102:0/3453611565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f500cb560 0x7f7f500aae50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00c5c0 tx=0x7f7f4c007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f45ffb700 1 -- 172.21.15.102:0/3453611565 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c011590 con 0x7f7f500cb560 2024-08-17T02:26:43.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f56cc5700 1 -- 172.21.15.102:0/3453611565 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5016aae0 con 0x7f7f500cb560 2024-08-17T02:26:43.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f45ffb700 1 -- 172.21.15.102:0/3453611565 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c011710 con 0x7f7f500cb560 2024-08-17T02:26:43.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f45ffb700 1 -- 172.21.15.102:0/3453611565 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c011ad0 con 0x7f7f500cb560 2024-08-17T02:26:43.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.040+0000 7f7f56cc5700 1 -- 172.21.15.102:0/3453611565 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5016b0a0 con 0x7f7f500cb560 2024-08-17T02:26:43.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.044+0000 7f7f56cc5700 1 -- 172.21.15.102:0/3453611565 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f500a6e60 con 0x7f7f500cb560 2024-08-17T02:26:43.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.044+0000 7f7f45ffb700 1 -- 172.21.15.102:0/3453611565 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7f4c033ad0 con 0x7f7f500cb560 2024-08-17T02:26:43.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.044+0000 7f7f45ffb700 1 --2- 172.21.15.102:0/3453611565 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7f34060860 0x7f7f34062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.044+0000 7f7f45ffb700 1 -- 172.21.15.102:0/3453611565 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7f4c07bdf0 con 0x7f7f500cb560 2024-08-17T02:26:43.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.044+0000 7f7f55cc3700 1 --2- 172.21.15.102:0/3453611565 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7f34060860 0x7f7f34062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.044+0000 7f7f55cc3700 1 --2- 172.21.15.102:0/3453611565 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7f34060860 0x7f7f34062d10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7f400093f0 tx=0x7f7f40017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.052+0000 7f7f45ffb700 1 -- 172.21.15.102:0/3453611565 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7f4c04c240 con 0x7f7f500cb560 2024-08-17T02:26:43.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.220+0000 7f7f56cc5700 1 -- 172.21.15.102:0/3453611565 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f500a6e60 con 0x7f7f500cb560 2024-08-17T02:26:43.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.220+0000 7f7f45ffb700 1 -- 172.21.15.102:0/3453611565 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f7f500a6e60 con 0x7f7f500cb560 2024-08-17T02:26:43.225 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:43.226 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":31,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:26:42.223579+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:40.530641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:41.227445+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:43.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.224+0000 7f7f56cc5700 1 -- 172.21.15.102:0/3453611565 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7f34060860 msgr2=0x7f7f34062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.224+0000 7f7f56cc5700 1 --2- 172.21.15.102:0/3453611565 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7f34060860 0x7f7f34062d10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7f400093f0 tx=0x7f7f40017000 comp rx=0 tx=0).stop 2024-08-17T02:26:43.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.224+0000 7f7f56cc5700 1 -- 172.21.15.102:0/3453611565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f500cb560 msgr2=0x7f7f500aae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.224+0000 7f7f56cc5700 1 --2- 172.21.15.102:0/3453611565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f500cb560 0x7f7f500aae50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00c5c0 tx=0x7f7f4c007ec0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.224+0000 7f7f56cc5700 1 -- 172.21.15.102:0/3453611565 shutdown_connections 2024-08-17T02:26:43.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.224+0000 7f7f56cc5700 1 --2- 172.21.15.102:0/3453611565 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7f34060860 0x7f7f34062d10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.224+0000 7f7f56cc5700 1 --2- 172.21.15.102:0/3453611565 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f50154900 0x7f7f500a8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.224+0000 7f7f56cc5700 1 --2- 172.21.15.102:0/3453611565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f500cb560 0x7f7f500aae50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.224+0000 7f7f56cc5700 1 --2- 172.21.15.102:0/3453611565 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7f500b12d0 0x7f7f50156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.224+0000 7f7f56cc5700 1 -- 172.21.15.102:0/3453611565 >> 172.21.15.102:0/3453611565 conn(0x7f7f500678d0 msgr2=0x7f7f500c9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.224+0000 7f7f56cc5700 1 -- 172.21.15.102:0/3453611565 shutdown_connections 2024-08-17T02:26:43.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.224+0000 7f7f56cc5700 1 -- 172.21.15.102:0/3453611565 wait complete. 2024-08-17T02:26:43.244 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:43.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.344+0000 7fa2f32c7700 1 Processor -- start 2024-08-17T02:26:43.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.344+0000 7fa2f32c7700 1 -- start start 2024-08-17T02:26:43.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.344+0000 7fa2f32c7700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa2ec06e130 0x7fa2ec0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.344+0000 7fa2f32c7700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa2ec068be0 0x7fa2ec160c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.344+0000 7fa2f32c7700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ec0c36f0 con 0x7fa2ec157060 2024-08-17T02:26:43.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.344+0000 7fa2f32c7700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ec0caec0 con 0x7fa2ec06e130 2024-08-17T02:26:43.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.344+0000 7fa2f32c7700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ec06e590 con 0x7fa2ec068be0 2024-08-17T02:26:43.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.344+0000 7fa2f0862700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa2ec06e130 0x7fa2ec0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.344+0000 7fa2f0862700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa2ec06e130 0x7fa2ec0686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55040/0 (socket says 172.21.15.102:55040) 2024-08-17T02:26:43.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.344+0000 7fa2f0862700 1 -- 172.21.15.102:0/3252936112 learned_addr learned my addr 172.21.15.102:0/3252936112 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:43.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.344+0000 7fa2f1063700 1 --1- 172.21.15.102:0/3252936112 >> v1:172.21.15.102:6789/0 conn(0x7fa2ec157060 0x7fa2ec06a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48190/0 (socket says 172.21.15.102:48190) 2024-08-17T02:26:43.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2f0862700 1 -- 172.21.15.102:0/3252936112 >> v2:172.21.15.121:3300/0 conn(0x7fa2ec068be0 msgr2=0x7fa2ec160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:43.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.344+0000 7fa2f1864700 1 --2- 172.21.15.102:0/3252936112 >> v2:172.21.15.121:3300/0 conn(0x7fa2ec068be0 0x7fa2ec160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2f0862700 1 --2- 172.21.15.102:0/3252936112 >> v2:172.21.15.121:3300/0 conn(0x7fa2ec068be0 0x7fa2ec160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2e3fff700 1 -- 172.21.15.102:0/3252936112 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374649078 0 0) 0x7fa2ec0c36f0 con 0x7fa2ec157060 2024-08-17T02:26:43.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2f0862700 1 -- 172.21.15.102:0/3252936112 >> v1:172.21.15.102:6789/0 conn(0x7fa2ec157060 legacy=0x7fa2ec06a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2f0862700 1 -- 172.21.15.102:0/3252936112 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec068fb0 con 0x7fa2ec06e130 2024-08-17T02:26:43.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2f1864700 1 --2- 172.21.15.102:0/3252936112 >> v2:172.21.15.121:3300/0 conn(0x7fa2ec068be0 0x7fa2ec160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:43.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2f0862700 1 --2- 172.21.15.102:0/3252936112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2ec06e130 0x7fa2ec0686a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0c35f0 tx=0x7fa2dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f767ccbf21cabc1f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2e3fff700 1 -- 172.21.15.102:0/3252936112 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc00b860 con 0x7fa2ec06e130 2024-08-17T02:26:43.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2e3fff700 1 -- 172.21.15.102:0/3252936112 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2dc00b9c0 con 0x7fa2ec06e130 2024-08-17T02:26:43.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2e3fff700 1 -- 172.21.15.102:0/3252936112 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc00bd60 con 0x7fa2ec06e130 2024-08-17T02:26:43.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2f32c7700 1 -- 172.21.15.102:0/3252936112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2ec06e130 msgr2=0x7fa2ec0686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2f32c7700 1 --2- 172.21.15.102:0/3252936112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2ec06e130 0x7fa2ec0686a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0c35f0 tx=0x7fa2dc009250 comp rx=0 tx=0).stop 2024-08-17T02:26:43.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2f32c7700 1 -- 172.21.15.102:0/3252936112 shutdown_connections 2024-08-17T02:26:43.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2f32c7700 1 --2- 172.21.15.102:0/3252936112 >> v2:172.21.15.121:3300/0 conn(0x7fa2ec068be0 0x7fa2ec160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2f32c7700 1 --2- 172.21.15.102:0/3252936112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2ec06e130 0x7fa2ec0686a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2f32c7700 1 -- 172.21.15.102:0/3252936112 >> 172.21.15.102:0/3252936112 conn(0x7fa2ec0c9c20 msgr2=0x7fa2ec06d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2f32c7700 1 -- 172.21.15.102:0/3252936112 shutdown_connections 2024-08-17T02:26:43.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.348+0000 7fa2f32c7700 1 -- 172.21.15.102:0/3252936112 wait complete. 2024-08-17T02:26:43.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f32c7700 1 Processor -- start 2024-08-17T02:26:43.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f32c7700 1 -- start start 2024-08-17T02:26:43.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f32c7700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2ec068be0 0x7fa2ec142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f32c7700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2ec06e130 0x7fa2ec0b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f32c7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2ec157060 0x7fa2ec0a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f32c7700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec158960 con 0x7fa2ec068be0 2024-08-17T02:26:43.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f32c7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec0b1b60 con 0x7fa2ec157060 2024-08-17T02:26:43.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f32c7700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec0b15a0 con 0x7fa2ec06e130 2024-08-17T02:26:43.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f1063700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2ec068be0 0x7fa2ec142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f1063700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2ec068be0 0x7fa2ec142890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55050/0 (socket says 172.21.15.102:55050) 2024-08-17T02:26:43.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f1063700 1 -- 172.21.15.102:0/1547912068 learned_addr learned my addr 172.21.15.102:0/1547912068 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:43.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f1864700 1 --2- 172.21.15.102:0/1547912068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2ec157060 0x7fa2ec0a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f0862700 1 --2- 172.21.15.102:0/1547912068 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2ec06e130 0x7fa2ec0b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f1063700 1 -- 172.21.15.102:0/1547912068 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2ec06e130 msgr2=0x7fa2ec0b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f1063700 1 --2- 172.21.15.102:0/1547912068 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2ec06e130 0x7fa2ec0b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f1063700 1 -- 172.21.15.102:0/1547912068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2ec157060 msgr2=0x7fa2ec0a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f1063700 1 --2- 172.21.15.102:0/1547912068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2ec157060 0x7fa2ec0a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f1063700 1 -- 172.21.15.102:0/1547912068 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc0094f0 con 0x7fa2ec068be0 2024-08-17T02:26:43.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f1864700 1 --2- 172.21.15.102:0/1547912068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2ec157060 0x7fa2ec0a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:43.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f1063700 1 --2- 172.21.15.102:0/1547912068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2ec068be0 0x7fa2ec142890 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800c5b0 tx=0x7fa2e8001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2e17fa700 1 -- 172.21.15.102:0/1547912068 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8005a70 con 0x7fa2ec068be0 2024-08-17T02:26:43.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2e17fa700 1 -- 172.21.15.102:0/1547912068 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e8005bd0 con 0x7fa2ec068be0 2024-08-17T02:26:43.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f32c7700 1 -- 172.21.15.102:0/1547912068 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ec0b1880 con 0x7fa2ec068be0 2024-08-17T02:26:43.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2e17fa700 1 -- 172.21.15.102:0/1547912068 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e80070d0 con 0x7fa2ec068be0 2024-08-17T02:26:43.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.352+0000 7fa2f32c7700 1 -- 172.21.15.102:0/1547912068 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ec142dd0 con 0x7fa2ec068be0 2024-08-17T02:26:43.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.356+0000 7fa2f32c7700 1 -- 172.21.15.102:0/1547912068 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ec0645c0 con 0x7fa2ec068be0 2024-08-17T02:26:43.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.356+0000 7fa2e17fa700 1 -- 172.21.15.102:0/1547912068 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa2e8007480 con 0x7fa2ec068be0 2024-08-17T02:26:43.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.356+0000 7fa2e17fa700 1 --2- 172.21.15.102:0/1547912068 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa2d0060860 0x7fa2d0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.356+0000 7fa2e17fa700 1 -- 172.21.15.102:0/1547912068 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa2e807c180 con 0x7fa2ec068be0 2024-08-17T02:26:43.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.356+0000 7fa2f0862700 1 --2- 172.21.15.102:0/1547912068 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa2d0060860 0x7fa2d0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.356+0000 7fa2f0862700 1 --2- 172.21.15.102:0/1547912068 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa2d0060860 0x7fa2d0062d10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0c35f0 tx=0x7fa2dc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.360+0000 7fa2e17fa700 1 -- 172.21.15.102:0/1547912068 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa2e804c530 con 0x7fa2ec068be0 2024-08-17T02:26:43.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.524+0000 7fa2f32c7700 1 -- 172.21.15.102:0/1547912068 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2ec06e890 con 0x7fa2ec068be0 2024-08-17T02:26:43.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.528+0000 7fa2e17fa700 1 -- 172.21.15.102:0/1547912068 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15411 (secure 0 0 0) 0x7fa2e804fb50 con 0x7fa2ec068be0 2024-08-17T02:26:43.532 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:43.532 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":31,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:26:42.223579+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:40.530641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:41.227445+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:43.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.532+0000 7fa2f32c7700 1 -- 172.21.15.102:0/1547912068 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa2d0060860 msgr2=0x7fa2d0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.532+0000 7fa2f32c7700 1 --2- 172.21.15.102:0/1547912068 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa2d0060860 0x7fa2d0062d10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0c35f0 tx=0x7fa2dc017000 comp rx=0 tx=0).stop 2024-08-17T02:26:43.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.532+0000 7fa2f32c7700 1 -- 172.21.15.102:0/1547912068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2ec068be0 msgr2=0x7fa2ec142890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.532+0000 7fa2f32c7700 1 --2- 172.21.15.102:0/1547912068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2ec068be0 0x7fa2ec142890 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800c5b0 tx=0x7fa2e8001040 comp rx=0 tx=0).stop 2024-08-17T02:26:43.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.532+0000 7fa2f32c7700 1 -- 172.21.15.102:0/1547912068 shutdown_connections 2024-08-17T02:26:43.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.532+0000 7fa2f32c7700 1 --2- 172.21.15.102:0/1547912068 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa2d0060860 0x7fa2d0062d10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.532+0000 7fa2f32c7700 1 --2- 172.21.15.102:0/1547912068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2ec157060 0x7fa2ec0a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.532+0000 7fa2f32c7700 1 --2- 172.21.15.102:0/1547912068 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa2ec06e130 0x7fa2ec0b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.532+0000 7fa2f32c7700 1 --2- 172.21.15.102:0/1547912068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2ec068be0 0x7fa2ec142890 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.532+0000 7fa2f32c7700 1 -- 172.21.15.102:0/1547912068 >> 172.21.15.102:0/1547912068 conn(0x7fa2ec0c9c20 msgr2=0x7fa2ec0c36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.532+0000 7fa2f32c7700 1 -- 172.21.15.102:0/1547912068 shutdown_connections 2024-08-17T02:26:43.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.532+0000 7fa2f32c7700 1 -- 172.21.15.102:0/1547912068 wait complete. 2024-08-17T02:26:43.552 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:26:43.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.660+0000 7f5c797ab700 1 Processor -- start 2024-08-17T02:26:43.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.660+0000 7f5c797ab700 1 -- start start 2024-08-17T02:26:43.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.660+0000 7f5c797ab700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c74159400 0x7f5c740b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.660+0000 7f5c797ab700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5c741597d0 0x7f5c740ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.660+0000 7f5c797ab700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c740ac630 con 0x7f5c740686a0 2024-08-17T02:26:43.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.660+0000 7f5c797ab700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c740ac910 con 0x7f5c741597d0 2024-08-17T02:26:43.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.660+0000 7f5c797ab700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c740acbf0 con 0x7f5c74159400 2024-08-17T02:26:43.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c72ffd700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c74159400 0x7f5c740b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c72ffd700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c74159400 0x7f5c740b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:54826/0 (socket says 172.21.15.102:54826) 2024-08-17T02:26:43.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c72ffd700 1 -- 172.21.15.102:0/3265817506 learned_addr learned my addr 172.21.15.102:0/3265817506 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:43.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c727fc700 1 --2- 172.21.15.102:0/3265817506 >> v2:172.21.15.121:3300/0 conn(0x7f5c741597d0 0x7f5c740ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c727fc700 1 -- 172.21.15.102:0/3265817506 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c74159400 msgr2=0x7f5c740b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:43.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c727fc700 1 --2- 172.21.15.102:0/3265817506 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c74159400 0x7f5c740b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c727fc700 1 -- 172.21.15.102:0/3265817506 >> v1:172.21.15.121:6789/0 conn(0x7f5c740686a0 legacy=0x7f5c740af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c727fc700 1 -- 172.21.15.102:0/3265817506 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c740aced0 con 0x7f5c741597d0 2024-08-17T02:26:43.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c72ffd700 1 --2- 172.21.15.102:0/3265817506 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c74159400 0x7f5c740b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:43.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c727fc700 1 --2- 172.21.15.102:0/3265817506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c741597d0 0x7f5c740ad3f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5c680098e0 tx=0x7f5c680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc0a06f57c797821 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c71ffb700 1 -- 172.21.15.102:0/3265817506 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800b640 con 0x7f5c741597d0 2024-08-17T02:26:43.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c71ffb700 1 -- 172.21.15.102:0/3265817506 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6800b7a0 con 0x7f5c741597d0 2024-08-17T02:26:43.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c71ffb700 1 -- 172.21.15.102:0/3265817506 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800bb40 con 0x7f5c741597d0 2024-08-17T02:26:43.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c797ab700 1 -- 172.21.15.102:0/3265817506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c741597d0 msgr2=0x7f5c740ad3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c797ab700 1 --2- 172.21.15.102:0/3265817506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c741597d0 0x7f5c740ad3f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5c680098e0 tx=0x7f5c680091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c797ab700 1 -- 172.21.15.102:0/3265817506 shutdown_connections 2024-08-17T02:26:43.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c797ab700 1 --2- 172.21.15.102:0/3265817506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c741597d0 0x7f5c740ad3f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c797ab700 1 --2- 172.21.15.102:0/3265817506 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c74159400 0x7f5c740b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c797ab700 1 -- 172.21.15.102:0/3265817506 >> 172.21.15.102:0/3265817506 conn(0x7f5c740c9bf0 msgr2=0x7f5c7406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c797ab700 1 -- 172.21.15.102:0/3265817506 shutdown_connections 2024-08-17T02:26:43.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.664+0000 7f5c797ab700 1 -- 172.21.15.102:0/3265817506 wait complete. 2024-08-17T02:26:43.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c797ab700 1 Processor -- start 2024-08-17T02:26:43.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c797ab700 1 -- start start 2024-08-17T02:26:43.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c797ab700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c740686a0 0x7f5c7414f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c797ab700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c74159400 0x7f5c74151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c797ab700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c741597d0 0x7f5c74153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c797ab700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7414fbe0 con 0x7f5c74159400 2024-08-17T02:26:43.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c797ab700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c741522a0 con 0x7f5c740686a0 2024-08-17T02:26:43.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c797ab700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74153b70 con 0x7f5c741597d0 2024-08-17T02:26:43.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c727fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c74159400 0x7f5c74151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c727fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c74159400 0x7f5c74151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55054/0 (socket says 172.21.15.102:55054) 2024-08-17T02:26:43.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c727fc700 1 -- 172.21.15.102:0/3306376026 learned_addr learned my addr 172.21.15.102:0/3306376026 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:43.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c737fe700 1 --2- 172.21.15.102:0/3306376026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c741597d0 0x7f5c74153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c72ffd700 1 --2- 172.21.15.102:0/3306376026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c740686a0 0x7f5c7414f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c727fc700 1 -- 172.21.15.102:0/3306376026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c741597d0 msgr2=0x7f5c74153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c727fc700 1 --2- 172.21.15.102:0/3306376026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c741597d0 0x7f5c74153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c727fc700 1 -- 172.21.15.102:0/3306376026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c740686a0 msgr2=0x7f5c7414f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c727fc700 1 --2- 172.21.15.102:0/3306376026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c740686a0 0x7f5c7414f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c727fc700 1 -- 172.21.15.102:0/3306376026 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c640094f0 con 0x7f5c74159400 2024-08-17T02:26:43.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.668+0000 7f5c727fc700 1 --2- 172.21.15.102:0/3306376026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c74159400 0x7f5c74151d60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009f80 tx=0x7f5c68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.672+0000 7f5c5affd700 1 -- 172.21.15.102:0/3306376026 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800bb20 con 0x7f5c74159400 2024-08-17T02:26:43.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.672+0000 7f5c5affd700 1 -- 172.21.15.102:0/3306376026 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c68000c90 con 0x7f5c74159400 2024-08-17T02:26:43.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.672+0000 7f5c797ab700 1 -- 172.21.15.102:0/3306376026 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c68009420 con 0x7f5c74159400 2024-08-17T02:26:43.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.672+0000 7f5c5affd700 1 -- 172.21.15.102:0/3306376026 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68011650 con 0x7f5c74159400 2024-08-17T02:26:43.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.672+0000 7f5c797ab700 1 -- 172.21.15.102:0/3306376026 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c74152870 con 0x7f5c74159400 2024-08-17T02:26:43.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.672+0000 7f5c797ab700 1 -- 172.21.15.102:0/3306376026 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c74153350 con 0x7f5c74159400 2024-08-17T02:26:43.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.672+0000 7f5c5affd700 1 -- 172.21.15.102:0/3306376026 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5c68011a40 con 0x7f5c74159400 2024-08-17T02:26:43.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.672+0000 7f5c5affd700 1 --2- 172.21.15.102:0/3306376026 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5c60060860 0x7f5c60062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.672+0000 7f5c5affd700 1 -- 172.21.15.102:0/3306376026 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c6807e4f0 con 0x7f5c74159400 2024-08-17T02:26:43.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.672+0000 7f5c72ffd700 1 --2- 172.21.15.102:0/3306376026 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5c60060860 0x7f5c60062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.672+0000 7f5c72ffd700 1 --2- 172.21.15.102:0/3306376026 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5c60060860 0x7f5c60062d10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5c64006d20 tx=0x7f5c64009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.676+0000 7f5c5affd700 1 -- 172.21.15.102:0/3306376026 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5c74153350 con 0x7f5c74159400 2024-08-17T02:26:43.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:43.876+0000 7f5c797ab700 1 -- 172.21.15.102:0/3306376026 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5c74153350 con 0x7f5c74159400 2024-08-17T02:26:44.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.536+0000 7f5c5affd700 1 -- 172.21.15.102:0/3306376026 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5c74153350 con 0x7f5c74159400 2024-08-17T02:26:44.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.540+0000 7f5c797ab700 1 -- 172.21.15.102:0/3306376026 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5c60060860 msgr2=0x7f5c60062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.540+0000 7f5c797ab700 1 --2- 172.21.15.102:0/3306376026 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5c60060860 0x7f5c60062d10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5c64006d20 tx=0x7f5c64009250 comp rx=0 tx=0).stop 2024-08-17T02:26:44.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.540+0000 7f5c797ab700 1 -- 172.21.15.102:0/3306376026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c74159400 msgr2=0x7f5c74151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.540+0000 7f5c797ab700 1 --2- 172.21.15.102:0/3306376026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c74159400 0x7f5c74151d60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009f80 tx=0x7f5c68017000 comp rx=0 tx=0).stop 2024-08-17T02:26:44.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.540+0000 7f5c797ab700 1 -- 172.21.15.102:0/3306376026 shutdown_connections 2024-08-17T02:26:44.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.540+0000 7f5c797ab700 1 --2- 172.21.15.102:0/3306376026 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5c60060860 0x7f5c60062d10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.540+0000 7f5c797ab700 1 --2- 172.21.15.102:0/3306376026 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c74159400 0x7f5c74151d60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.540+0000 7f5c797ab700 1 --2- 172.21.15.102:0/3306376026 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5c741597d0 0x7f5c74153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.540+0000 7f5c797ab700 1 --2- 172.21.15.102:0/3306376026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c740686a0 0x7f5c7414f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.540+0000 7f5c797ab700 1 -- 172.21.15.102:0/3306376026 >> 172.21.15.102:0/3306376026 conn(0x7f5c740c9bf0 msgr2=0x7f5c740afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.540+0000 7f5c797ab700 1 -- 172.21.15.102:0/3306376026 shutdown_connections 2024-08-17T02:26:44.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.540+0000 7f5c797ab700 1 -- 172.21.15.102:0/3306376026 wait complete. 2024-08-17T02:26:44.563 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:26:44.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.676+0000 7f6246221700 1 Processor -- start 2024-08-17T02:26:44.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.676+0000 7f6246221700 1 -- start start 2024-08-17T02:26:44.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f6246221700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6240140910 0x7f62400c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f6246221700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f62400ae6f0 0x7f62400cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f6246221700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62400cc450 con 0x7f62400cbab0 2024-08-17T02:26:44.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f6246221700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62400c3e30 con 0x7f6240140910 2024-08-17T02:26:44.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f6246221700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62400c4110 con 0x7f62400ae6f0 2024-08-17T02:26:44.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f624521f700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6240140910 0x7f62400c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f6244a1e700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f62400cbab0 0x7f62400c2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48196/0 (socket says 172.21.15.102:48196) 2024-08-17T02:26:44.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f6244a1e700 1 -- 172.21.15.102:0/4249824270 learned_addr learned my addr 172.21.15.102:0/4249824270 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:44.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f6245a20700 1 --2- 172.21.15.102:0/4249824270 >> v2:172.21.15.121:3300/0 conn(0x7f62400ae6f0 0x7f62400cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f6237fff700 1 -- 172.21.15.102:0/4249824270 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602499385 0 0) 0x7f623c001110 con 0x7f62400cbab0 2024-08-17T02:26:44.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f6237fff700 1 -- 172.21.15.102:0/4249824270 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f622c003570 con 0x7f62400cbab0 2024-08-17T02:26:44.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f624521f700 1 -- 172.21.15.102:0/4249824270 >> v2:172.21.15.121:3300/0 conn(0x7f62400ae6f0 msgr2=0x7f62400cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:44.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f6237fff700 1 -- 172.21.15.102:0/4249824270 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1006074973 0 0) 0x7f622c003570 con 0x7f62400cbab0 2024-08-17T02:26:44.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f624521f700 1 --2- 172.21.15.102:0/4249824270 >> v2:172.21.15.121:3300/0 conn(0x7f62400ae6f0 0x7f62400cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f624521f700 1 -- 172.21.15.102:0/4249824270 >> v1:172.21.15.102:6789/0 conn(0x7f62400cbab0 legacy=0x7f62400c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f624521f700 1 -- 172.21.15.102:0/4249824270 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400c43f0 con 0x7f6240140910 2024-08-17T02:26:44.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f624521f700 1 --2- 172.21.15.102:0/4249824270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6240140910 0x7f62400c8520 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f62400cde10 tx=0x7f62300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed633a2e65786294 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f6237fff700 1 -- 172.21.15.102:0/4249824270 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c001600 con 0x7f6240140910 2024-08-17T02:26:44.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f6237fff700 1 -- 172.21.15.102:0/4249824270 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6230011420 con 0x7f6240140910 2024-08-17T02:26:44.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.680+0000 7f6237fff700 1 -- 172.21.15.102:0/4249824270 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62300117c0 con 0x7f6240140910 2024-08-17T02:26:44.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.684+0000 7f6246221700 1 -- 172.21.15.102:0/4249824270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6240140910 msgr2=0x7f62400c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.684+0000 7f6246221700 1 --2- 172.21.15.102:0/4249824270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6240140910 0x7f62400c8520 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f62400cde10 tx=0x7f62300091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.684+0000 7f6246221700 1 -- 172.21.15.102:0/4249824270 shutdown_connections 2024-08-17T02:26:44.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.684+0000 7f6246221700 1 --2- 172.21.15.102:0/4249824270 >> v2:172.21.15.121:3300/0 conn(0x7f62400ae6f0 0x7f62400cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.684+0000 7f6246221700 1 --2- 172.21.15.102:0/4249824270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6240140910 0x7f62400c8520 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.684+0000 7f6246221700 1 -- 172.21.15.102:0/4249824270 >> 172.21.15.102:0/4249824270 conn(0x7f62400cdee0 msgr2=0x7f62400ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.684+0000 7f6246221700 1 -- 172.21.15.102:0/4249824270 shutdown_connections 2024-08-17T02:26:44.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.684+0000 7f6246221700 1 -- 172.21.15.102:0/4249824270 wait complete. 2024-08-17T02:26:44.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.684+0000 7f6246221700 1 Processor -- start 2024-08-17T02:26:44.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.684+0000 7f6246221700 1 -- start start 2024-08-17T02:26:44.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6246221700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f62400ae6f0 0x7f62401365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6246221700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62400cbab0 0x7f62400b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6246221700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6240140910 0x7f62400b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6246221700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624013dfe0 con 0x7f62400cbab0 2024-08-17T02:26:44.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6246221700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400a6060 con 0x7f6240140910 2024-08-17T02:26:44.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6246221700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400a6340 con 0x7f62400ae6f0 2024-08-17T02:26:44.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6244a1e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62400cbab0 0x7f62400b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6244a1e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62400cbab0 0x7f62400b31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55078/0 (socket says 172.21.15.102:55078) 2024-08-17T02:26:44.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6244a1e700 1 -- 172.21.15.102:0/465546613 learned_addr learned my addr 172.21.15.102:0/465546613 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:44.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f624521f700 1 --2- 172.21.15.102:0/465546613 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f62400ae6f0 0x7f62401365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6245a20700 1 --2- 172.21.15.102:0/465546613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6240140910 0x7f62400b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6244a1e700 1 -- 172.21.15.102:0/465546613 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f62400ae6f0 msgr2=0x7f62401365a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6244a1e700 1 --2- 172.21.15.102:0/465546613 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f62400ae6f0 0x7f62401365a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6244a1e700 1 -- 172.21.15.102:0/465546613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6240140910 msgr2=0x7f62400b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6244a1e700 1 --2- 172.21.15.102:0/465546613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6240140910 0x7f62400b3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6244a1e700 1 -- 172.21.15.102:0/465546613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6230009420 con 0x7f62400cbab0 2024-08-17T02:26:44.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6244a1e700 1 --2- 172.21.15.102:0/465546613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62400cbab0 0x7f62400b31f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f623c00cb90 tx=0x7f623c001450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f62357fa700 1 -- 172.21.15.102:0/465546613 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c00cea0 con 0x7f62400cbab0 2024-08-17T02:26:44.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f62357fa700 1 -- 172.21.15.102:0/465546613 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c007e90 con 0x7f62400cbab0 2024-08-17T02:26:44.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6246221700 1 -- 172.21.15.102:0/465546613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62400b0e20 con 0x7f62400cbab0 2024-08-17T02:26:44.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f62357fa700 1 -- 172.21.15.102:0/465546613 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c0075b0 con 0x7f62400cbab0 2024-08-17T02:26:44.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6246221700 1 -- 172.21.15.102:0/465546613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6240166c10 con 0x7f62400cbab0 2024-08-17T02:26:44.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.688+0000 7f6246221700 1 -- 172.21.15.102:0/465546613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62400b0c80 con 0x7f62400cbab0 2024-08-17T02:26:44.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.692+0000 7f62357fa700 1 -- 172.21.15.102:0/465546613 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f623c004a40 con 0x7f62400cbab0 2024-08-17T02:26:44.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.692+0000 7f62357fa700 1 --2- 172.21.15.102:0/465546613 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6224060860 0x7f6224062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.692+0000 7f62357fa700 1 -- 172.21.15.102:0/465546613 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f623c07c1f0 con 0x7f62400cbab0 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.692+0000 7f624521f700 1 --2- 172.21.15.102:0/465546613 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6224060860 0x7f6224062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.692+0000 7f624521f700 1 --2- 172.21.15.102:0/465546613 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6224060860 0x7f6224062d10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f62400cde10 tx=0x7f6230016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.700+0000 7f62357fa700 1 -- 172.21.15.102:0/465546613 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f62400b0c80 con 0x7f62400cbab0 2024-08-17T02:26:44.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:44.900+0000 7f6246221700 1 -- 172.21.15.102:0/465546613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f62400cc450 con 0x7f62400cbab0 2024-08-17T02:26:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:45.896+0000 7f62357fa700 1 -- 172.21.15.102:0/465546613 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f62400cc450 con 0x7f62400cbab0 2024-08-17T02:26:45.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:45.900+0000 7f6246221700 1 -- 172.21.15.102:0/465546613 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6224060860 msgr2=0x7f6224062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:45.900+0000 7f6246221700 1 --2- 172.21.15.102:0/465546613 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6224060860 0x7f6224062d10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f62400cde10 tx=0x7f6230016000 comp rx=0 tx=0).stop 2024-08-17T02:26:45.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:45.900+0000 7f6246221700 1 -- 172.21.15.102:0/465546613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62400cbab0 msgr2=0x7f62400b31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:45.900+0000 7f6246221700 1 --2- 172.21.15.102:0/465546613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62400cbab0 0x7f62400b31f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f623c00cb90 tx=0x7f623c001450 comp rx=0 tx=0).stop 2024-08-17T02:26:45.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:45.900+0000 7f6246221700 1 -- 172.21.15.102:0/465546613 shutdown_connections 2024-08-17T02:26:45.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:45.900+0000 7f6246221700 1 --2- 172.21.15.102:0/465546613 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f6224060860 0x7f6224062d10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:45.900+0000 7f6246221700 1 --2- 172.21.15.102:0/465546613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62400cbab0 0x7f62400b31f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:45.900+0000 7f6246221700 1 --2- 172.21.15.102:0/465546613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6240140910 0x7f62400b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:45.900+0000 7f6246221700 1 --2- 172.21.15.102:0/465546613 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f62400ae6f0 0x7f62401365a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:45.900+0000 7f6246221700 1 -- 172.21.15.102:0/465546613 >> 172.21.15.102:0/465546613 conn(0x7f62400cdee0 msgr2=0x7f624013f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:45.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:45.900+0000 7f6246221700 1 -- 172.21.15.102:0/465546613 shutdown_connections 2024-08-17T02:26:45.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:45.900+0000 7f6246221700 1 -- 172.21.15.102:0/465546613 wait complete. 2024-08-17T02:26:45.921 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:46.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82f6361700 1 Processor -- start 2024-08-17T02:26:46.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82f6361700 1 -- start start 2024-08-17T02:26:46.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82f6361700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f82f00af030 0x7f82f00a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82f6361700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f82f00a9260 0x7f82f00b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82f6361700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f00b0270 con 0x7f82f015d540 2024-08-17T02:26:46.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82f6361700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f00af660 con 0x7f82f00af030 2024-08-17T02:26:46.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82f6361700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00af940 con 0x7f82f00a9260 2024-08-17T02:26:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82ef7fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f82f00af030 0x7f82f00a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82ef7fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f82f00af030 0x7f82f00a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55084/0 (socket says 172.21.15.102:55084) 2024-08-17T02:26:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82effff700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f82f015d540 0x7f82f006e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48212/0 (socket says 172.21.15.102:48212) 2024-08-17T02:26:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82ef7fe700 1 -- 172.21.15.102:0/1452559936 learned_addr learned my addr 172.21.15.102:0/1452559936 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82f48fe700 1 --2- 172.21.15.102:0/1452559936 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f82f00a9260 0x7f82f00b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82ef7fe700 1 -- 172.21.15.102:0/1452559936 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f82f00a9260 msgr2=0x7f82f00b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82ef7fe700 1 --2- 172.21.15.102:0/1452559936 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f82f00a9260 0x7f82f00b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82ef7fe700 1 -- 172.21.15.102:0/1452559936 >> v1:172.21.15.102:6789/0 conn(0x7f82f015d540 legacy=0x7f82f006e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82eeffd700 1 -- 172.21.15.102:0/1452559936 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717124967 0 0) 0x7f82f00b0270 con 0x7f82f015d540 2024-08-17T02:26:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82ef7fe700 1 -- 172.21.15.102:0/1452559936 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f00afc20 con 0x7f82f00af030 2024-08-17T02:26:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82ef7fe700 1 --2- 172.21.15.102:0/1452559936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82f00af030 0x7f82f00a8d20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009f20 tx=0x7f82e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78158ece3e50b69d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82eeffd700 1 -- 172.21.15.102:0/1452559936 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000e070 con 0x7f82f00af030 2024-08-17T02:26:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82eeffd700 1 -- 172.21.15.102:0/1452559936 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e000ba80 con 0x7f82f00af030 2024-08-17T02:26:46.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.032+0000 7f82eeffd700 1 -- 172.21.15.102:0/1452559936 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e00092e0 con 0x7f82f00af030 2024-08-17T02:26:46.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.036+0000 7f82f6361700 1 -- 172.21.15.102:0/1452559936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82f00af030 msgr2=0x7f82f00a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.036+0000 7f82f6361700 1 --2- 172.21.15.102:0/1452559936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82f00af030 0x7f82f00a8d20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009f20 tx=0x7f82e0009840 comp rx=0 tx=0).stop 2024-08-17T02:26:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.036+0000 7f82f6361700 1 -- 172.21.15.102:0/1452559936 shutdown_connections 2024-08-17T02:26:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.036+0000 7f82f6361700 1 --2- 172.21.15.102:0/1452559936 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f82f00a9260 0x7f82f00b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.036+0000 7f82f6361700 1 --2- 172.21.15.102:0/1452559936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82f00af030 0x7f82f00a8d20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.036+0000 7f82f6361700 1 -- 172.21.15.102:0/1452559936 >> 172.21.15.102:0/1452559936 conn(0x7f82f0066e00 msgr2=0x7f82f0067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.036+0000 7f82f6361700 1 -- 172.21.15.102:0/1452559936 shutdown_connections 2024-08-17T02:26:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.036+0000 7f82f6361700 1 -- 172.21.15.102:0/1452559936 wait complete. 2024-08-17T02:26:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.036+0000 7f82f6361700 1 Processor -- start 2024-08-17T02:26:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.036+0000 7f82f6361700 1 -- start start 2024-08-17T02:26:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82f6361700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82f00a9260 0x7f82f00cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82f6361700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82f00af030 0x7f82f00990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82f6361700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f82f015d540 0x7f82f01578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82f6361700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00ad5e0 con 0x7f82f00af030 2024-08-17T02:26:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82f6361700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00c98b0 con 0x7f82f00a9260 2024-08-17T02:26:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82f6361700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f0158810 con 0x7f82f015d540 2024-08-17T02:26:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82ef7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82f00af030 0x7f82f00990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82ef7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82f00af030 0x7f82f00990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55090/0 (socket says 172.21.15.102:55090) 2024-08-17T02:26:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82ef7fe700 1 -- 172.21.15.102:0/3539974208 learned_addr learned my addr 172.21.15.102:0/3539974208 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82f48fe700 1 --2- 172.21.15.102:0/3539974208 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f82f015d540 0x7f82f01578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82effff700 1 --2- 172.21.15.102:0/3539974208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82f00a9260 0x7f82f00cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82ef7fe700 1 -- 172.21.15.102:0/3539974208 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f82f015d540 msgr2=0x7f82f01578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82ef7fe700 1 --2- 172.21.15.102:0/3539974208 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f82f015d540 0x7f82f01578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82ef7fe700 1 -- 172.21.15.102:0/3539974208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82f00a9260 msgr2=0x7f82f00cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82ef7fe700 1 --2- 172.21.15.102:0/3539974208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82f00a9260 0x7f82f00cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82ef7fe700 1 -- 172.21.15.102:0/3539974208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e0009ae0 con 0x7f82f00af030 2024-08-17T02:26:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82ef7fe700 1 --2- 172.21.15.102:0/3539974208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82f00af030 0x7f82f00990c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f82e000b6c0 tx=0x7f82e0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82d7fff700 1 -- 172.21.15.102:0/3539974208 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e00088b0 con 0x7f82f00af030 2024-08-17T02:26:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82d7fff700 1 -- 172.21.15.102:0/3539974208 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e0008a30 con 0x7f82f00af030 2024-08-17T02:26:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82f6361700 1 -- 172.21.15.102:0/3539974208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f00c8af0 con 0x7f82f00af030 2024-08-17T02:26:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82d7fff700 1 -- 172.21.15.102:0/3539974208 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0008df0 con 0x7f82f00af030 2024-08-17T02:26:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.040+0000 7f82f6361700 1 -- 172.21.15.102:0/3539974208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f00c9390 con 0x7f82f00af030 2024-08-17T02:26:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.044+0000 7f82f6361700 1 -- 172.21.15.102:0/3539974208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f00c95e0 con 0x7f82f00af030 2024-08-17T02:26:46.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.044+0000 7f82d7fff700 1 -- 172.21.15.102:0/3539974208 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f82e0003040 con 0x7f82f00af030 2024-08-17T02:26:46.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.044+0000 7f82d7fff700 1 --2- 172.21.15.102:0/3539974208 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f82dc060860 0x7f82dc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.044+0000 7f82d7fff700 1 -- 172.21.15.102:0/3539974208 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82e007e8b0 con 0x7f82f00af030 2024-08-17T02:26:46.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.044+0000 7f82effff700 1 --2- 172.21.15.102:0/3539974208 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f82dc060860 0x7f82dc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.044+0000 7f82effff700 1 --2- 172.21.15.102:0/3539974208 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f82dc060860 0x7f82dc062d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f82e4007180 tx=0x7f82e4007ef0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.052+0000 7f82d7fff700 1 -- 172.21.15.102:0/3539974208 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f82e004edb0 con 0x7f82f00af030 2024-08-17T02:26:46.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.256+0000 7f82f6361700 1 -- 172.21.15.102:0/3539974208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82f006f360 con 0x7f82f00af030 2024-08-17T02:26:46.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.256+0000 7f82d7fff700 1 -- 172.21.15.102:0/3539974208 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f82e00523d0 con 0x7f82f00af030 2024-08-17T02:26:46.259 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:46.259 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3728405798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3728405798},{"type":"v1","addr":"172.21.15.102:6835","nonce":3728405798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2759836087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2759836087},{"type":"v1","addr":"172.21.15.121:6833","nonce":2759836087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2189006578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2189006578},{"type":"v1","addr":"172.21.15.121:6835","nonce":2189006578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:42.224494+0000","modified":"2024-08-17T02:26:45.888060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/1340437033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1340437033},{"type":"v1","addr":"172.21.15.102:6837","nonce":1340437033}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:26:46.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.256+0000 7f82f6361700 1 -- 172.21.15.102:0/3539974208 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f82dc060860 msgr2=0x7f82dc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.256+0000 7f82f6361700 1 --2- 172.21.15.102:0/3539974208 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f82dc060860 0x7f82dc062d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f82e4007180 tx=0x7f82e4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.256+0000 7f82f6361700 1 -- 172.21.15.102:0/3539974208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82f00af030 msgr2=0x7f82f00990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.256+0000 7f82f6361700 1 --2- 172.21.15.102:0/3539974208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82f00af030 0x7f82f00990c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f82e000b6c0 tx=0x7f82e0018000 comp rx=0 tx=0).stop 2024-08-17T02:26:46.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.256+0000 7f82f6361700 1 -- 172.21.15.102:0/3539974208 shutdown_connections 2024-08-17T02:26:46.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.256+0000 7f82f6361700 1 --2- 172.21.15.102:0/3539974208 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f82dc060860 0x7f82dc062d10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.256+0000 7f82f6361700 1 --2- 172.21.15.102:0/3539974208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82f00af030 0x7f82f00990c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.256+0000 7f82f6361700 1 --2- 172.21.15.102:0/3539974208 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f82f015d540 0x7f82f01578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.256+0000 7f82f6361700 1 --2- 172.21.15.102:0/3539974208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82f00a9260 0x7f82f00cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.256+0000 7f82f6361700 1 -- 172.21.15.102:0/3539974208 >> 172.21.15.102:0/3539974208 conn(0x7f82f0066e00 msgr2=0x7f82f015c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.256+0000 7f82f6361700 1 -- 172.21.15.102:0/3539974208 shutdown_connections 2024-08-17T02:26:46.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.256+0000 7f82f6361700 1 -- 172.21.15.102:0/3539974208 wait complete. 2024-08-17T02:26:46.263 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 14 2024-08-17T02:26:46.273 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:46.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38f7a8700 1 Processor -- start 2024-08-17T02:26:46.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38f7a8700 1 -- start start 2024-08-17T02:26:46.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38f7a8700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb388142800 0x7fb3880a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38f7a8700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb3880b1ac0 0x7fb3880ab270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38f7a8700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3880aade0 con 0x7fb388142bd0 2024-08-17T02:26:46.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38f7a8700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3880a9ff0 con 0x7fb3880b1ac0 2024-08-17T02:26:46.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38f7a8700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3880af4f0 con 0x7fb388142800 2024-08-17T02:26:46.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38dd45700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb3880b1ac0 0x7fb3880ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38dd45700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb3880b1ac0 0x7fb3880ab270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55102/0 (socket says 172.21.15.102:55102) 2024-08-17T02:26:46.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38dd45700 1 -- 172.21.15.102:0/3504212811 learned_addr learned my addr 172.21.15.102:0/3504212811 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38d544700 1 --2- 172.21.15.102:0/3504212811 >> v2:172.21.15.121:3300/0 conn(0x7fb388142800 0x7fb3880a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38dd45700 1 -- 172.21.15.102:0/3504212811 >> v2:172.21.15.121:3300/0 conn(0x7fb388142800 msgr2=0x7fb3880a9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38dd45700 1 --2- 172.21.15.102:0/3504212811 >> v2:172.21.15.121:3300/0 conn(0x7fb388142800 0x7fb3880a9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38dd45700 1 -- 172.21.15.102:0/3504212811 >> v1:172.21.15.121:6789/0 conn(0x7fb388142bd0 legacy=0x7fb3880b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38dd45700 1 -- 172.21.15.102:0/3504212811 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3880aa1d0 con 0x7fb3880b1ac0 2024-08-17T02:26:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38d544700 1 --2- 172.21.15.102:0/3504212811 >> v2:172.21.15.121:3300/0 conn(0x7fb388142800 0x7fb3880a9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38dd45700 1 --2- 172.21.15.102:0/3504212811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3880b1ac0 0x7fb3880ab270 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb388066eb0 tx=0x7fb378009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50ed5736d8694cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb387fff700 1 -- 172.21.15.102:0/3504212811 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37800e070 con 0x7fb3880b1ac0 2024-08-17T02:26:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb387fff700 1 -- 172.21.15.102:0/3504212811 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37800ba50 con 0x7fb3880b1ac0 2024-08-17T02:26:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb387fff700 1 -- 172.21.15.102:0/3504212811 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3780092e0 con 0x7fb3880b1ac0 2024-08-17T02:26:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38f7a8700 1 -- 172.21.15.102:0/3504212811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3880b1ac0 msgr2=0x7fb3880ab270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38f7a8700 1 --2- 172.21.15.102:0/3504212811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3880b1ac0 0x7fb3880ab270 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb388066eb0 tx=0x7fb378009840 comp rx=0 tx=0).stop 2024-08-17T02:26:46.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38f7a8700 1 -- 172.21.15.102:0/3504212811 shutdown_connections 2024-08-17T02:26:46.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38f7a8700 1 --2- 172.21.15.102:0/3504212811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3880b1ac0 0x7fb3880ab270 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38f7a8700 1 --2- 172.21.15.102:0/3504212811 >> v2:172.21.15.121:3300/0 conn(0x7fb388142800 0x7fb3880a9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.376+0000 7fb38f7a8700 1 -- 172.21.15.102:0/3504212811 >> 172.21.15.102:0/3504212811 conn(0x7fb38806e3b0 msgr2=0x7fb3880aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.380+0000 7fb38f7a8700 1 -- 172.21.15.102:0/3504212811 shutdown_connections 2024-08-17T02:26:46.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.380+0000 7fb38f7a8700 1 -- 172.21.15.102:0/3504212811 wait complete. 2024-08-17T02:26:46.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.380+0000 7fb38f7a8700 1 Processor -- start 2024-08-17T02:26:46.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.380+0000 7fb38f7a8700 1 -- start start 2024-08-17T02:26:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.380+0000 7fb38f7a8700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3880b1ac0 0x7fb3880c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.380+0000 7fb38f7a8700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb388142800 0x7fb3880c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.380+0000 7fb38f7a8700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb388142bd0 0x7fb3880c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.380+0000 7fb38f7a8700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880c4470 con 0x7fb388142800 2024-08-17T02:26:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.380+0000 7fb38f7a8700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880c4970 con 0x7fb3880b1ac0 2024-08-17T02:26:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.380+0000 7fb38f7a8700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880c6220 con 0x7fb388142bd0 2024-08-17T02:26:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.380+0000 7fb38cd43700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb388142800 0x7fb3880c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.380+0000 7fb38cd43700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb388142800 0x7fb3880c39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55108/0 (socket says 172.21.15.102:55108) 2024-08-17T02:26:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.380+0000 7fb38cd43700 1 -- 172.21.15.102:0/157188903 learned_addr learned my addr 172.21.15.102:0/157188903 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.380+0000 7fb38d544700 1 --2- 172.21.15.102:0/157188903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3880b1ac0 0x7fb3880c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.380+0000 7fb38dd45700 1 --2- 172.21.15.102:0/157188903 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb388142bd0 0x7fb3880c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.380+0000 7fb38cd43700 1 -- 172.21.15.102:0/157188903 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb388142bd0 msgr2=0x7fb3880c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.384+0000 7fb38cd43700 1 --2- 172.21.15.102:0/157188903 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb388142bd0 0x7fb3880c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.384+0000 7fb38cd43700 1 -- 172.21.15.102:0/157188903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3880b1ac0 msgr2=0x7fb3880c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.384+0000 7fb38cd43700 1 --2- 172.21.15.102:0/157188903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3880b1ac0 0x7fb3880c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.384+0000 7fb38cd43700 1 -- 172.21.15.102:0/157188903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb378009ae0 con 0x7fb388142800 2024-08-17T02:26:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.384+0000 7fb38cd43700 1 --2- 172.21.15.102:0/157188903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb388142800 0x7fb3880c39f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb37000c590 tx=0x7fb37000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.384+0000 7fb3857fa700 1 -- 172.21.15.102:0/157188903 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb370011590 con 0x7fb388142800 2024-08-17T02:26:46.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.384+0000 7fb3857fa700 1 -- 172.21.15.102:0/157188903 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb370011710 con 0x7fb388142800 2024-08-17T02:26:46.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.384+0000 7fb38f7a8700 1 -- 172.21.15.102:0/157188903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3880c4690 con 0x7fb388142800 2024-08-17T02:26:46.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.384+0000 7fb3857fa700 1 -- 172.21.15.102:0/157188903 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb370011ad0 con 0x7fb388142800 2024-08-17T02:26:46.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.384+0000 7fb38f7a8700 1 -- 172.21.15.102:0/157188903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3880c5eb0 con 0x7fb388142800 2024-08-17T02:26:46.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.384+0000 7fb38f7a8700 1 -- 172.21.15.102:0/157188903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3880645c0 con 0x7fb388142800 2024-08-17T02:26:46.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.384+0000 7fb3857fa700 1 -- 172.21.15.102:0/157188903 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb37001b3b0 con 0x7fb388142800 2024-08-17T02:26:46.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.384+0000 7fb3857fa700 1 --2- 172.21.15.102:0/157188903 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb368060860 0x7fb368062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.384+0000 7fb38d544700 1 --2- 172.21.15.102:0/157188903 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb368060860 0x7fb368062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.384+0000 7fb3857fa700 1 -- 172.21.15.102:0/157188903 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb37007bff0 con 0x7fb388142800 2024-08-17T02:26:46.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.388+0000 7fb38d544700 1 --2- 172.21.15.102:0/157188903 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb368060860 0x7fb368062d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb380006f00 tx=0x7fb380008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.392+0000 7fb3857fa700 1 -- 172.21.15.102:0/157188903 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb37004c440 con 0x7fb388142800 2024-08-17T02:26:46.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.556+0000 7fb38f7a8700 1 -- 172.21.15.102:0/157188903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3880c6360 con 0x7fb388142800 2024-08-17T02:26:46.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.556+0000 7fb3857fa700 1 -- 172.21.15.102:0/157188903 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fb370017090 con 0x7fb388142800 2024-08-17T02:26:46.561 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:46.561 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":32,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:26:43.896313+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:40.530641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:41.227445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:46.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.560+0000 7fb38f7a8700 1 -- 172.21.15.102:0/157188903 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb368060860 msgr2=0x7fb368062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.560+0000 7fb38f7a8700 1 --2- 172.21.15.102:0/157188903 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb368060860 0x7fb368062d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb380006f00 tx=0x7fb380008040 comp rx=0 tx=0).stop 2024-08-17T02:26:46.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.560+0000 7fb38f7a8700 1 -- 172.21.15.102:0/157188903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb388142800 msgr2=0x7fb3880c39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.560+0000 7fb38f7a8700 1 --2- 172.21.15.102:0/157188903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb388142800 0x7fb3880c39f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb37000c590 tx=0x7fb37000c8a0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.560+0000 7fb38f7a8700 1 -- 172.21.15.102:0/157188903 shutdown_connections 2024-08-17T02:26:46.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.560+0000 7fb38f7a8700 1 --2- 172.21.15.102:0/157188903 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fb368060860 0x7fb368062d10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.560+0000 7fb38f7a8700 1 --2- 172.21.15.102:0/157188903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb388142800 0x7fb3880c39f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.560+0000 7fb38f7a8700 1 --2- 172.21.15.102:0/157188903 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fb388142bd0 0x7fb3880c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.560+0000 7fb38f7a8700 1 --2- 172.21.15.102:0/157188903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3880b1ac0 0x7fb3880c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.560+0000 7fb38f7a8700 1 -- 172.21.15.102:0/157188903 >> 172.21.15.102:0/157188903 conn(0x7fb38806e3b0 msgr2=0x7fb3880ab270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.560+0000 7fb38f7a8700 1 -- 172.21.15.102:0/157188903 shutdown_connections 2024-08-17T02:26:46.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.560+0000 7fb38f7a8700 1 -- 172.21.15.102:0/157188903 wait complete. 2024-08-17T02:26:46.575 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:26:46.575 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:46.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.676+0000 7fdaa5aa6700 1 Processor -- start 2024-08-17T02:26:46.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.676+0000 7fdaa5aa6700 1 -- start start 2024-08-17T02:26:46.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.676+0000 7fdaa5aa6700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdaa015d5b0 0x7fdaa00d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.676+0000 7fdaa5aa6700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa00cf190 con 0x7fdaa00d0010 2024-08-17T02:26:46.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.676+0000 7fdaa5aa6700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa00d09a0 con 0x7fdaa0159040 2024-08-17T02:26:46.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.676+0000 7fdaa5aa6700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa015d9f0 con 0x7fdaa015d5b0 2024-08-17T02:26:46.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.676+0000 7fda9ffff700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fdaa00d0010 0x7fdaa015cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48228/0 (socket says 172.21.15.102:48228) 2024-08-17T02:26:46.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.676+0000 7fda9ffff700 1 -- 172.21.15.102:0/3855034566 learned_addr learned my addr 172.21.15.102:0/3855034566 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:46.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.676+0000 7fdaa52a5700 1 --2- 172.21.15.102:0/3855034566 >> v2:172.21.15.102:3300/0 conn(0x7fdaa015d5b0 0x7fdaa00d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.676+0000 7fda9f7fe700 1 -- 172.21.15.102:0/3855034566 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702422455 0 0) 0x7fdaa00cf190 con 0x7fdaa00d0010 2024-08-17T02:26:46.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.676+0000 7fda9f7fe700 1 -- 172.21.15.102:0/3855034566 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda88003570 con 0x7fdaa00d0010 2024-08-17T02:26:46.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 -- 172.21.15.102:0/3855034566 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495266953 0 0) 0x7fdaa00d09a0 con 0x7fdaa0159040 2024-08-17T02:26:46.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 -- 172.21.15.102:0/3855034566 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaa00cf190 con 0x7fdaa0159040 2024-08-17T02:26:46.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 -- 172.21.15.102:0/3855034566 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 735053218 0 0) 0x7fda88003570 con 0x7fdaa00d0010 2024-08-17T02:26:46.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 -- 172.21.15.102:0/3855034566 >> v2:172.21.15.102:3300/0 conn(0x7fdaa015d5b0 msgr2=0x7fdaa00d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 --2- 172.21.15.102:0/3855034566 >> v2:172.21.15.102:3300/0 conn(0x7fdaa015d5b0 0x7fdaa00d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 -- 172.21.15.102:0/3855034566 >> v1:172.21.15.121:6789/0 conn(0x7fdaa0159040 legacy=0x7fdaa00cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 -- 172.21.15.102:0/3855034566 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa00ce5e0 con 0x7fdaa00d0010 2024-08-17T02:26:46.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 -- 172.21.15.102:0/3855034566 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7fda90001470 con 0x7fdaa00d0010 2024-08-17T02:26:46.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 -- 172.21.15.102:0/3855034566 >> v1:172.21.15.102:6789/0 conn(0x7fdaa00d0010 legacy=0x7fdaa015cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 --2- 172.21.15.102:0/3855034566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda88003bf0 0x7fda88003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 --2- 172.21.15.102:0/3855034566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda88004810 0x7fda88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 --2- 172.21.15.102:0/3855034566 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fda88005230 0x7fda8800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 -- 172.21.15.102:0/3855034566 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa015d9f0 con 0x7fda88003bf0 2024-08-17T02:26:46.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 -- 172.21.15.102:0/3855034566 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8800c200 con 0x7fda88004810 2024-08-17T02:26:46.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 -- 172.21.15.102:0/3855034566 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8800c3c0 con 0x7fda88005230 2024-08-17T02:26:46.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fdaa4aa4700 1 --2- 172.21.15.102:0/3855034566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda88003bf0 0x7fda88003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9ffff700 1 --2- 172.21.15.102:0/3855034566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda88004810 0x7fda88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fdaa52a5700 1 --2- 172.21.15.102:0/3855034566 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fda88005230 0x7fda8800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fdaa4aa4700 1 -- 172.21.15.102:0/3855034566 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fda88005230 msgr2=0x7fda8800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fdaa4aa4700 1 --2- 172.21.15.102:0/3855034566 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fda88005230 0x7fda8800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fdaa4aa4700 1 -- 172.21.15.102:0/3855034566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda88004810 msgr2=0x7fda88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fdaa4aa4700 1 --2- 172.21.15.102:0/3855034566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda88004810 0x7fda88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fdaa52a5700 1 -- 172.21.15.102:0/3855034566 reap_dead start 2024-08-17T02:26:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fdaa4aa4700 1 -- 172.21.15.102:0/3855034566 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda88003570 con 0x7fda88003bf0 2024-08-17T02:26:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9ffff700 1 --2- 172.21.15.102:0/3855034566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda88004810 0x7fda88004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fdaa4aa4700 1 --2- 172.21.15.102:0/3855034566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda88003bf0 0x7fda88003fe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fda94001a10 tx=0x7fda94007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bade5eaccebcb1e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 -- 172.21.15.102:0/3855034566 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400c590 con 0x7fda88003bf0 2024-08-17T02:26:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 -- 172.21.15.102:0/3855034566 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9400c6f0 con 0x7fda88003bf0 2024-08-17T02:26:46.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fda9f7fe700 1 -- 172.21.15.102:0/3855034566 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400ca90 con 0x7fda88003bf0 2024-08-17T02:26:46.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fdaa5aa6700 1 -- 172.21.15.102:0/3855034566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda88003bf0 msgr2=0x7fda88003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fdaa5aa6700 1 --2- 172.21.15.102:0/3855034566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda88003bf0 0x7fda88003fe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fda94001a10 tx=0x7fda94007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:46.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fdaa5aa6700 1 -- 172.21.15.102:0/3855034566 shutdown_connections 2024-08-17T02:26:46.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fdaa5aa6700 1 --2- 172.21.15.102:0/3855034566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda88003bf0 0x7fda88003fe0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fdaa5aa6700 1 -- 172.21.15.102:0/3855034566 >> 172.21.15.102:0/3855034566 conn(0x7fdaa0068250 msgr2=0x7fdaa0068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fdaa5aa6700 1 -- 172.21.15.102:0/3855034566 shutdown_connections 2024-08-17T02:26:46.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.680+0000 7fdaa5aa6700 1 -- 172.21.15.102:0/3855034566 wait complete. 2024-08-17T02:26:46.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa5aa6700 1 Processor -- start 2024-08-17T02:26:46.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa5aa6700 1 -- start start 2024-08-17T02:26:46.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa5aa6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda88003bf0 0x7fdaa0151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa5aa6700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdaa00a69b0 0x7fdaa0169ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa5aa6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdaa00a6e00 0x7fdaa00b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa5aa6700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa01542b0 con 0x7fdaa00a6e00 2024-08-17T02:26:46.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa5aa6700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0169850 con 0x7fda88003bf0 2024-08-17T02:26:46.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa5aa6700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa00ae580 con 0x7fdaa00a69b0 2024-08-17T02:26:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa52a5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdaa00a6e00 0x7fdaa00b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa52a5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdaa00a6e00 0x7fdaa00b09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55124/0 (socket says 172.21.15.102:55124) 2024-08-17T02:26:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa52a5700 1 -- 172.21.15.102:0/532911425 learned_addr learned my addr 172.21.15.102:0/532911425 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fda9ffff700 1 --2- 172.21.15.102:0/532911425 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdaa00a69b0 0x7fdaa0169ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa4aa4700 1 --2- 172.21.15.102:0/532911425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda88003bf0 0x7fdaa0151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa52a5700 1 -- 172.21.15.102:0/532911425 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdaa00a69b0 msgr2=0x7fdaa0169ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa52a5700 1 --2- 172.21.15.102:0/532911425 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdaa00a69b0 0x7fdaa0169ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa52a5700 1 -- 172.21.15.102:0/532911425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda88003bf0 msgr2=0x7fdaa0151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa52a5700 1 --2- 172.21.15.102:0/532911425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda88003bf0 0x7fdaa0151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa52a5700 1 -- 172.21.15.102:0/532911425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa0153770 con 0x7fdaa00a6e00 2024-08-17T02:26:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa52a5700 1 --2- 172.21.15.102:0/532911425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdaa00a6e00 0x7fdaa00b09f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fda980094d0 tx=0x7fda9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fda9cff9700 1 -- 172.21.15.102:0/532911425 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9800e040 con 0x7fdaa00a6e00 2024-08-17T02:26:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fda9cff9700 1 -- 172.21.15.102:0/532911425 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9800f040 con 0x7fdaa00a6e00 2024-08-17T02:26:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fda9cff9700 1 -- 172.21.15.102:0/532911425 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9800fd40 con 0x7fdaa00a6e00 2024-08-17T02:26:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa5aa6700 1 -- 172.21.15.102:0/532911425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa0153a10 con 0x7fdaa00a6e00 2024-08-17T02:26:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.684+0000 7fdaa5aa6700 1 -- 172.21.15.102:0/532911425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa0153fd0 con 0x7fdaa00a6e00 2024-08-17T02:26:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.688+0000 7fdaa5aa6700 1 -- 172.21.15.102:0/532911425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa01695f0 con 0x7fdaa00a6e00 2024-08-17T02:26:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.688+0000 7fda9cff9700 1 -- 172.21.15.102:0/532911425 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fda98015640 con 0x7fdaa00a6e00 2024-08-17T02:26:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.688+0000 7fda9cff9700 1 --2- 172.21.15.102:0/532911425 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fda8c060860 0x7fda8c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.688+0000 7fda9cff9700 1 -- 172.21.15.102:0/532911425 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda9807d530 con 0x7fdaa00a6e00 2024-08-17T02:26:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.688+0000 7fdaa4aa4700 1 --2- 172.21.15.102:0/532911425 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fda8c060860 0x7fda8c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.688+0000 7fdaa4aa4700 1 --2- 172.21.15.102:0/532911425 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fda8c060860 0x7fda8c062d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fda94001a10 tx=0x7fda94015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.696+0000 7fda9cff9700 1 -- 172.21.15.102:0/532911425 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fda9804d8e0 con 0x7fdaa00a6e00 2024-08-17T02:26:46.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.856+0000 7fdaa5aa6700 1 -- 172.21.15.102:0/532911425 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdaa00643a0 con 0x7fda8c060860 2024-08-17T02:26:46.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.860+0000 7fda9cff9700 1 -- 172.21.15.102:0/532911425 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264482 (secure 0 0 0) 0x7fdaa00643a0 con 0x7fda8c060860 2024-08-17T02:26:46.870 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.868+0000 7fdaa5aa6700 1 -- 172.21.15.102:0/532911425 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fda8c060860 msgr2=0x7fda8c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.868+0000 7fdaa5aa6700 1 --2- 172.21.15.102:0/532911425 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fda8c060860 0x7fda8c062d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fda94001a10 tx=0x7fda94015000 comp rx=0 tx=0).stop 2024-08-17T02:26:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.868+0000 7fdaa5aa6700 1 -- 172.21.15.102:0/532911425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdaa00a6e00 msgr2=0x7fdaa00b09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.868+0000 7fdaa5aa6700 1 --2- 172.21.15.102:0/532911425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdaa00a6e00 0x7fdaa00b09f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fda980094d0 tx=0x7fda9800b040 comp rx=0 tx=0).stop 2024-08-17T02:26:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.868+0000 7fdaa5aa6700 1 -- 172.21.15.102:0/532911425 shutdown_connections 2024-08-17T02:26:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.868+0000 7fdaa5aa6700 1 --2- 172.21.15.102:0/532911425 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fda8c060860 0x7fda8c062d10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.868+0000 7fdaa5aa6700 1 --2- 172.21.15.102:0/532911425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdaa00a6e00 0x7fdaa00b09f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.868+0000 7fdaa5aa6700 1 --2- 172.21.15.102:0/532911425 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fdaa00a69b0 0x7fdaa0169ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.868+0000 7fdaa5aa6700 1 --2- 172.21.15.102:0/532911425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda88003bf0 0x7fdaa0151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.868+0000 7fdaa5aa6700 1 -- 172.21.15.102:0/532911425 >> 172.21.15.102:0/532911425 conn(0x7fdaa0068250 msgr2=0x7fdaa00b56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.868+0000 7fdaa5aa6700 1 -- 172.21.15.102:0/532911425 shutdown_connections 2024-08-17T02:26:46.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.868+0000 7fdaa5aa6700 1 -- 172.21.15.102:0/532911425 wait complete. 2024-08-17T02:26:46.873 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-08-17T02:26:46.882 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-08-17T02:26:45.192410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2391112,"kb_used_data":3924,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752583608,"statfs":{"total":773094113280,"available":770645614592,"internally_reserved":0,"allocated":4018176,"data_stored":2236188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.334331"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.912774+0000","last_change":"2024-08-17T02:26:42.912774+0000","last_active":"2024-08-17T02:26:42.912774+0000","last_peered":"2024-08-17T02:26:42.912774+0000","last_clean":"2024-08-17T02:26:42.912774+0000","last_became_active":"2024-08-17T02:26:42.912517+0000","last_became_peered":"2024-08-17T02:26:42.912517+0000","last_unstale":"2024-08-17T02:26:42.912774+0000","last_undegraded":"2024-08-17T02:26:42.912774+0000","last_fullsized":"2024-08-17T02:26:42.912774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:01:19.776065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.907765+0000","last_change":"2024-08-17T02:26:42.903694+0000","last_active":"2024-08-17T02:26:42.907765+0000","last_peered":"2024-08-17T02:26:42.907765+0000","last_clean":"2024-08-17T02:26:42.907765+0000","last_became_active":"2024-08-17T02:26:42.903402+0000","last_became_peered":"2024-08-17T02:26:42.903402+0000","last_unstale":"2024-08-17T02:26:42.907765+0000","last_undegraded":"2024-08-17T02:26:42.907765+0000","last_fullsized":"2024-08-17T02:26:42.907765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:43.826528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.922760+0000","last_change":"2024-08-17T02:26:42.922760+0000","last_active":"2024-08-17T02:26:42.922760+0000","last_peered":"2024-08-17T02:26:42.922760+0000","last_clean":"2024-08-17T02:26:42.922760+0000","last_became_active":"2024-08-17T02:26:42.922385+0000","last_became_peered":"2024-08-17T02:26:42.922385+0000","last_unstale":"2024-08-17T02:26:42.922760+0000","last_undegraded":"2024-08-17T02:26:42.922760+0000","last_fullsized":"2024-08-17T02:26:42.922760+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:43:26.766143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914099+0000","last_change":"2024-08-17T02:26:42.896571+0000","last_active":"2024-08-17T02:26:42.914099+0000","last_peered":"2024-08-17T02:26:42.914099+0000","last_clean":"2024-08-17T02:26:42.914099+0000","last_became_active":"2024-08-17T02:26:42.895854+0000","last_became_peered":"2024-08-17T02:26:42.895854+0000","last_unstale":"2024-08-17T02:26:42.914099+0000","last_undegraded":"2024-08-17T02:26:42.914099+0000","last_fullsized":"2024-08-17T02:26:42.914099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:45:02.791392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.908960+0000","last_change":"2024-08-17T02:26:42.906589+0000","last_active":"2024-08-17T02:26:42.908960+0000","last_peered":"2024-08-17T02:26:42.908960+0000","last_clean":"2024-08-17T02:26:42.908960+0000","last_became_active":"2024-08-17T02:26:42.906298+0000","last_became_peered":"2024-08-17T02:26:42.906298+0000","last_unstale":"2024-08-17T02:26:42.908960+0000","last_undegraded":"2024-08-17T02:26:42.908960+0000","last_fullsized":"2024-08-17T02:26:42.908960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:33:26.085908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.907923+0000","last_change":"2024-08-17T02:26:42.902756+0000","last_active":"2024-08-17T02:26:42.907923+0000","last_peered":"2024-08-17T02:26:42.907923+0000","last_clean":"2024-08-17T02:26:42.907923+0000","last_became_active":"2024-08-17T02:26:42.902107+0000","last_became_peered":"2024-08-17T02:26:42.902107+0000","last_unstale":"2024-08-17T02:26:42.907923+0000","last_undegraded":"2024-08-17T02:26:42.907923+0000","last_fullsized":"2024-08-17T02:26:42.907923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:23.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904065+0000","last_change":"2024-08-17T02:26:42.904065+0000","last_active":"2024-08-17T02:26:42.904065+0000","last_peered":"2024-08-17T02:26:42.904065+0000","last_clean":"2024-08-17T02:26:42.904065+0000","last_became_active":"2024-08-17T02:26:42.903763+0000","last_became_peered":"2024-08-17T02:26:42.903763+0000","last_unstale":"2024-08-17T02:26:42.904065+0000","last_undegraded":"2024-08-17T02:26:42.904065+0000","last_fullsized":"2024-08-17T02:26:42.904065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:43:39.020410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904427+0000","last_change":"2024-08-17T02:26:42.904427+0000","last_active":"2024-08-17T02:26:42.904427+0000","last_peered":"2024-08-17T02:26:42.904427+0000","last_clean":"2024-08-17T02:26:42.904427+0000","last_became_active":"2024-08-17T02:26:42.904145+0000","last_became_peered":"2024-08-17T02:26:42.904145+0000","last_unstale":"2024-08-17T02:26:42.904427+0000","last_undegraded":"2024-08-17T02:26:42.904427+0000","last_fullsized":"2024-08-17T02:26:42.904427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:47.517185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.902491+0000","last_change":"2024-08-17T02:26:42.899492+0000","last_active":"2024-08-17T02:26:42.902491+0000","last_peered":"2024-08-17T02:26:42.902491+0000","last_clean":"2024-08-17T02:26:42.902491+0000","last_became_active":"2024-08-17T02:26:42.899234+0000","last_became_peered":"2024-08-17T02:26:42.899234+0000","last_unstale":"2024-08-17T02:26:42.902491+0000","last_undegraded":"2024-08-17T02:26:42.902491+0000","last_fullsized":"2024-08-17T02:26:42.902491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:44:12.560936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921365+0000","last_change":"2024-08-17T02:26:42.917632+0000","last_active":"2024-08-17T02:26:42.921365+0000","last_peered":"2024-08-17T02:26:42.921365+0000","last_clean":"2024-08-17T02:26:42.921365+0000","last_became_active":"2024-08-17T02:26:42.917323+0000","last_became_peered":"2024-08-17T02:26:42.917323+0000","last_unstale":"2024-08-17T02:26:42.921365+0000","last_undegraded":"2024-08-17T02:26:42.921365+0000","last_fullsized":"2024-08-17T02:26:42.921365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:39:12.343432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.922026+0000","last_change":"2024-08-17T02:26:42.922026+0000","last_active":"2024-08-17T02:26:42.922026+0000","last_peered":"2024-08-17T02:26:42.922026+0000","last_clean":"2024-08-17T02:26:42.922026+0000","last_became_active":"2024-08-17T02:26:42.921655+0000","last_became_peered":"2024-08-17T02:26:42.921655+0000","last_unstale":"2024-08-17T02:26:42.922026+0000","last_undegraded":"2024-08-17T02:26:42.922026+0000","last_fullsized":"2024-08-17T02:26:42.922026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:22.036785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.908592+0000","last_change":"2024-08-17T02:26:42.908592+0000","last_active":"2024-08-17T02:26:42.908592+0000","last_peered":"2024-08-17T02:26:42.908592+0000","last_clean":"2024-08-17T02:26:42.908592+0000","last_became_active":"2024-08-17T02:26:42.907753+0000","last_became_peered":"2024-08-17T02:26:42.907753+0000","last_unstale":"2024-08-17T02:26:42.908592+0000","last_undegraded":"2024-08-17T02:26:42.908592+0000","last_fullsized":"2024-08-17T02:26:42.908592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:14.326686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.918245+0000","last_change":"2024-08-17T02:26:42.915982+0000","last_active":"2024-08-17T02:26:42.918245+0000","last_peered":"2024-08-17T02:26:42.918245+0000","last_clean":"2024-08-17T02:26:42.918245+0000","last_became_active":"2024-08-17T02:26:42.915740+0000","last_became_peered":"2024-08-17T02:26:42.915740+0000","last_unstale":"2024-08-17T02:26:42.918245+0000","last_undegraded":"2024-08-17T02:26:42.918245+0000","last_fullsized":"2024-08-17T02:26:42.918245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:52.513813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.907963+0000","last_change":"2024-08-17T02:26:42.903011+0000","last_active":"2024-08-17T02:26:42.907963+0000","last_peered":"2024-08-17T02:26:42.907963+0000","last_clean":"2024-08-17T02:26:42.907963+0000","last_became_active":"2024-08-17T02:26:42.902534+0000","last_became_peered":"2024-08-17T02:26:42.902534+0000","last_unstale":"2024-08-17T02:26:42.907963+0000","last_undegraded":"2024-08-17T02:26:42.907963+0000","last_fullsized":"2024-08-17T02:26:42.907963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:18.760297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.912898+0000","last_change":"2024-08-17T02:26:42.912898+0000","last_active":"2024-08-17T02:26:42.912898+0000","last_peered":"2024-08-17T02:26:42.912898+0000","last_clean":"2024-08-17T02:26:42.912898+0000","last_became_active":"2024-08-17T02:26:42.912273+0000","last_became_peered":"2024-08-17T02:26:42.912273+0000","last_unstale":"2024-08-17T02:26:42.912898+0000","last_undegraded":"2024-08-17T02:26:42.912898+0000","last_fullsized":"2024-08-17T02:26:42.912898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:44:26.694565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.906422+0000","last_change":"2024-08-17T02:26:42.906422+0000","last_active":"2024-08-17T02:26:42.906422+0000","last_peered":"2024-08-17T02:26:42.906422+0000","last_clean":"2024-08-17T02:26:42.906422+0000","last_became_active":"2024-08-17T02:26:42.906093+0000","last_became_peered":"2024-08-17T02:26:42.906093+0000","last_unstale":"2024-08-17T02:26:42.906422+0000","last_undegraded":"2024-08-17T02:26:42.906422+0000","last_fullsized":"2024-08-17T02:26:42.906422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:22.157799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904644+0000","last_change":"2024-08-17T02:26:42.904644+0000","last_active":"2024-08-17T02:26:42.904644+0000","last_peered":"2024-08-17T02:26:42.904644+0000","last_clean":"2024-08-17T02:26:42.904644+0000","last_became_active":"2024-08-17T02:26:42.903632+0000","last_became_peered":"2024-08-17T02:26:42.903632+0000","last_unstale":"2024-08-17T02:26:42.904644+0000","last_undegraded":"2024-08-17T02:26:42.904644+0000","last_fullsized":"2024-08-17T02:26:42.904644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:19.192691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921175+0000","last_change":"2024-08-17T02:26:42.917741+0000","last_active":"2024-08-17T02:26:42.921175+0000","last_peered":"2024-08-17T02:26:42.921175+0000","last_clean":"2024-08-17T02:26:42.921175+0000","last_became_active":"2024-08-17T02:26:42.917438+0000","last_became_peered":"2024-08-17T02:26:42.917438+0000","last_unstale":"2024-08-17T02:26:42.921175+0000","last_undegraded":"2024-08-17T02:26:42.921175+0000","last_fullsized":"2024-08-17T02:26:42.921175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:05.402861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904503+0000","last_change":"2024-08-17T02:26:42.895649+0000","last_active":"2024-08-17T02:26:42.904503+0000","last_peered":"2024-08-17T02:26:42.904503+0000","last_clean":"2024-08-17T02:26:42.904503+0000","last_became_active":"2024-08-17T02:26:42.895328+0000","last_became_peered":"2024-08-17T02:26:42.895328+0000","last_unstale":"2024-08-17T02:26:42.904503+0000","last_undegraded":"2024-08-17T02:26:42.904503+0000","last_fullsized":"2024-08-17T02:26:42.904503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:37:57.415755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.910604+0000","last_change":"2024-08-17T02:26:42.908333+0000","last_active":"2024-08-17T02:26:42.910604+0000","last_peered":"2024-08-17T02:26:42.910604+0000","last_clean":"2024-08-17T02:26:42.910604+0000","last_became_active":"2024-08-17T02:26:42.908074+0000","last_became_peered":"2024-08-17T02:26:42.908074+0000","last_unstale":"2024-08-17T02:26:42.910604+0000","last_undegraded":"2024-08-17T02:26:42.910604+0000","last_fullsized":"2024-08-17T02:26:42.910604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:28:20.184280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914532+0000","last_change":"2024-08-17T02:26:42.905166+0000","last_active":"2024-08-17T02:26:42.914532+0000","last_peered":"2024-08-17T02:26:42.914532+0000","last_clean":"2024-08-17T02:26:42.914532+0000","last_became_active":"2024-08-17T02:26:42.904635+0000","last_became_peered":"2024-08-17T02:26:42.904635+0000","last_unstale":"2024-08-17T02:26:42.914532+0000","last_undegraded":"2024-08-17T02:26:42.914532+0000","last_fullsized":"2024-08-17T02:26:42.914532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:49.204164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914404+0000","last_change":"2024-08-17T02:26:42.905005+0000","last_active":"2024-08-17T02:26:42.914404+0000","last_peered":"2024-08-17T02:26:42.914404+0000","last_clean":"2024-08-17T02:26:42.914404+0000","last_became_active":"2024-08-17T02:26:42.904342+0000","last_became_peered":"2024-08-17T02:26:42.904342+0000","last_unstale":"2024-08-17T02:26:42.914404+0000","last_undegraded":"2024-08-17T02:26:42.914404+0000","last_fullsized":"2024-08-17T02:26:42.914404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:54.999191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904494+0000","last_change":"2024-08-17T02:26:42.904494+0000","last_active":"2024-08-17T02:26:42.904494+0000","last_peered":"2024-08-17T02:26:42.904494+0000","last_clean":"2024-08-17T02:26:42.904494+0000","last_became_active":"2024-08-17T02:26:42.904157+0000","last_became_peered":"2024-08-17T02:26:42.904157+0000","last_unstale":"2024-08-17T02:26:42.904494+0000","last_undegraded":"2024-08-17T02:26:42.904494+0000","last_fullsized":"2024-08-17T02:26:42.904494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:55.687560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.908291+0000","last_change":"2024-08-17T02:26:42.908291+0000","last_active":"2024-08-17T02:26:42.908291+0000","last_peered":"2024-08-17T02:26:42.908291+0000","last_clean":"2024-08-17T02:26:42.908291+0000","last_became_active":"2024-08-17T02:26:42.907912+0000","last_became_peered":"2024-08-17T02:26:42.907912+0000","last_unstale":"2024-08-17T02:26:42.908291+0000","last_undegraded":"2024-08-17T02:26:42.908291+0000","last_fullsized":"2024-08-17T02:26:42.908291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:58.118037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.918965+0000","last_change":"2024-08-17T02:26:42.914810+0000","last_active":"2024-08-17T02:26:42.918965+0000","last_peered":"2024-08-17T02:26:42.918965+0000","last_clean":"2024-08-17T02:26:42.918965+0000","last_became_active":"2024-08-17T02:26:42.914535+0000","last_became_peered":"2024-08-17T02:26:42.914535+0000","last_unstale":"2024-08-17T02:26:42.918965+0000","last_undegraded":"2024-08-17T02:26:42.918965+0000","last_fullsized":"2024-08-17T02:26:42.918965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:55:55.555712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.907786+0000","last_change":"2024-08-17T02:26:42.903734+0000","last_active":"2024-08-17T02:26:42.907786+0000","last_peered":"2024-08-17T02:26:42.907786+0000","last_clean":"2024-08-17T02:26:42.907786+0000","last_became_active":"2024-08-17T02:26:42.903473+0000","last_became_peered":"2024-08-17T02:26:42.903473+0000","last_unstale":"2024-08-17T02:26:42.907786+0000","last_undegraded":"2024-08-17T02:26:42.907786+0000","last_fullsized":"2024-08-17T02:26:42.907786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:26:49.635760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.916024+0000","last_change":"2024-08-17T02:26:42.896195+0000","last_active":"2024-08-17T02:26:42.916024+0000","last_peered":"2024-08-17T02:26:42.916024+0000","last_clean":"2024-08-17T02:26:42.916024+0000","last_became_active":"2024-08-17T02:26:42.895901+0000","last_became_peered":"2024-08-17T02:26:42.895901+0000","last_unstale":"2024-08-17T02:26:42.916024+0000","last_undegraded":"2024-08-17T02:26:42.916024+0000","last_fullsized":"2024-08-17T02:26:42.916024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:22.323550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.908756+0000","last_change":"2024-08-17T02:26:42.908756+0000","last_active":"2024-08-17T02:26:42.908756+0000","last_peered":"2024-08-17T02:26:42.908756+0000","last_clean":"2024-08-17T02:26:42.908756+0000","last_became_active":"2024-08-17T02:26:42.908343+0000","last_became_peered":"2024-08-17T02:26:42.908343+0000","last_unstale":"2024-08-17T02:26:42.908756+0000","last_undegraded":"2024-08-17T02:26:42.908756+0000","last_fullsized":"2024-08-17T02:26:42.908756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:23.558376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914552+0000","last_change":"2024-08-17T02:26:42.905401+0000","last_active":"2024-08-17T02:26:42.914552+0000","last_peered":"2024-08-17T02:26:42.914552+0000","last_clean":"2024-08-17T02:26:42.914552+0000","last_became_active":"2024-08-17T02:26:42.905020+0000","last_became_peered":"2024-08-17T02:26:42.905020+0000","last_unstale":"2024-08-17T02:26:42.914552+0000","last_undegraded":"2024-08-17T02:26:42.914552+0000","last_fullsized":"2024-08-17T02:26:42.914552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:55:41.955127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904664+0000","last_change":"2024-08-17T02:26:42.904664+0000","last_active":"2024-08-17T02:26:42.904664+0000","last_peered":"2024-08-17T02:26:42.904664+0000","last_clean":"2024-08-17T02:26:42.904664+0000","last_became_active":"2024-08-17T02:26:42.903822+0000","last_became_peered":"2024-08-17T02:26:42.903822+0000","last_unstale":"2024-08-17T02:26:42.904664+0000","last_undegraded":"2024-08-17T02:26:42.904664+0000","last_fullsized":"2024-08-17T02:26:42.904664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:50:17.148297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.903540+0000","last_change":"2024-08-17T02:26:42.903540+0000","last_active":"2024-08-17T02:26:42.903540+0000","last_peered":"2024-08-17T02:26:42.903540+0000","last_clean":"2024-08-17T02:26:42.903540+0000","last_became_active":"2024-08-17T02:26:42.903101+0000","last_became_peered":"2024-08-17T02:26:42.903101+0000","last_unstale":"2024-08-17T02:26:42.903540+0000","last_undegraded":"2024-08-17T02:26:42.903540+0000","last_fullsized":"2024-08-17T02:26:42.903540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:59.914776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.905059+0000","last_change":"2024-08-17T02:26:42.905059+0000","last_active":"2024-08-17T02:26:42.905059+0000","last_peered":"2024-08-17T02:26:42.905059+0000","last_clean":"2024-08-17T02:26:42.905059+0000","last_became_active":"2024-08-17T02:26:42.903379+0000","last_became_peered":"2024-08-17T02:26:42.903379+0000","last_unstale":"2024-08-17T02:26:42.905059+0000","last_undegraded":"2024-08-17T02:26:42.905059+0000","last_fullsized":"2024-08-17T02:26:42.905059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:23.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.912381+0000","last_change":"2024-08-17T02:26:42.912381+0000","last_active":"2024-08-17T02:26:42.912381+0000","last_peered":"2024-08-17T02:26:42.912381+0000","last_clean":"2024-08-17T02:26:42.912381+0000","last_became_active":"2024-08-17T02:26:42.911588+0000","last_became_peered":"2024-08-17T02:26:42.911588+0000","last_unstale":"2024-08-17T02:26:42.912381+0000","last_undegraded":"2024-08-17T02:26:42.912381+0000","last_fullsized":"2024-08-17T02:26:42.912381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:20:35.623529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921401+0000","last_change":"2024-08-17T02:26:41.883823+0000","last_active":"2024-08-17T02:26:42.921401+0000","last_peered":"2024-08-17T02:26:42.921401+0000","last_clean":"2024-08-17T02:26:42.921401+0000","last_became_active":"2024-08-17T02:26:41.883251+0000","last_became_peered":"2024-08-17T02:26:41.883251+0000","last_unstale":"2024-08-17T02:26:42.921401+0000","last_undegraded":"2024-08-17T02:26:42.921401+0000","last_fullsized":"2024-08-17T02:26:42.921401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:51.510920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.903131+0000","last_change":"2024-08-17T02:26:42.903131+0000","last_active":"2024-08-17T02:26:42.903131+0000","last_peered":"2024-08-17T02:26:42.903131+0000","last_clean":"2024-08-17T02:26:42.903131+0000","last_became_active":"2024-08-17T02:26:42.902730+0000","last_became_peered":"2024-08-17T02:26:42.902730+0000","last_unstale":"2024-08-17T02:26:42.903131+0000","last_undegraded":"2024-08-17T02:26:42.903131+0000","last_fullsized":"2024-08-17T02:26:42.903131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:49.369237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.899468+0000","last_change":"2024-08-17T02:26:41.887356+0000","last_active":"2024-08-17T02:26:42.899468+0000","last_peered":"2024-08-17T02:26:42.899468+0000","last_clean":"2024-08-17T02:26:42.899468+0000","last_became_active":"2024-08-17T02:26:41.887032+0000","last_became_peered":"2024-08-17T02:26:41.887032+0000","last_unstale":"2024-08-17T02:26:42.899468+0000","last_undegraded":"2024-08-17T02:26:42.899468+0000","last_fullsized":"2024-08-17T02:26:42.899468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:48:55.285578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914298+0000","last_change":"2024-08-17T02:26:42.904879+0000","last_active":"2024-08-17T02:26:42.914298+0000","last_peered":"2024-08-17T02:26:42.914298+0000","last_clean":"2024-08-17T02:26:42.914298+0000","last_became_active":"2024-08-17T02:26:42.904591+0000","last_became_peered":"2024-08-17T02:26:42.904591+0000","last_unstale":"2024-08-17T02:26:42.914298+0000","last_undegraded":"2024-08-17T02:26:42.914298+0000","last_fullsized":"2024-08-17T02:26:42.914298+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:13.175988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.924046+0000","last_change":"2024-08-17T02:26:41.878768+0000","last_active":"2024-08-17T02:26:42.924046+0000","last_peered":"2024-08-17T02:26:42.924046+0000","last_clean":"2024-08-17T02:26:42.924046+0000","last_became_active":"2024-08-17T02:26:41.878411+0000","last_became_peered":"2024-08-17T02:26:41.878411+0000","last_unstale":"2024-08-17T02:26:42.924046+0000","last_undegraded":"2024-08-17T02:26:42.924046+0000","last_fullsized":"2024-08-17T02:26:42.924046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:01:18.773172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.916001+0000","last_change":"2024-08-17T02:26:42.895464+0000","last_active":"2024-08-17T02:26:42.916001+0000","last_peered":"2024-08-17T02:26:42.916001+0000","last_clean":"2024-08-17T02:26:42.916001+0000","last_became_active":"2024-08-17T02:26:42.894964+0000","last_became_peered":"2024-08-17T02:26:42.894964+0000","last_unstale":"2024-08-17T02:26:42.916001+0000","last_undegraded":"2024-08-17T02:26:42.916001+0000","last_fullsized":"2024-08-17T02:26:42.916001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:54.999191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.919533+0000","last_change":"2024-08-17T02:26:41.875625+0000","last_active":"2024-08-17T02:26:42.919533+0000","last_peered":"2024-08-17T02:26:42.919533+0000","last_clean":"2024-08-17T02:26:42.919533+0000","last_became_active":"2024-08-17T02:26:41.875358+0000","last_became_peered":"2024-08-17T02:26:41.875358+0000","last_unstale":"2024-08-17T02:26:42.919533+0000","last_undegraded":"2024-08-17T02:26:42.919533+0000","last_fullsized":"2024-08-17T02:26:42.919533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:36.726951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.905114+0000","last_change":"2024-08-17T02:26:42.905114+0000","last_active":"2024-08-17T02:26:42.905114+0000","last_peered":"2024-08-17T02:26:42.905114+0000","last_clean":"2024-08-17T02:26:42.905114+0000","last_became_active":"2024-08-17T02:26:42.904839+0000","last_became_peered":"2024-08-17T02:26:42.904839+0000","last_unstale":"2024-08-17T02:26:42.905114+0000","last_undegraded":"2024-08-17T02:26:42.905114+0000","last_fullsized":"2024-08-17T02:26:42.905114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:30:51.965463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921007+0000","last_change":"2024-08-17T02:26:41.885244+0000","last_active":"2024-08-17T02:26:42.921007+0000","last_peered":"2024-08-17T02:26:42.921007+0000","last_clean":"2024-08-17T02:26:42.921007+0000","last_became_active":"2024-08-17T02:26:41.884437+0000","last_became_peered":"2024-08-17T02:26:41.884437+0000","last_unstale":"2024-08-17T02:26:42.921007+0000","last_undegraded":"2024-08-17T02:26:42.921007+0000","last_fullsized":"2024-08-17T02:26:42.921007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:53:52.109330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.902921+0000","last_change":"2024-08-17T02:26:42.902921+0000","last_active":"2024-08-17T02:26:42.902921+0000","last_peered":"2024-08-17T02:26:42.902921+0000","last_clean":"2024-08-17T02:26:42.902921+0000","last_became_active":"2024-08-17T02:26:42.902622+0000","last_became_peered":"2024-08-17T02:26:42.902622+0000","last_unstale":"2024-08-17T02:26:42.902921+0000","last_undegraded":"2024-08-17T02:26:42.902921+0000","last_fullsized":"2024-08-17T02:26:42.902921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:09.377231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921003+0000","last_change":"2024-08-17T02:26:41.885371+0000","last_active":"2024-08-17T02:26:42.921003+0000","last_peered":"2024-08-17T02:26:42.921003+0000","last_clean":"2024-08-17T02:26:42.921003+0000","last_became_active":"2024-08-17T02:26:41.884544+0000","last_became_peered":"2024-08-17T02:26:41.884544+0000","last_unstale":"2024-08-17T02:26:42.921003+0000","last_undegraded":"2024-08-17T02:26:42.921003+0000","last_fullsized":"2024-08-17T02:26:42.921003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:26:46.143935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.910759+0000","last_change":"2024-08-17T02:26:42.901170+0000","last_active":"2024-08-17T02:26:42.910759+0000","last_peered":"2024-08-17T02:26:42.910759+0000","last_clean":"2024-08-17T02:26:42.910759+0000","last_became_active":"2024-08-17T02:26:42.900878+0000","last_became_peered":"2024-08-17T02:26:42.900878+0000","last_unstale":"2024-08-17T02:26:42.910759+0000","last_undegraded":"2024-08-17T02:26:42.910759+0000","last_fullsized":"2024-08-17T02:26:42.910759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:07.505884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.893484+0000","last_change":"2024-08-17T02:26:41.882796+0000","last_active":"2024-08-17T02:26:42.893484+0000","last_peered":"2024-08-17T02:26:42.893484+0000","last_clean":"2024-08-17T02:26:42.893484+0000","last_became_active":"2024-08-17T02:26:41.882439+0000","last_became_peered":"2024-08-17T02:26:41.882439+0000","last_unstale":"2024-08-17T02:26:42.893484+0000","last_undegraded":"2024-08-17T02:26:42.893484+0000","last_fullsized":"2024-08-17T02:26:42.893484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:47:07.290965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921283+0000","last_change":"2024-08-17T02:26:42.916617+0000","last_active":"2024-08-17T02:26:42.921283+0000","last_peered":"2024-08-17T02:26:42.921283+0000","last_clean":"2024-08-17T02:26:42.921283+0000","last_became_active":"2024-08-17T02:26:42.916280+0000","last_became_peered":"2024-08-17T02:26:42.916280+0000","last_unstale":"2024-08-17T02:26:42.921283+0000","last_undegraded":"2024-08-17T02:26:42.921283+0000","last_fullsized":"2024-08-17T02:26:42.921283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:09.377231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.890331+0000","last_change":"2024-08-17T02:26:41.878706+0000","last_active":"2024-08-17T02:26:42.890331+0000","last_peered":"2024-08-17T02:26:42.890331+0000","last_clean":"2024-08-17T02:26:42.890331+0000","last_became_active":"2024-08-17T02:26:41.878353+0000","last_became_peered":"2024-08-17T02:26:41.878353+0000","last_unstale":"2024-08-17T02:26:42.890331+0000","last_undegraded":"2024-08-17T02:26:42.890331+0000","last_fullsized":"2024-08-17T02:26:42.890331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:45:47.128790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.907957+0000","last_change":"2024-08-17T02:26:42.907957+0000","last_active":"2024-08-17T02:26:42.907957+0000","last_peered":"2024-08-17T02:26:42.907957+0000","last_clean":"2024-08-17T02:26:42.907957+0000","last_became_active":"2024-08-17T02:26:42.907352+0000","last_became_peered":"2024-08-17T02:26:42.907352+0000","last_unstale":"2024-08-17T02:26:42.907957+0000","last_undegraded":"2024-08-17T02:26:42.907957+0000","last_fullsized":"2024-08-17T02:26:42.907957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:58.812100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.896073+0000","last_change":"2024-08-17T02:26:41.887971+0000","last_active":"2024-08-17T02:26:42.896073+0000","last_peered":"2024-08-17T02:26:42.896073+0000","last_clean":"2024-08-17T02:26:42.896073+0000","last_became_active":"2024-08-17T02:26:41.887512+0000","last_became_peered":"2024-08-17T02:26:41.887512+0000","last_unstale":"2024-08-17T02:26:42.896073+0000","last_undegraded":"2024-08-17T02:26:42.896073+0000","last_fullsized":"2024-08-17T02:26:42.896073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:48.366344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.907468+0000","last_change":"2024-08-17T02:26:42.902576+0000","last_active":"2024-08-17T02:26:42.907468+0000","last_peered":"2024-08-17T02:26:42.907468+0000","last_clean":"2024-08-17T02:26:42.907468+0000","last_became_active":"2024-08-17T02:26:42.902193+0000","last_became_peered":"2024-08-17T02:26:42.902193+0000","last_unstale":"2024-08-17T02:26:42.907468+0000","last_undegraded":"2024-08-17T02:26:42.907468+0000","last_fullsized":"2024-08-17T02:26:42.907468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:22.157799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:41.880564+0000","last_change":"2024-08-17T02:26:41.877480+0000","last_active":"2024-08-17T02:26:41.880564+0000","last_peered":"2024-08-17T02:26:41.880564+0000","last_clean":"2024-08-17T02:26:41.880564+0000","last_became_active":"2024-08-17T02:26:41.877193+0000","last_became_peered":"2024-08-17T02:26:41.877193+0000","last_unstale":"2024-08-17T02:26:41.880564+0000","last_undegraded":"2024-08-17T02:26:41.880564+0000","last_fullsized":"2024-08-17T02:26:41.880564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:33:25.083015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.907484+0000","last_change":"2024-08-17T02:26:42.902556+0000","last_active":"2024-08-17T02:26:42.907484+0000","last_peered":"2024-08-17T02:26:42.907484+0000","last_clean":"2024-08-17T02:26:42.907484+0000","last_became_active":"2024-08-17T02:26:42.902040+0000","last_became_peered":"2024-08-17T02:26:42.902040+0000","last_unstale":"2024-08-17T02:26:42.907484+0000","last_undegraded":"2024-08-17T02:26:42.907484+0000","last_fullsized":"2024-08-17T02:26:42.907484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:47.517185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921345+0000","last_change":"2024-08-17T02:26:41.889812+0000","last_active":"2024-08-17T02:26:42.921345+0000","last_peered":"2024-08-17T02:26:42.921345+0000","last_clean":"2024-08-17T02:26:42.921345+0000","last_became_active":"2024-08-17T02:26:41.889528+0000","last_became_peered":"2024-08-17T02:26:41.889528+0000","last_unstale":"2024-08-17T02:26:42.921345+0000","last_undegraded":"2024-08-17T02:26:42.921345+0000","last_fullsized":"2024-08-17T02:26:42.921345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:16.939562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.922813+0000","last_change":"2024-08-17T02:26:42.922813+0000","last_active":"2024-08-17T02:26:42.922813+0000","last_peered":"2024-08-17T02:26:42.922813+0000","last_clean":"2024-08-17T02:26:42.922813+0000","last_became_active":"2024-08-17T02:26:42.922472+0000","last_became_peered":"2024-08-17T02:26:42.922472+0000","last_unstale":"2024-08-17T02:26:42.922813+0000","last_undegraded":"2024-08-17T02:26:42.922813+0000","last_fullsized":"2024-08-17T02:26:42.922813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:58:18.622105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.925505+0000","last_change":"2024-08-17T02:26:41.881833+0000","last_active":"2024-08-17T02:26:42.925505+0000","last_peered":"2024-08-17T02:26:42.925505+0000","last_clean":"2024-08-17T02:26:42.925505+0000","last_became_active":"2024-08-17T02:26:41.878601+0000","last_became_peered":"2024-08-17T02:26:41.878601+0000","last_unstale":"2024-08-17T02:26:42.925505+0000","last_undegraded":"2024-08-17T02:26:42.925505+0000","last_fullsized":"2024-08-17T02:26:42.925505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:58.911882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921241+0000","last_change":"2024-08-17T02:26:42.916870+0000","last_active":"2024-08-17T02:26:42.921241+0000","last_peered":"2024-08-17T02:26:42.921241+0000","last_clean":"2024-08-17T02:26:42.921241+0000","last_became_active":"2024-08-17T02:26:42.916180+0000","last_became_peered":"2024-08-17T02:26:42.916180+0000","last_unstale":"2024-08-17T02:26:42.921241+0000","last_undegraded":"2024-08-17T02:26:42.921241+0000","last_fullsized":"2024-08-17T02:26:42.921241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:44:26.694565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.920957+0000","last_change":"2024-08-17T02:26:41.878696+0000","last_active":"2024-08-17T02:26:42.920957+0000","last_peered":"2024-08-17T02:26:42.920957+0000","last_clean":"2024-08-17T02:26:42.920957+0000","last_became_active":"2024-08-17T02:26:41.878379+0000","last_became_peered":"2024-08-17T02:26:41.878379+0000","last_unstale":"2024-08-17T02:26:42.920957+0000","last_undegraded":"2024-08-17T02:26:42.920957+0000","last_fullsized":"2024-08-17T02:26:42.920957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:25:40.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.907990+0000","last_change":"2024-08-17T02:26:42.902693+0000","last_active":"2024-08-17T02:26:42.907990+0000","last_peered":"2024-08-17T02:26:42.907990+0000","last_clean":"2024-08-17T02:26:42.907990+0000","last_became_active":"2024-08-17T02:26:42.901198+0000","last_became_peered":"2024-08-17T02:26:42.901198+0000","last_unstale":"2024-08-17T02:26:42.907990+0000","last_undegraded":"2024-08-17T02:26:42.907990+0000","last_fullsized":"2024-08-17T02:26:42.907990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:21.932351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.887953+0000","last_change":"2024-08-17T02:26:41.878680+0000","last_active":"2024-08-17T02:26:42.887953+0000","last_peered":"2024-08-17T02:26:42.887953+0000","last_clean":"2024-08-17T02:26:42.887953+0000","last_became_active":"2024-08-17T02:26:41.878404+0000","last_became_peered":"2024-08-17T02:26:41.878404+0000","last_unstale":"2024-08-17T02:26:42.887953+0000","last_undegraded":"2024-08-17T02:26:42.887953+0000","last_fullsized":"2024-08-17T02:26:42.887953+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:57.595861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.903628+0000","last_change":"2024-08-17T02:26:42.903628+0000","last_active":"2024-08-17T02:26:42.903628+0000","last_peered":"2024-08-17T02:26:42.903628+0000","last_clean":"2024-08-17T02:26:42.903628+0000","last_became_active":"2024-08-17T02:26:42.902944+0000","last_became_peered":"2024-08-17T02:26:42.902944+0000","last_unstale":"2024-08-17T02:26:42.903628+0000","last_undegraded":"2024-08-17T02:26:42.903628+0000","last_fullsized":"2024-08-17T02:26:42.903628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:05.402861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.887435+0000","last_change":"2024-08-17T02:26:41.885063+0000","last_active":"2024-08-17T02:26:42.887435+0000","last_peered":"2024-08-17T02:26:42.887435+0000","last_clean":"2024-08-17T02:26:42.887435+0000","last_became_active":"2024-08-17T02:26:41.884590+0000","last_became_peered":"2024-08-17T02:26:41.884590+0000","last_unstale":"2024-08-17T02:26:42.887435+0000","last_undegraded":"2024-08-17T02:26:42.887435+0000","last_fullsized":"2024-08-17T02:26:42.887435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:17:30.109039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.903383+0000","last_change":"2024-08-17T02:26:42.903383+0000","last_active":"2024-08-17T02:26:42.903383+0000","last_peered":"2024-08-17T02:26:42.903383+0000","last_clean":"2024-08-17T02:26:42.903383+0000","last_became_active":"2024-08-17T02:26:42.902756+0000","last_became_peered":"2024-08-17T02:26:42.902756+0000","last_unstale":"2024-08-17T02:26:42.903383+0000","last_undegraded":"2024-08-17T02:26:42.903383+0000","last_fullsized":"2024-08-17T02:26:42.903383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:17:31.111932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.923406+0000","last_change":"2024-08-17T02:26:41.879446+0000","last_active":"2024-08-17T02:26:42.923406+0000","last_peered":"2024-08-17T02:26:42.923406+0000","last_clean":"2024-08-17T02:26:42.923406+0000","last_became_active":"2024-08-17T02:26:41.878601+0000","last_became_peered":"2024-08-17T02:26:41.878601+0000","last_unstale":"2024-08-17T02:26:42.923406+0000","last_undegraded":"2024-08-17T02:26:42.923406+0000","last_fullsized":"2024-08-17T02:26:42.923406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:09.058484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921187+0000","last_change":"2024-08-17T02:26:42.913449+0000","last_active":"2024-08-17T02:26:42.921187+0000","last_peered":"2024-08-17T02:26:42.921187+0000","last_clean":"2024-08-17T02:26:42.921187+0000","last_became_active":"2024-08-17T02:26:42.913038+0000","last_became_peered":"2024-08-17T02:26:42.913038+0000","last_unstale":"2024-08-17T02:26:42.921187+0000","last_undegraded":"2024-08-17T02:26:42.921187+0000","last_fullsized":"2024-08-17T02:26:42.921187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:14.960789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.923050+0000","last_change":"2024-08-17T02:26:41.884565+0000","last_active":"2024-08-17T02:26:42.923050+0000","last_peered":"2024-08-17T02:26:42.923050+0000","last_clean":"2024-08-17T02:26:42.923050+0000","last_became_active":"2024-08-17T02:26:41.884274+0000","last_became_peered":"2024-08-17T02:26:41.884274+0000","last_unstale":"2024-08-17T02:26:42.923050+0000","last_undegraded":"2024-08-17T02:26:42.923050+0000","last_fullsized":"2024-08-17T02:26:42.923050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:19:55.911978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914882+0000","last_change":"2024-08-17T02:26:42.914882+0000","last_active":"2024-08-17T02:26:42.914882+0000","last_peered":"2024-08-17T02:26:42.914882+0000","last_clean":"2024-08-17T02:26:42.914882+0000","last_became_active":"2024-08-17T02:26:42.914635+0000","last_became_peered":"2024-08-17T02:26:42.914635+0000","last_unstale":"2024-08-17T02:26:42.914882+0000","last_undegraded":"2024-08-17T02:26:42.914882+0000","last_fullsized":"2024-08-17T02:26:42.914882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:07.035098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921129+0000","last_change":"2024-08-17T02:26:41.880827+0000","last_active":"2024-08-17T02:26:42.921129+0000","last_peered":"2024-08-17T02:26:42.921129+0000","last_clean":"2024-08-17T02:26:42.921129+0000","last_became_active":"2024-08-17T02:26:41.880552+0000","last_became_peered":"2024-08-17T02:26:41.880552+0000","last_unstale":"2024-08-17T02:26:42.921129+0000","last_undegraded":"2024-08-17T02:26:42.921129+0000","last_fullsized":"2024-08-17T02:26:42.921129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:30.285004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914122+0000","last_change":"2024-08-17T02:26:42.896769+0000","last_active":"2024-08-17T02:26:42.914122+0000","last_peered":"2024-08-17T02:26:42.914122+0000","last_clean":"2024-08-17T02:26:42.914122+0000","last_became_active":"2024-08-17T02:26:42.896287+0000","last_became_peered":"2024-08-17T02:26:42.896287+0000","last_unstale":"2024-08-17T02:26:42.914122+0000","last_undegraded":"2024-08-17T02:26:42.914122+0000","last_fullsized":"2024-08-17T02:26:42.914122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:58.118037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.920929+0000","last_change":"2024-08-17T02:26:41.877534+0000","last_active":"2024-08-17T02:26:42.920929+0000","last_peered":"2024-08-17T02:26:42.920929+0000","last_clean":"2024-08-17T02:26:42.920929+0000","last_became_active":"2024-08-17T02:26:41.877250+0000","last_became_peered":"2024-08-17T02:26:41.877250+0000","last_unstale":"2024-08-17T02:26:42.920929+0000","last_undegraded":"2024-08-17T02:26:42.920929+0000","last_fullsized":"2024-08-17T02:26:42.920929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:26:04.753309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914313+0000","last_change":"2024-08-17T02:26:42.912131+0000","last_active":"2024-08-17T02:26:42.914313+0000","last_peered":"2024-08-17T02:26:42.914313+0000","last_clean":"2024-08-17T02:26:42.914313+0000","last_became_active":"2024-08-17T02:26:42.911821+0000","last_became_peered":"2024-08-17T02:26:42.911821+0000","last_unstale":"2024-08-17T02:26:42.914313+0000","last_undegraded":"2024-08-17T02:26:42.914313+0000","last_fullsized":"2024-08-17T02:26:42.914313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:07.212415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.889669+0000","last_change":"2024-08-17T02:26:41.884913+0000","last_active":"2024-08-17T02:26:42.889669+0000","last_peered":"2024-08-17T02:26:42.889669+0000","last_clean":"2024-08-17T02:26:42.889669+0000","last_became_active":"2024-08-17T02:26:41.884717+0000","last_became_peered":"2024-08-17T02:26:41.884717+0000","last_unstale":"2024-08-17T02:26:42.889669+0000","last_undegraded":"2024-08-17T02:26:42.889669+0000","last_fullsized":"2024-08-17T02:26:42.889669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:49:12.847432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914451+0000","last_change":"2024-08-17T02:26:42.912595+0000","last_active":"2024-08-17T02:26:42.914451+0000","last_peered":"2024-08-17T02:26:42.914451+0000","last_clean":"2024-08-17T02:26:42.914451+0000","last_became_active":"2024-08-17T02:26:42.912167+0000","last_became_peered":"2024-08-17T02:26:42.912167+0000","last_unstale":"2024-08-17T02:26:42.914451+0000","last_undegraded":"2024-08-17T02:26:42.914451+0000","last_fullsized":"2024-08-17T02:26:42.914451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:46:07.035843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.919117+0000","last_change":"2024-08-17T02:26:41.877347+0000","last_active":"2024-08-17T02:26:42.919117+0000","last_peered":"2024-08-17T02:26:42.919117+0000","last_clean":"2024-08-17T02:26:42.919117+0000","last_became_active":"2024-08-17T02:26:41.877073+0000","last_became_peered":"2024-08-17T02:26:41.877073+0000","last_unstale":"2024-08-17T02:26:42.919117+0000","last_undegraded":"2024-08-17T02:26:42.919117+0000","last_fullsized":"2024-08-17T02:26:42.919117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:42:18.050608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.908443+0000","last_change":"2024-08-17T02:26:42.905372+0000","last_active":"2024-08-17T02:26:42.908443+0000","last_peered":"2024-08-17T02:26:42.908443+0000","last_clean":"2024-08-17T02:26:42.908443+0000","last_became_active":"2024-08-17T02:26:42.905075+0000","last_became_peered":"2024-08-17T02:26:42.905075+0000","last_unstale":"2024-08-17T02:26:42.908443+0000","last_undegraded":"2024-08-17T02:26:42.908443+0000","last_fullsized":"2024-08-17T02:26:42.908443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:49.840135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:41.889274+0000","last_change":"2024-08-17T02:26:41.884001+0000","last_active":"2024-08-17T02:26:41.889274+0000","last_peered":"2024-08-17T02:26:41.889274+0000","last_clean":"2024-08-17T02:26:41.889274+0000","last_became_active":"2024-08-17T02:26:41.882276+0000","last_became_peered":"2024-08-17T02:26:41.882276+0000","last_unstale":"2024-08-17T02:26:41.889274+0000","last_undegraded":"2024-08-17T02:26:41.889274+0000","last_fullsized":"2024-08-17T02:26:41.889274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:33:25.083015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.908995+0000","last_change":"2024-08-17T02:26:42.905492+0000","last_active":"2024-08-17T02:26:42.908995+0000","last_peered":"2024-08-17T02:26:42.908995+0000","last_clean":"2024-08-17T02:26:42.908995+0000","last_became_active":"2024-08-17T02:26:42.905187+0000","last_became_peered":"2024-08-17T02:26:42.905187+0000","last_unstale":"2024-08-17T02:26:42.908995+0000","last_undegraded":"2024-08-17T02:26:42.908995+0000","last_fullsized":"2024-08-17T02:26:42.908995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:21:22.234731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.888038+0000","last_change":"2024-08-17T02:26:41.874962+0000","last_active":"2024-08-17T02:26:42.888038+0000","last_peered":"2024-08-17T02:26:42.888038+0000","last_clean":"2024-08-17T02:26:42.888038+0000","last_became_active":"2024-08-17T02:26:41.874358+0000","last_became_peered":"2024-08-17T02:26:41.874358+0000","last_unstale":"2024-08-17T02:26:42.888038+0000","last_undegraded":"2024-08-17T02:26:42.888038+0000","last_fullsized":"2024-08-17T02:26:42.888038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:05:49.073134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.905252+0000","last_change":"2024-08-17T02:26:42.905252+0000","last_active":"2024-08-17T02:26:42.905252+0000","last_peered":"2024-08-17T02:26:42.905252+0000","last_clean":"2024-08-17T02:26:42.905252+0000","last_became_active":"2024-08-17T02:26:42.904353+0000","last_became_peered":"2024-08-17T02:26:42.904353+0000","last_unstale":"2024-08-17T02:26:42.905252+0000","last_undegraded":"2024-08-17T02:26:42.905252+0000","last_fullsized":"2024-08-17T02:26:42.905252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:21.932351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:41.891485+0000","last_change":"2024-08-17T02:26:41.888677+0000","last_active":"2024-08-17T02:26:41.891485+0000","last_peered":"2024-08-17T02:26:41.891485+0000","last_clean":"2024-08-17T02:26:41.891485+0000","last_became_active":"2024-08-17T02:26:41.888226+0000","last_became_peered":"2024-08-17T02:26:41.888226+0000","last_unstale":"2024-08-17T02:26:41.891485+0000","last_undegraded":"2024-08-17T02:26:41.891485+0000","last_fullsized":"2024-08-17T02:26:41.891485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:44:11.558043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.916449+0000","last_change":"2024-08-17T02:26:42.914333+0000","last_active":"2024-08-17T02:26:42.916449+0000","last_peered":"2024-08-17T02:26:42.916449+0000","last_clean":"2024-08-17T02:26:42.916449+0000","last_became_active":"2024-08-17T02:26:42.914006+0000","last_became_peered":"2024-08-17T02:26:42.914006+0000","last_unstale":"2024-08-17T02:26:42.916449+0000","last_undegraded":"2024-08-17T02:26:42.916449+0000","last_fullsized":"2024-08-17T02:26:42.916449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:16:37.504708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.922555+0000","last_change":"2024-08-17T02:26:41.883660+0000","last_active":"2024-08-17T02:26:42.922555+0000","last_peered":"2024-08-17T02:26:42.922555+0000","last_clean":"2024-08-17T02:26:42.922555+0000","last_became_active":"2024-08-17T02:26:41.883321+0000","last_became_peered":"2024-08-17T02:26:41.883321+0000","last_unstale":"2024-08-17T02:26:42.922555+0000","last_undegraded":"2024-08-17T02:26:42.922555+0000","last_fullsized":"2024-08-17T02:26:42.922555+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:02:21.592473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.922095+0000","last_change":"2024-08-17T02:26:42.922095+0000","last_active":"2024-08-17T02:26:42.922095+0000","last_peered":"2024-08-17T02:26:42.922095+0000","last_clean":"2024-08-17T02:26:42.922095+0000","last_became_active":"2024-08-17T02:26:42.921771+0000","last_became_peered":"2024-08-17T02:26:42.921771+0000","last_unstale":"2024-08-17T02:26:42.922095+0000","last_undegraded":"2024-08-17T02:26:42.922095+0000","last_fullsized":"2024-08-17T02:26:42.922095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:39:12.343432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:41.877819+0000","last_change":"2024-08-17T02:26:41.874792+0000","last_active":"2024-08-17T02:26:41.877819+0000","last_peered":"2024-08-17T02:26:41.877819+0000","last_clean":"2024-08-17T02:26:41.877819+0000","last_became_active":"2024-08-17T02:26:41.874503+0000","last_became_peered":"2024-08-17T02:26:41.874503+0000","last_unstale":"2024-08-17T02:26:41.877819+0000","last_undegraded":"2024-08-17T02:26:41.877819+0000","last_fullsized":"2024-08-17T02:26:41.877819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:21.500716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.922400+0000","last_change":"2024-08-17T02:26:42.922400+0000","last_active":"2024-08-17T02:26:42.922400+0000","last_peered":"2024-08-17T02:26:42.922400+0000","last_clean":"2024-08-17T02:26:42.922400+0000","last_became_active":"2024-08-17T02:26:42.922065+0000","last_became_peered":"2024-08-17T02:26:42.922065+0000","last_unstale":"2024-08-17T02:26:42.922400+0000","last_undegraded":"2024-08-17T02:26:42.922400+0000","last_fullsized":"2024-08-17T02:26:42.922400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:59.914776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.888712+0000","last_change":"2024-08-17T02:26:41.877473+0000","last_active":"2024-08-17T02:26:42.888712+0000","last_peered":"2024-08-17T02:26:42.888712+0000","last_clean":"2024-08-17T02:26:42.888712+0000","last_became_active":"2024-08-17T02:26:41.877157+0000","last_became_peered":"2024-08-17T02:26:41.877157+0000","last_unstale":"2024-08-17T02:26:42.888712+0000","last_undegraded":"2024-08-17T02:26:42.888712+0000","last_fullsized":"2024-08-17T02:26:42.888712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:08.217922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904315+0000","last_change":"2024-08-17T02:26:42.904315+0000","last_active":"2024-08-17T02:26:42.904315+0000","last_peered":"2024-08-17T02:26:42.904315+0000","last_clean":"2024-08-17T02:26:42.904315+0000","last_became_active":"2024-08-17T02:26:42.904016+0000","last_became_peered":"2024-08-17T02:26:42.904016+0000","last_unstale":"2024-08-17T02:26:42.904315+0000","last_undegraded":"2024-08-17T02:26:42.904315+0000","last_fullsized":"2024-08-17T02:26:42.904315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:10.061377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:41.880817+0000","last_change":"2024-08-17T02:26:41.879691+0000","last_active":"2024-08-17T02:26:41.880817+0000","last_peered":"2024-08-17T02:26:41.880817+0000","last_clean":"2024-08-17T02:26:41.880817+0000","last_became_active":"2024-08-17T02:26:41.879446+0000","last_became_peered":"2024-08-17T02:26:41.879446+0000","last_unstale":"2024-08-17T02:26:41.880817+0000","last_undegraded":"2024-08-17T02:26:41.880817+0000","last_fullsized":"2024-08-17T02:26:41.880817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:36.149653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.909988+0000","last_change":"2024-08-17T02:26:42.909988+0000","last_active":"2024-08-17T02:26:42.909988+0000","last_peered":"2024-08-17T02:26:42.909988+0000","last_clean":"2024-08-17T02:26:42.909988+0000","last_became_active":"2024-08-17T02:26:42.909489+0000","last_became_peered":"2024-08-17T02:26:42.909489+0000","last_unstale":"2024-08-17T02:26:42.909988+0000","last_undegraded":"2024-08-17T02:26:42.909988+0000","last_fullsized":"2024-08-17T02:26:42.909988+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:01:19.776065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.888072+0000","last_change":"2024-08-17T02:26:41.880030+0000","last_active":"2024-08-17T02:26:42.888072+0000","last_peered":"2024-08-17T02:26:42.888072+0000","last_clean":"2024-08-17T02:26:42.888072+0000","last_became_active":"2024-08-17T02:26:41.879241+0000","last_became_peered":"2024-08-17T02:26:41.879241+0000","last_unstale":"2024-08-17T02:26:42.888072+0000","last_undegraded":"2024-08-17T02:26:42.888072+0000","last_fullsized":"2024-08-17T02:26:42.888072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:34.888550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904660+0000","last_change":"2024-08-17T02:26:42.898024+0000","last_active":"2024-08-17T02:26:42.904660+0000","last_peered":"2024-08-17T02:26:42.904660+0000","last_clean":"2024-08-17T02:26:42.904660+0000","last_became_active":"2024-08-17T02:26:42.896946+0000","last_became_peered":"2024-08-17T02:26:42.896946+0000","last_unstale":"2024-08-17T02:26:42.904660+0000","last_undegraded":"2024-08-17T02:26:42.904660+0000","last_fullsized":"2024-08-17T02:26:42.904660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:12.799975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.888275+0000","last_change":"2024-08-17T02:26:41.875105+0000","last_active":"2024-08-17T02:26:42.888275+0000","last_peered":"2024-08-17T02:26:42.888275+0000","last_clean":"2024-08-17T02:26:42.888275+0000","last_became_active":"2024-08-17T02:26:41.874704+0000","last_became_peered":"2024-08-17T02:26:41.874704+0000","last_unstale":"2024-08-17T02:26:42.888275+0000","last_undegraded":"2024-08-17T02:26:42.888275+0000","last_fullsized":"2024-08-17T02:26:42.888275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:09:57.637856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914317+0000","last_change":"2024-08-17T02:26:42.904789+0000","last_active":"2024-08-17T02:26:42.914317+0000","last_peered":"2024-08-17T02:26:42.914317+0000","last_clean":"2024-08-17T02:26:42.914317+0000","last_became_active":"2024-08-17T02:26:42.904460+0000","last_became_peered":"2024-08-17T02:26:42.904460+0000","last_unstale":"2024-08-17T02:26:42.914317+0000","last_undegraded":"2024-08-17T02:26:42.914317+0000","last_fullsized":"2024-08-17T02:26:42.914317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:18.766640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.891073+0000","last_change":"2024-08-17T02:26:41.890078+0000","last_active":"2024-08-17T02:26:42.891073+0000","last_peered":"2024-08-17T02:26:42.891073+0000","last_clean":"2024-08-17T02:26:42.891073+0000","last_became_active":"2024-08-17T02:26:41.889688+0000","last_became_peered":"2024-08-17T02:26:41.889688+0000","last_unstale":"2024-08-17T02:26:42.891073+0000","last_undegraded":"2024-08-17T02:26:42.891073+0000","last_fullsized":"2024-08-17T02:26:42.891073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:24:27.230099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904805+0000","last_change":"2024-08-17T02:26:42.904805+0000","last_active":"2024-08-17T02:26:42.904805+0000","last_peered":"2024-08-17T02:26:42.904805+0000","last_clean":"2024-08-17T02:26:42.904805+0000","last_became_active":"2024-08-17T02:26:42.904384+0000","last_became_peered":"2024-08-17T02:26:42.904384+0000","last_unstale":"2024-08-17T02:26:42.904805+0000","last_undegraded":"2024-08-17T02:26:42.904805+0000","last_fullsized":"2024-08-17T02:26:42.904805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:55.687560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:41.883708+0000","last_change":"2024-08-17T02:26:41.882314+0000","last_active":"2024-08-17T02:26:41.883708+0000","last_peered":"2024-08-17T02:26:41.883708+0000","last_clean":"2024-08-17T02:26:41.883708+0000","last_became_active":"2024-08-17T02:26:41.881240+0000","last_became_peered":"2024-08-17T02:26:41.881240+0000","last_unstale":"2024-08-17T02:26:41.883708+0000","last_undegraded":"2024-08-17T02:26:41.883708+0000","last_fullsized":"2024-08-17T02:26:41.883708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:06.209522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:41.887286+0000","last_change":"2024-08-17T02:25:51.241912+0000","last_active":"2024-08-17T02:26:41.887286+0000","last_peered":"2024-08-17T02:26:41.887286+0000","last_clean":"2024-08-17T02:26:41.887286+0000","last_became_active":"2024-08-17T02:25:51.239655+0000","last_became_peered":"2024-08-17T02:25:51.239655+0000","last_unstale":"2024-08-17T02:26:41.887286+0000","last_undegraded":"2024-08-17T02:26:41.887286+0000","last_fullsized":"2024-08-17T02:26:41.887286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_clean_scrub_stamp":"2024-08-17T02:25:49.863184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:53.845381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073560,"statfs":{"total":96636764160,"available":96331325440,"internally_reserved":0,"allocated":942080,"data_stored":721019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":352256,"data_stored":131165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":352256,"data_stored":131221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301876,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069964,"statfs":{"total":96636764160,"available":96327643136,"internally_reserved":0,"allocated":364544,"data_stored":136953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]}]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297712,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074128,"statfs":{"total":96636764160,"available":96331907072,"internally_reserved":0,"allocated":360448,"data_stored":132135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":348160,"data_stored":130631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301868,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069972,"statfs":{"total":96636764160,"available":96327651328,"internally_reserved":0,"allocated":360448,"data_stored":132135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":937984,"data_stored":720929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:46.887 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:46.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca11c33700 1 Processor -- start 2024-08-17T02:26:46.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca11c33700 1 -- start start 2024-08-17T02:26:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca11c33700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fca0c0d0010 0x7fca0c0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca11c33700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0c0cf190 con 0x7fca0c159040 2024-08-17T02:26:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca11c33700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0c0d09a0 con 0x7fca0c15cea0 2024-08-17T02:26:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca11c33700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0c15d9f0 con 0x7fca0c0d0010 2024-08-17T02:26:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca10c31700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fca0c159040 0x7fca0c0cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48230/0 (socket says 172.21.15.102:48230) 2024-08-17T02:26:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca10c31700 1 -- 172.21.15.102:0/2153294725 learned_addr learned my addr 172.21.15.102:0/2153294725 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca0bfff700 1 --2- 172.21.15.102:0/2153294725 >> v2:172.21.15.121:3300/0 conn(0x7fca0c0d0010 0x7fca0c0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca0b7fe700 1 -- 172.21.15.102:0/2153294725 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583893510 0 0) 0x7fca0c0cf190 con 0x7fca0c159040 2024-08-17T02:26:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca0b7fe700 1 -- 172.21.15.102:0/2153294725 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9ec003570 con 0x7fca0c159040 2024-08-17T02:26:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca0bfff700 1 -- 172.21.15.102:0/2153294725 >> v1:172.21.15.121:6789/0 conn(0x7fca0c15cea0 legacy=0x7fca0c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca0bfff700 1 -- 172.21.15.102:0/2153294725 >> v1:172.21.15.102:6789/0 conn(0x7fca0c159040 legacy=0x7fca0c0cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca0bfff700 1 -- 172.21.15.102:0/2153294725 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c0ce5e0 con 0x7fca0c0d0010 2024-08-17T02:26:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca0bfff700 1 --2- 172.21.15.102:0/2153294725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca0c0d0010 0x7fca0c0d0460 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40098e0 tx=0x7fc9f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8926230e28fbf9c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca0b7fe700 1 -- 172.21.15.102:0/2153294725 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f400b640 con 0x7fca0c0d0010 2024-08-17T02:26:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca0b7fe700 1 -- 172.21.15.102:0/2153294725 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f400b7a0 con 0x7fca0c0d0010 2024-08-17T02:26:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.992+0000 7fca0b7fe700 1 -- 172.21.15.102:0/2153294725 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f400bb20 con 0x7fca0c0d0010 2024-08-17T02:26:46.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11c33700 1 -- 172.21.15.102:0/2153294725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca0c0d0010 msgr2=0x7fca0c0d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11c33700 1 --2- 172.21.15.102:0/2153294725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca0c0d0010 0x7fca0c0d0460 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40098e0 tx=0x7fc9f40091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11c33700 1 -- 172.21.15.102:0/2153294725 shutdown_connections 2024-08-17T02:26:46.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11c33700 1 --2- 172.21.15.102:0/2153294725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca0c0d0010 0x7fca0c0d0460 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11c33700 1 -- 172.21.15.102:0/2153294725 >> 172.21.15.102:0/2153294725 conn(0x7fca0c068250 msgr2=0x7fca0c068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11c33700 1 -- 172.21.15.102:0/2153294725 shutdown_connections 2024-08-17T02:26:46.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11c33700 1 -- 172.21.15.102:0/2153294725 wait complete. 2024-08-17T02:26:47.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11c33700 1 Processor -- start 2024-08-17T02:26:47.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11c33700 1 -- start start 2024-08-17T02:26:47.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11c33700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca0c0d0010 0x7fca0c1493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11c33700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca0c159040 0x7fca0c14e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11c33700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca0c15cea0 0x7fca0c15bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11c33700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c0b0790 con 0x7fca0c15cea0 2024-08-17T02:26:47.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11c33700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c0afbc0 con 0x7fca0c0d0010 2024-08-17T02:26:47.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11c33700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c149900 con 0x7fca0c159040 2024-08-17T02:26:47.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11432700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca0c15cea0 0x7fca0c15bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca0bfff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca0c159040 0x7fca0c14e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca0bfff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca0c159040 0x7fca0c14e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:54914/0 (socket says 172.21.15.102:54914) 2024-08-17T02:26:47.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca10c31700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca0c0d0010 0x7fca0c1493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca0bfff700 1 -- 172.21.15.102:0/2923899910 learned_addr learned my addr 172.21.15.102:0/2923899910 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:47.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca10c31700 1 -- 172.21.15.102:0/2923899910 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca0c159040 msgr2=0x7fca0c14e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca10c31700 1 --2- 172.21.15.102:0/2923899910 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca0c159040 0x7fca0c14e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca10c31700 1 -- 172.21.15.102:0/2923899910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca0c15cea0 msgr2=0x7fca0c15bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca10c31700 1 --2- 172.21.15.102:0/2923899910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca0c15cea0 0x7fca0c15bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca10c31700 1 -- 172.21.15.102:0/2923899910 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f4009420 con 0x7fca0c0d0010 2024-08-17T02:26:47.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca11432700 1 --2- 172.21.15.102:0/2923899910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca0c15cea0 0x7fca0c15bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:47.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca10c31700 1 --2- 172.21.15.102:0/2923899910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca0c0d0010 0x7fca0c1493c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00c560 tx=0x7fc9fc007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:46.996+0000 7fca08ff9700 1 -- 172.21.15.102:0/2923899910 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc005b30 con 0x7fca0c0d0010 2024-08-17T02:26:47.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.000+0000 7fca08ff9700 1 -- 172.21.15.102:0/2923899910 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc005cb0 con 0x7fca0c0d0010 2024-08-17T02:26:47.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.000+0000 7fca11c33700 1 -- 172.21.15.102:0/2923899910 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0c0afe60 con 0x7fca0c0d0010 2024-08-17T02:26:47.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.000+0000 7fca08ff9700 1 -- 172.21.15.102:0/2923899910 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc007320 con 0x7fca0c0d0010 2024-08-17T02:26:47.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.000+0000 7fca11c33700 1 -- 172.21.15.102:0/2923899910 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0c0b0420 con 0x7fca0c0d0010 2024-08-17T02:26:47.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.000+0000 7fca11c33700 1 -- 172.21.15.102:0/2923899910 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0c0643a0 con 0x7fca0c0d0010 2024-08-17T02:26:47.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.000+0000 7fca08ff9700 1 -- 172.21.15.102:0/2923899910 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc9fc033ad0 con 0x7fca0c0d0010 2024-08-17T02:26:47.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.000+0000 7fca08ff9700 1 --2- 172.21.15.102:0/2923899910 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc9f0060860 0x7fc9f0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.000+0000 7fca08ff9700 1 -- 172.21.15.102:0/2923899910 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9fc07bfd0 con 0x7fca0c0d0010 2024-08-17T02:26:47.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.000+0000 7fca0bfff700 1 --2- 172.21.15.102:0/2923899910 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc9f0060860 0x7fc9f0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.000+0000 7fca0bfff700 1 --2- 172.21.15.102:0/2923899910 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc9f0060860 0x7fc9f0062d10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fca0c15ce20 tx=0x7fc9f4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.008+0000 7fca08ff9700 1 -- 172.21.15.102:0/2923899910 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc9fc04c420 con 0x7fca0c0d0010 2024-08-17T02:26:47.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.168+0000 7fca11c33700 1 -- 172.21.15.102:0/2923899910 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca0c0b3480 con 0x7fc9f0060860 2024-08-17T02:26:47.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.184+0000 7fca08ff9700 1 -- 172.21.15.102:0/2923899910 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264482 (secure 0 0 0) 0x7fca0c0b3480 con 0x7fc9f0060860 2024-08-17T02:26:47.192 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:47.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.188+0000 7fca11c33700 1 -- 172.21.15.102:0/2923899910 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc9f0060860 msgr2=0x7fc9f0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.188+0000 7fca11c33700 1 --2- 172.21.15.102:0/2923899910 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc9f0060860 0x7fc9f0062d10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fca0c15ce20 tx=0x7fc9f4017000 comp rx=0 tx=0).stop 2024-08-17T02:26:47.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.188+0000 7fca11c33700 1 -- 172.21.15.102:0/2923899910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca0c0d0010 msgr2=0x7fca0c1493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.188+0000 7fca11c33700 1 --2- 172.21.15.102:0/2923899910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca0c0d0010 0x7fca0c1493c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00c560 tx=0x7fc9fc007d50 comp rx=0 tx=0).stop 2024-08-17T02:26:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.188+0000 7fca11c33700 1 -- 172.21.15.102:0/2923899910 shutdown_connections 2024-08-17T02:26:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.188+0000 7fca11c33700 1 --2- 172.21.15.102:0/2923899910 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc9f0060860 0x7fc9f0062d10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.188+0000 7fca11c33700 1 --2- 172.21.15.102:0/2923899910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca0c15cea0 0x7fca0c15bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.188+0000 7fca11c33700 1 --2- 172.21.15.102:0/2923899910 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca0c159040 0x7fca0c14e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.188+0000 7fca11c33700 1 --2- 172.21.15.102:0/2923899910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca0c0d0010 0x7fca0c1493c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.188+0000 7fca11c33700 1 -- 172.21.15.102:0/2923899910 >> 172.21.15.102:0/2923899910 conn(0x7fca0c068250 msgr2=0x7fca0c0b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.188+0000 7fca11c33700 1 -- 172.21.15.102:0/2923899910 shutdown_connections 2024-08-17T02:26:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.188+0000 7fca11c33700 1 -- 172.21.15.102:0/2923899910 wait complete. 2024-08-17T02:26:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-08-17T02:26:47.206 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-08-17T02:26:45.192410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2391112,"kb_used_data":3924,"kb_used_omap":13,"kb_used_meta":2387058,"kb_avail":752583608,"statfs":{"total":773094113280,"available":770645614592,"internally_reserved":0,"allocated":4018176,"data_stored":2236188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2444348096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.334331"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.912774+0000","last_change":"2024-08-17T02:26:42.912774+0000","last_active":"2024-08-17T02:26:42.912774+0000","last_peered":"2024-08-17T02:26:42.912774+0000","last_clean":"2024-08-17T02:26:42.912774+0000","last_became_active":"2024-08-17T02:26:42.912517+0000","last_became_peered":"2024-08-17T02:26:42.912517+0000","last_unstale":"2024-08-17T02:26:42.912774+0000","last_undegraded":"2024-08-17T02:26:42.912774+0000","last_fullsized":"2024-08-17T02:26:42.912774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:01:19.776065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.907765+0000","last_change":"2024-08-17T02:26:42.903694+0000","last_active":"2024-08-17T02:26:42.907765+0000","last_peered":"2024-08-17T02:26:42.907765+0000","last_clean":"2024-08-17T02:26:42.907765+0000","last_became_active":"2024-08-17T02:26:42.903402+0000","last_became_peered":"2024-08-17T02:26:42.903402+0000","last_unstale":"2024-08-17T02:26:42.907765+0000","last_undegraded":"2024-08-17T02:26:42.907765+0000","last_fullsized":"2024-08-17T02:26:42.907765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:43.826528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.922760+0000","last_change":"2024-08-17T02:26:42.922760+0000","last_active":"2024-08-17T02:26:42.922760+0000","last_peered":"2024-08-17T02:26:42.922760+0000","last_clean":"2024-08-17T02:26:42.922760+0000","last_became_active":"2024-08-17T02:26:42.922385+0000","last_became_peered":"2024-08-17T02:26:42.922385+0000","last_unstale":"2024-08-17T02:26:42.922760+0000","last_undegraded":"2024-08-17T02:26:42.922760+0000","last_fullsized":"2024-08-17T02:26:42.922760+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:43:26.766143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914099+0000","last_change":"2024-08-17T02:26:42.896571+0000","last_active":"2024-08-17T02:26:42.914099+0000","last_peered":"2024-08-17T02:26:42.914099+0000","last_clean":"2024-08-17T02:26:42.914099+0000","last_became_active":"2024-08-17T02:26:42.895854+0000","last_became_peered":"2024-08-17T02:26:42.895854+0000","last_unstale":"2024-08-17T02:26:42.914099+0000","last_undegraded":"2024-08-17T02:26:42.914099+0000","last_fullsized":"2024-08-17T02:26:42.914099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:45:02.791392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.908960+0000","last_change":"2024-08-17T02:26:42.906589+0000","last_active":"2024-08-17T02:26:42.908960+0000","last_peered":"2024-08-17T02:26:42.908960+0000","last_clean":"2024-08-17T02:26:42.908960+0000","last_became_active":"2024-08-17T02:26:42.906298+0000","last_became_peered":"2024-08-17T02:26:42.906298+0000","last_unstale":"2024-08-17T02:26:42.908960+0000","last_undegraded":"2024-08-17T02:26:42.908960+0000","last_fullsized":"2024-08-17T02:26:42.908960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:33:26.085908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.907923+0000","last_change":"2024-08-17T02:26:42.902756+0000","last_active":"2024-08-17T02:26:42.907923+0000","last_peered":"2024-08-17T02:26:42.907923+0000","last_clean":"2024-08-17T02:26:42.907923+0000","last_became_active":"2024-08-17T02:26:42.902107+0000","last_became_peered":"2024-08-17T02:26:42.902107+0000","last_unstale":"2024-08-17T02:26:42.907923+0000","last_undegraded":"2024-08-17T02:26:42.907923+0000","last_fullsized":"2024-08-17T02:26:42.907923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:23.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904065+0000","last_change":"2024-08-17T02:26:42.904065+0000","last_active":"2024-08-17T02:26:42.904065+0000","last_peered":"2024-08-17T02:26:42.904065+0000","last_clean":"2024-08-17T02:26:42.904065+0000","last_became_active":"2024-08-17T02:26:42.903763+0000","last_became_peered":"2024-08-17T02:26:42.903763+0000","last_unstale":"2024-08-17T02:26:42.904065+0000","last_undegraded":"2024-08-17T02:26:42.904065+0000","last_fullsized":"2024-08-17T02:26:42.904065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:43:39.020410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904427+0000","last_change":"2024-08-17T02:26:42.904427+0000","last_active":"2024-08-17T02:26:42.904427+0000","last_peered":"2024-08-17T02:26:42.904427+0000","last_clean":"2024-08-17T02:26:42.904427+0000","last_became_active":"2024-08-17T02:26:42.904145+0000","last_became_peered":"2024-08-17T02:26:42.904145+0000","last_unstale":"2024-08-17T02:26:42.904427+0000","last_undegraded":"2024-08-17T02:26:42.904427+0000","last_fullsized":"2024-08-17T02:26:42.904427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:47.517185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.902491+0000","last_change":"2024-08-17T02:26:42.899492+0000","last_active":"2024-08-17T02:26:42.902491+0000","last_peered":"2024-08-17T02:26:42.902491+0000","last_clean":"2024-08-17T02:26:42.902491+0000","last_became_active":"2024-08-17T02:26:42.899234+0000","last_became_peered":"2024-08-17T02:26:42.899234+0000","last_unstale":"2024-08-17T02:26:42.902491+0000","last_undegraded":"2024-08-17T02:26:42.902491+0000","last_fullsized":"2024-08-17T02:26:42.902491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:44:12.560936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921365+0000","last_change":"2024-08-17T02:26:42.917632+0000","last_active":"2024-08-17T02:26:42.921365+0000","last_peered":"2024-08-17T02:26:42.921365+0000","last_clean":"2024-08-17T02:26:42.921365+0000","last_became_active":"2024-08-17T02:26:42.917323+0000","last_became_peered":"2024-08-17T02:26:42.917323+0000","last_unstale":"2024-08-17T02:26:42.921365+0000","last_undegraded":"2024-08-17T02:26:42.921365+0000","last_fullsized":"2024-08-17T02:26:42.921365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:39:12.343432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.922026+0000","last_change":"2024-08-17T02:26:42.922026+0000","last_active":"2024-08-17T02:26:42.922026+0000","last_peered":"2024-08-17T02:26:42.922026+0000","last_clean":"2024-08-17T02:26:42.922026+0000","last_became_active":"2024-08-17T02:26:42.921655+0000","last_became_peered":"2024-08-17T02:26:42.921655+0000","last_unstale":"2024-08-17T02:26:42.922026+0000","last_undegraded":"2024-08-17T02:26:42.922026+0000","last_fullsized":"2024-08-17T02:26:42.922026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:22.036785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.908592+0000","last_change":"2024-08-17T02:26:42.908592+0000","last_active":"2024-08-17T02:26:42.908592+0000","last_peered":"2024-08-17T02:26:42.908592+0000","last_clean":"2024-08-17T02:26:42.908592+0000","last_became_active":"2024-08-17T02:26:42.907753+0000","last_became_peered":"2024-08-17T02:26:42.907753+0000","last_unstale":"2024-08-17T02:26:42.908592+0000","last_undegraded":"2024-08-17T02:26:42.908592+0000","last_fullsized":"2024-08-17T02:26:42.908592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:14.326686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.918245+0000","last_change":"2024-08-17T02:26:42.915982+0000","last_active":"2024-08-17T02:26:42.918245+0000","last_peered":"2024-08-17T02:26:42.918245+0000","last_clean":"2024-08-17T02:26:42.918245+0000","last_became_active":"2024-08-17T02:26:42.915740+0000","last_became_peered":"2024-08-17T02:26:42.915740+0000","last_unstale":"2024-08-17T02:26:42.918245+0000","last_undegraded":"2024-08-17T02:26:42.918245+0000","last_fullsized":"2024-08-17T02:26:42.918245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:52.513813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.907963+0000","last_change":"2024-08-17T02:26:42.903011+0000","last_active":"2024-08-17T02:26:42.907963+0000","last_peered":"2024-08-17T02:26:42.907963+0000","last_clean":"2024-08-17T02:26:42.907963+0000","last_became_active":"2024-08-17T02:26:42.902534+0000","last_became_peered":"2024-08-17T02:26:42.902534+0000","last_unstale":"2024-08-17T02:26:42.907963+0000","last_undegraded":"2024-08-17T02:26:42.907963+0000","last_fullsized":"2024-08-17T02:26:42.907963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:18.760297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.912898+0000","last_change":"2024-08-17T02:26:42.912898+0000","last_active":"2024-08-17T02:26:42.912898+0000","last_peered":"2024-08-17T02:26:42.912898+0000","last_clean":"2024-08-17T02:26:42.912898+0000","last_became_active":"2024-08-17T02:26:42.912273+0000","last_became_peered":"2024-08-17T02:26:42.912273+0000","last_unstale":"2024-08-17T02:26:42.912898+0000","last_undegraded":"2024-08-17T02:26:42.912898+0000","last_fullsized":"2024-08-17T02:26:42.912898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:44:26.694565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.906422+0000","last_change":"2024-08-17T02:26:42.906422+0000","last_active":"2024-08-17T02:26:42.906422+0000","last_peered":"2024-08-17T02:26:42.906422+0000","last_clean":"2024-08-17T02:26:42.906422+0000","last_became_active":"2024-08-17T02:26:42.906093+0000","last_became_peered":"2024-08-17T02:26:42.906093+0000","last_unstale":"2024-08-17T02:26:42.906422+0000","last_undegraded":"2024-08-17T02:26:42.906422+0000","last_fullsized":"2024-08-17T02:26:42.906422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:22.157799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904644+0000","last_change":"2024-08-17T02:26:42.904644+0000","last_active":"2024-08-17T02:26:42.904644+0000","last_peered":"2024-08-17T02:26:42.904644+0000","last_clean":"2024-08-17T02:26:42.904644+0000","last_became_active":"2024-08-17T02:26:42.903632+0000","last_became_peered":"2024-08-17T02:26:42.903632+0000","last_unstale":"2024-08-17T02:26:42.904644+0000","last_undegraded":"2024-08-17T02:26:42.904644+0000","last_fullsized":"2024-08-17T02:26:42.904644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:19.192691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921175+0000","last_change":"2024-08-17T02:26:42.917741+0000","last_active":"2024-08-17T02:26:42.921175+0000","last_peered":"2024-08-17T02:26:42.921175+0000","last_clean":"2024-08-17T02:26:42.921175+0000","last_became_active":"2024-08-17T02:26:42.917438+0000","last_became_peered":"2024-08-17T02:26:42.917438+0000","last_unstale":"2024-08-17T02:26:42.921175+0000","last_undegraded":"2024-08-17T02:26:42.921175+0000","last_fullsized":"2024-08-17T02:26:42.921175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:05.402861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904503+0000","last_change":"2024-08-17T02:26:42.895649+0000","last_active":"2024-08-17T02:26:42.904503+0000","last_peered":"2024-08-17T02:26:42.904503+0000","last_clean":"2024-08-17T02:26:42.904503+0000","last_became_active":"2024-08-17T02:26:42.895328+0000","last_became_peered":"2024-08-17T02:26:42.895328+0000","last_unstale":"2024-08-17T02:26:42.904503+0000","last_undegraded":"2024-08-17T02:26:42.904503+0000","last_fullsized":"2024-08-17T02:26:42.904503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:37:57.415755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.910604+0000","last_change":"2024-08-17T02:26:42.908333+0000","last_active":"2024-08-17T02:26:42.910604+0000","last_peered":"2024-08-17T02:26:42.910604+0000","last_clean":"2024-08-17T02:26:42.910604+0000","last_became_active":"2024-08-17T02:26:42.908074+0000","last_became_peered":"2024-08-17T02:26:42.908074+0000","last_unstale":"2024-08-17T02:26:42.910604+0000","last_undegraded":"2024-08-17T02:26:42.910604+0000","last_fullsized":"2024-08-17T02:26:42.910604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:28:20.184280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914532+0000","last_change":"2024-08-17T02:26:42.905166+0000","last_active":"2024-08-17T02:26:42.914532+0000","last_peered":"2024-08-17T02:26:42.914532+0000","last_clean":"2024-08-17T02:26:42.914532+0000","last_became_active":"2024-08-17T02:26:42.904635+0000","last_became_peered":"2024-08-17T02:26:42.904635+0000","last_unstale":"2024-08-17T02:26:42.914532+0000","last_undegraded":"2024-08-17T02:26:42.914532+0000","last_fullsized":"2024-08-17T02:26:42.914532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:49.204164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914404+0000","last_change":"2024-08-17T02:26:42.905005+0000","last_active":"2024-08-17T02:26:42.914404+0000","last_peered":"2024-08-17T02:26:42.914404+0000","last_clean":"2024-08-17T02:26:42.914404+0000","last_became_active":"2024-08-17T02:26:42.904342+0000","last_became_peered":"2024-08-17T02:26:42.904342+0000","last_unstale":"2024-08-17T02:26:42.914404+0000","last_undegraded":"2024-08-17T02:26:42.914404+0000","last_fullsized":"2024-08-17T02:26:42.914404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:54.999191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904494+0000","last_change":"2024-08-17T02:26:42.904494+0000","last_active":"2024-08-17T02:26:42.904494+0000","last_peered":"2024-08-17T02:26:42.904494+0000","last_clean":"2024-08-17T02:26:42.904494+0000","last_became_active":"2024-08-17T02:26:42.904157+0000","last_became_peered":"2024-08-17T02:26:42.904157+0000","last_unstale":"2024-08-17T02:26:42.904494+0000","last_undegraded":"2024-08-17T02:26:42.904494+0000","last_fullsized":"2024-08-17T02:26:42.904494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:55.687560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.908291+0000","last_change":"2024-08-17T02:26:42.908291+0000","last_active":"2024-08-17T02:26:42.908291+0000","last_peered":"2024-08-17T02:26:42.908291+0000","last_clean":"2024-08-17T02:26:42.908291+0000","last_became_active":"2024-08-17T02:26:42.907912+0000","last_became_peered":"2024-08-17T02:26:42.907912+0000","last_unstale":"2024-08-17T02:26:42.908291+0000","last_undegraded":"2024-08-17T02:26:42.908291+0000","last_fullsized":"2024-08-17T02:26:42.908291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:58.118037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.918965+0000","last_change":"2024-08-17T02:26:42.914810+0000","last_active":"2024-08-17T02:26:42.918965+0000","last_peered":"2024-08-17T02:26:42.918965+0000","last_clean":"2024-08-17T02:26:42.918965+0000","last_became_active":"2024-08-17T02:26:42.914535+0000","last_became_peered":"2024-08-17T02:26:42.914535+0000","last_unstale":"2024-08-17T02:26:42.918965+0000","last_undegraded":"2024-08-17T02:26:42.918965+0000","last_fullsized":"2024-08-17T02:26:42.918965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:55:55.555712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.907786+0000","last_change":"2024-08-17T02:26:42.903734+0000","last_active":"2024-08-17T02:26:42.907786+0000","last_peered":"2024-08-17T02:26:42.907786+0000","last_clean":"2024-08-17T02:26:42.907786+0000","last_became_active":"2024-08-17T02:26:42.903473+0000","last_became_peered":"2024-08-17T02:26:42.903473+0000","last_unstale":"2024-08-17T02:26:42.907786+0000","last_undegraded":"2024-08-17T02:26:42.907786+0000","last_fullsized":"2024-08-17T02:26:42.907786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:26:49.635760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.916024+0000","last_change":"2024-08-17T02:26:42.896195+0000","last_active":"2024-08-17T02:26:42.916024+0000","last_peered":"2024-08-17T02:26:42.916024+0000","last_clean":"2024-08-17T02:26:42.916024+0000","last_became_active":"2024-08-17T02:26:42.895901+0000","last_became_peered":"2024-08-17T02:26:42.895901+0000","last_unstale":"2024-08-17T02:26:42.916024+0000","last_undegraded":"2024-08-17T02:26:42.916024+0000","last_fullsized":"2024-08-17T02:26:42.916024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:17:22.323550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.908756+0000","last_change":"2024-08-17T02:26:42.908756+0000","last_active":"2024-08-17T02:26:42.908756+0000","last_peered":"2024-08-17T02:26:42.908756+0000","last_clean":"2024-08-17T02:26:42.908756+0000","last_became_active":"2024-08-17T02:26:42.908343+0000","last_became_peered":"2024-08-17T02:26:42.908343+0000","last_unstale":"2024-08-17T02:26:42.908756+0000","last_undegraded":"2024-08-17T02:26:42.908756+0000","last_fullsized":"2024-08-17T02:26:42.908756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:33:23.558376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914552+0000","last_change":"2024-08-17T02:26:42.905401+0000","last_active":"2024-08-17T02:26:42.914552+0000","last_peered":"2024-08-17T02:26:42.914552+0000","last_clean":"2024-08-17T02:26:42.914552+0000","last_became_active":"2024-08-17T02:26:42.905020+0000","last_became_peered":"2024-08-17T02:26:42.905020+0000","last_unstale":"2024-08-17T02:26:42.914552+0000","last_undegraded":"2024-08-17T02:26:42.914552+0000","last_fullsized":"2024-08-17T02:26:42.914552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:55:41.955127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904664+0000","last_change":"2024-08-17T02:26:42.904664+0000","last_active":"2024-08-17T02:26:42.904664+0000","last_peered":"2024-08-17T02:26:42.904664+0000","last_clean":"2024-08-17T02:26:42.904664+0000","last_became_active":"2024-08-17T02:26:42.903822+0000","last_became_peered":"2024-08-17T02:26:42.903822+0000","last_unstale":"2024-08-17T02:26:42.904664+0000","last_undegraded":"2024-08-17T02:26:42.904664+0000","last_fullsized":"2024-08-17T02:26:42.904664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:50:17.148297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.903540+0000","last_change":"2024-08-17T02:26:42.903540+0000","last_active":"2024-08-17T02:26:42.903540+0000","last_peered":"2024-08-17T02:26:42.903540+0000","last_clean":"2024-08-17T02:26:42.903540+0000","last_became_active":"2024-08-17T02:26:42.903101+0000","last_became_peered":"2024-08-17T02:26:42.903101+0000","last_unstale":"2024-08-17T02:26:42.903540+0000","last_undegraded":"2024-08-17T02:26:42.903540+0000","last_fullsized":"2024-08-17T02:26:42.903540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:59.914776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.905059+0000","last_change":"2024-08-17T02:26:42.905059+0000","last_active":"2024-08-17T02:26:42.905059+0000","last_peered":"2024-08-17T02:26:42.905059+0000","last_clean":"2024-08-17T02:26:42.905059+0000","last_became_active":"2024-08-17T02:26:42.903379+0000","last_became_peered":"2024-08-17T02:26:42.903379+0000","last_unstale":"2024-08-17T02:26:42.905059+0000","last_undegraded":"2024-08-17T02:26:42.905059+0000","last_fullsized":"2024-08-17T02:26:42.905059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:23.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.912381+0000","last_change":"2024-08-17T02:26:42.912381+0000","last_active":"2024-08-17T02:26:42.912381+0000","last_peered":"2024-08-17T02:26:42.912381+0000","last_clean":"2024-08-17T02:26:42.912381+0000","last_became_active":"2024-08-17T02:26:42.911588+0000","last_became_peered":"2024-08-17T02:26:42.911588+0000","last_unstale":"2024-08-17T02:26:42.912381+0000","last_undegraded":"2024-08-17T02:26:42.912381+0000","last_fullsized":"2024-08-17T02:26:42.912381+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:20:35.623529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921401+0000","last_change":"2024-08-17T02:26:41.883823+0000","last_active":"2024-08-17T02:26:42.921401+0000","last_peered":"2024-08-17T02:26:42.921401+0000","last_clean":"2024-08-17T02:26:42.921401+0000","last_became_active":"2024-08-17T02:26:41.883251+0000","last_became_peered":"2024-08-17T02:26:41.883251+0000","last_unstale":"2024-08-17T02:26:42.921401+0000","last_undegraded":"2024-08-17T02:26:42.921401+0000","last_fullsized":"2024-08-17T02:26:42.921401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:51.510920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.903131+0000","last_change":"2024-08-17T02:26:42.903131+0000","last_active":"2024-08-17T02:26:42.903131+0000","last_peered":"2024-08-17T02:26:42.903131+0000","last_clean":"2024-08-17T02:26:42.903131+0000","last_became_active":"2024-08-17T02:26:42.902730+0000","last_became_peered":"2024-08-17T02:26:42.902730+0000","last_unstale":"2024-08-17T02:26:42.903131+0000","last_undegraded":"2024-08-17T02:26:42.903131+0000","last_fullsized":"2024-08-17T02:26:42.903131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:49.369237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.899468+0000","last_change":"2024-08-17T02:26:41.887356+0000","last_active":"2024-08-17T02:26:42.899468+0000","last_peered":"2024-08-17T02:26:42.899468+0000","last_clean":"2024-08-17T02:26:42.899468+0000","last_became_active":"2024-08-17T02:26:41.887032+0000","last_became_peered":"2024-08-17T02:26:41.887032+0000","last_unstale":"2024-08-17T02:26:42.899468+0000","last_undegraded":"2024-08-17T02:26:42.899468+0000","last_fullsized":"2024-08-17T02:26:42.899468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:48:55.285578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914298+0000","last_change":"2024-08-17T02:26:42.904879+0000","last_active":"2024-08-17T02:26:42.914298+0000","last_peered":"2024-08-17T02:26:42.914298+0000","last_clean":"2024-08-17T02:26:42.914298+0000","last_became_active":"2024-08-17T02:26:42.904591+0000","last_became_peered":"2024-08-17T02:26:42.904591+0000","last_unstale":"2024-08-17T02:26:42.914298+0000","last_undegraded":"2024-08-17T02:26:42.914298+0000","last_fullsized":"2024-08-17T02:26:42.914298+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:13.175988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.924046+0000","last_change":"2024-08-17T02:26:41.878768+0000","last_active":"2024-08-17T02:26:42.924046+0000","last_peered":"2024-08-17T02:26:42.924046+0000","last_clean":"2024-08-17T02:26:42.924046+0000","last_became_active":"2024-08-17T02:26:41.878411+0000","last_became_peered":"2024-08-17T02:26:41.878411+0000","last_unstale":"2024-08-17T02:26:42.924046+0000","last_undegraded":"2024-08-17T02:26:42.924046+0000","last_fullsized":"2024-08-17T02:26:42.924046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:01:18.773172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.916001+0000","last_change":"2024-08-17T02:26:42.895464+0000","last_active":"2024-08-17T02:26:42.916001+0000","last_peered":"2024-08-17T02:26:42.916001+0000","last_clean":"2024-08-17T02:26:42.916001+0000","last_became_active":"2024-08-17T02:26:42.894964+0000","last_became_peered":"2024-08-17T02:26:42.894964+0000","last_unstale":"2024-08-17T02:26:42.916001+0000","last_undegraded":"2024-08-17T02:26:42.916001+0000","last_fullsized":"2024-08-17T02:26:42.916001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:54.999191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.919533+0000","last_change":"2024-08-17T02:26:41.875625+0000","last_active":"2024-08-17T02:26:42.919533+0000","last_peered":"2024-08-17T02:26:42.919533+0000","last_clean":"2024-08-17T02:26:42.919533+0000","last_became_active":"2024-08-17T02:26:41.875358+0000","last_became_peered":"2024-08-17T02:26:41.875358+0000","last_unstale":"2024-08-17T02:26:42.919533+0000","last_undegraded":"2024-08-17T02:26:42.919533+0000","last_fullsized":"2024-08-17T02:26:42.919533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:36.726951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.905114+0000","last_change":"2024-08-17T02:26:42.905114+0000","last_active":"2024-08-17T02:26:42.905114+0000","last_peered":"2024-08-17T02:26:42.905114+0000","last_clean":"2024-08-17T02:26:42.905114+0000","last_became_active":"2024-08-17T02:26:42.904839+0000","last_became_peered":"2024-08-17T02:26:42.904839+0000","last_unstale":"2024-08-17T02:26:42.905114+0000","last_undegraded":"2024-08-17T02:26:42.905114+0000","last_fullsized":"2024-08-17T02:26:42.905114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:30:51.965463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921007+0000","last_change":"2024-08-17T02:26:41.885244+0000","last_active":"2024-08-17T02:26:42.921007+0000","last_peered":"2024-08-17T02:26:42.921007+0000","last_clean":"2024-08-17T02:26:42.921007+0000","last_became_active":"2024-08-17T02:26:41.884437+0000","last_became_peered":"2024-08-17T02:26:41.884437+0000","last_unstale":"2024-08-17T02:26:42.921007+0000","last_undegraded":"2024-08-17T02:26:42.921007+0000","last_fullsized":"2024-08-17T02:26:42.921007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:53:52.109330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.902921+0000","last_change":"2024-08-17T02:26:42.902921+0000","last_active":"2024-08-17T02:26:42.902921+0000","last_peered":"2024-08-17T02:26:42.902921+0000","last_clean":"2024-08-17T02:26:42.902921+0000","last_became_active":"2024-08-17T02:26:42.902622+0000","last_became_peered":"2024-08-17T02:26:42.902622+0000","last_unstale":"2024-08-17T02:26:42.902921+0000","last_undegraded":"2024-08-17T02:26:42.902921+0000","last_fullsized":"2024-08-17T02:26:42.902921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:09.377231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921003+0000","last_change":"2024-08-17T02:26:41.885371+0000","last_active":"2024-08-17T02:26:42.921003+0000","last_peered":"2024-08-17T02:26:42.921003+0000","last_clean":"2024-08-17T02:26:42.921003+0000","last_became_active":"2024-08-17T02:26:41.884544+0000","last_became_peered":"2024-08-17T02:26:41.884544+0000","last_unstale":"2024-08-17T02:26:42.921003+0000","last_undegraded":"2024-08-17T02:26:42.921003+0000","last_fullsized":"2024-08-17T02:26:42.921003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:26:46.143935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.910759+0000","last_change":"2024-08-17T02:26:42.901170+0000","last_active":"2024-08-17T02:26:42.910759+0000","last_peered":"2024-08-17T02:26:42.910759+0000","last_clean":"2024-08-17T02:26:42.910759+0000","last_became_active":"2024-08-17T02:26:42.900878+0000","last_became_peered":"2024-08-17T02:26:42.900878+0000","last_unstale":"2024-08-17T02:26:42.910759+0000","last_undegraded":"2024-08-17T02:26:42.910759+0000","last_fullsized":"2024-08-17T02:26:42.910759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:07.505884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.893484+0000","last_change":"2024-08-17T02:26:41.882796+0000","last_active":"2024-08-17T02:26:42.893484+0000","last_peered":"2024-08-17T02:26:42.893484+0000","last_clean":"2024-08-17T02:26:42.893484+0000","last_became_active":"2024-08-17T02:26:41.882439+0000","last_became_peered":"2024-08-17T02:26:41.882439+0000","last_unstale":"2024-08-17T02:26:42.893484+0000","last_undegraded":"2024-08-17T02:26:42.893484+0000","last_fullsized":"2024-08-17T02:26:42.893484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:47:07.290965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921283+0000","last_change":"2024-08-17T02:26:42.916617+0000","last_active":"2024-08-17T02:26:42.921283+0000","last_peered":"2024-08-17T02:26:42.921283+0000","last_clean":"2024-08-17T02:26:42.921283+0000","last_became_active":"2024-08-17T02:26:42.916280+0000","last_became_peered":"2024-08-17T02:26:42.916280+0000","last_unstale":"2024-08-17T02:26:42.921283+0000","last_undegraded":"2024-08-17T02:26:42.921283+0000","last_fullsized":"2024-08-17T02:26:42.921283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:09.377231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.890331+0000","last_change":"2024-08-17T02:26:41.878706+0000","last_active":"2024-08-17T02:26:42.890331+0000","last_peered":"2024-08-17T02:26:42.890331+0000","last_clean":"2024-08-17T02:26:42.890331+0000","last_became_active":"2024-08-17T02:26:41.878353+0000","last_became_peered":"2024-08-17T02:26:41.878353+0000","last_unstale":"2024-08-17T02:26:42.890331+0000","last_undegraded":"2024-08-17T02:26:42.890331+0000","last_fullsized":"2024-08-17T02:26:42.890331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:45:47.128790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.907957+0000","last_change":"2024-08-17T02:26:42.907957+0000","last_active":"2024-08-17T02:26:42.907957+0000","last_peered":"2024-08-17T02:26:42.907957+0000","last_clean":"2024-08-17T02:26:42.907957+0000","last_became_active":"2024-08-17T02:26:42.907352+0000","last_became_peered":"2024-08-17T02:26:42.907352+0000","last_unstale":"2024-08-17T02:26:42.907957+0000","last_undegraded":"2024-08-17T02:26:42.907957+0000","last_fullsized":"2024-08-17T02:26:42.907957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:58.812100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.896073+0000","last_change":"2024-08-17T02:26:41.887971+0000","last_active":"2024-08-17T02:26:42.896073+0000","last_peered":"2024-08-17T02:26:42.896073+0000","last_clean":"2024-08-17T02:26:42.896073+0000","last_became_active":"2024-08-17T02:26:41.887512+0000","last_became_peered":"2024-08-17T02:26:41.887512+0000","last_unstale":"2024-08-17T02:26:42.896073+0000","last_undegraded":"2024-08-17T02:26:42.896073+0000","last_fullsized":"2024-08-17T02:26:42.896073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:48.366344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.907468+0000","last_change":"2024-08-17T02:26:42.902576+0000","last_active":"2024-08-17T02:26:42.907468+0000","last_peered":"2024-08-17T02:26:42.907468+0000","last_clean":"2024-08-17T02:26:42.907468+0000","last_became_active":"2024-08-17T02:26:42.902193+0000","last_became_peered":"2024-08-17T02:26:42.902193+0000","last_unstale":"2024-08-17T02:26:42.907468+0000","last_undegraded":"2024-08-17T02:26:42.907468+0000","last_fullsized":"2024-08-17T02:26:42.907468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:22.157799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:41.880564+0000","last_change":"2024-08-17T02:26:41.877480+0000","last_active":"2024-08-17T02:26:41.880564+0000","last_peered":"2024-08-17T02:26:41.880564+0000","last_clean":"2024-08-17T02:26:41.880564+0000","last_became_active":"2024-08-17T02:26:41.877193+0000","last_became_peered":"2024-08-17T02:26:41.877193+0000","last_unstale":"2024-08-17T02:26:41.880564+0000","last_undegraded":"2024-08-17T02:26:41.880564+0000","last_fullsized":"2024-08-17T02:26:41.880564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:33:25.083015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.907484+0000","last_change":"2024-08-17T02:26:42.902556+0000","last_active":"2024-08-17T02:26:42.907484+0000","last_peered":"2024-08-17T02:26:42.907484+0000","last_clean":"2024-08-17T02:26:42.907484+0000","last_became_active":"2024-08-17T02:26:42.902040+0000","last_became_peered":"2024-08-17T02:26:42.902040+0000","last_unstale":"2024-08-17T02:26:42.907484+0000","last_undegraded":"2024-08-17T02:26:42.907484+0000","last_fullsized":"2024-08-17T02:26:42.907484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:47.517185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921345+0000","last_change":"2024-08-17T02:26:41.889812+0000","last_active":"2024-08-17T02:26:42.921345+0000","last_peered":"2024-08-17T02:26:42.921345+0000","last_clean":"2024-08-17T02:26:42.921345+0000","last_became_active":"2024-08-17T02:26:41.889528+0000","last_became_peered":"2024-08-17T02:26:41.889528+0000","last_unstale":"2024-08-17T02:26:42.921345+0000","last_undegraded":"2024-08-17T02:26:42.921345+0000","last_fullsized":"2024-08-17T02:26:42.921345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:41:16.939562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.922813+0000","last_change":"2024-08-17T02:26:42.922813+0000","last_active":"2024-08-17T02:26:42.922813+0000","last_peered":"2024-08-17T02:26:42.922813+0000","last_clean":"2024-08-17T02:26:42.922813+0000","last_became_active":"2024-08-17T02:26:42.922472+0000","last_became_peered":"2024-08-17T02:26:42.922472+0000","last_unstale":"2024-08-17T02:26:42.922813+0000","last_undegraded":"2024-08-17T02:26:42.922813+0000","last_fullsized":"2024-08-17T02:26:42.922813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:58:18.622105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.925505+0000","last_change":"2024-08-17T02:26:41.881833+0000","last_active":"2024-08-17T02:26:42.925505+0000","last_peered":"2024-08-17T02:26:42.925505+0000","last_clean":"2024-08-17T02:26:42.925505+0000","last_became_active":"2024-08-17T02:26:41.878601+0000","last_became_peered":"2024-08-17T02:26:41.878601+0000","last_unstale":"2024-08-17T02:26:42.925505+0000","last_undegraded":"2024-08-17T02:26:42.925505+0000","last_fullsized":"2024-08-17T02:26:42.925505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:58.911882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921241+0000","last_change":"2024-08-17T02:26:42.916870+0000","last_active":"2024-08-17T02:26:42.921241+0000","last_peered":"2024-08-17T02:26:42.921241+0000","last_clean":"2024-08-17T02:26:42.921241+0000","last_became_active":"2024-08-17T02:26:42.916180+0000","last_became_peered":"2024-08-17T02:26:42.916180+0000","last_unstale":"2024-08-17T02:26:42.921241+0000","last_undegraded":"2024-08-17T02:26:42.921241+0000","last_fullsized":"2024-08-17T02:26:42.921241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:44:26.694565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.920957+0000","last_change":"2024-08-17T02:26:41.878696+0000","last_active":"2024-08-17T02:26:42.920957+0000","last_peered":"2024-08-17T02:26:42.920957+0000","last_clean":"2024-08-17T02:26:42.920957+0000","last_became_active":"2024-08-17T02:26:41.878379+0000","last_became_peered":"2024-08-17T02:26:41.878379+0000","last_unstale":"2024-08-17T02:26:42.920957+0000","last_undegraded":"2024-08-17T02:26:42.920957+0000","last_fullsized":"2024-08-17T02:26:42.920957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:25:40.921714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.907990+0000","last_change":"2024-08-17T02:26:42.902693+0000","last_active":"2024-08-17T02:26:42.907990+0000","last_peered":"2024-08-17T02:26:42.907990+0000","last_clean":"2024-08-17T02:26:42.907990+0000","last_became_active":"2024-08-17T02:26:42.901198+0000","last_became_peered":"2024-08-17T02:26:42.901198+0000","last_unstale":"2024-08-17T02:26:42.907990+0000","last_undegraded":"2024-08-17T02:26:42.907990+0000","last_fullsized":"2024-08-17T02:26:42.907990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:21.932351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.887953+0000","last_change":"2024-08-17T02:26:41.878680+0000","last_active":"2024-08-17T02:26:42.887953+0000","last_peered":"2024-08-17T02:26:42.887953+0000","last_clean":"2024-08-17T02:26:42.887953+0000","last_became_active":"2024-08-17T02:26:41.878404+0000","last_became_peered":"2024-08-17T02:26:41.878404+0000","last_unstale":"2024-08-17T02:26:42.887953+0000","last_undegraded":"2024-08-17T02:26:42.887953+0000","last_fullsized":"2024-08-17T02:26:42.887953+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:57.595861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.903628+0000","last_change":"2024-08-17T02:26:42.903628+0000","last_active":"2024-08-17T02:26:42.903628+0000","last_peered":"2024-08-17T02:26:42.903628+0000","last_clean":"2024-08-17T02:26:42.903628+0000","last_became_active":"2024-08-17T02:26:42.902944+0000","last_became_peered":"2024-08-17T02:26:42.902944+0000","last_unstale":"2024-08-17T02:26:42.903628+0000","last_undegraded":"2024-08-17T02:26:42.903628+0000","last_fullsized":"2024-08-17T02:26:42.903628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:05.402861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.887435+0000","last_change":"2024-08-17T02:26:41.885063+0000","last_active":"2024-08-17T02:26:42.887435+0000","last_peered":"2024-08-17T02:26:42.887435+0000","last_clean":"2024-08-17T02:26:42.887435+0000","last_became_active":"2024-08-17T02:26:41.884590+0000","last_became_peered":"2024-08-17T02:26:41.884590+0000","last_unstale":"2024-08-17T02:26:42.887435+0000","last_undegraded":"2024-08-17T02:26:42.887435+0000","last_fullsized":"2024-08-17T02:26:42.887435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:17:30.109039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.903383+0000","last_change":"2024-08-17T02:26:42.903383+0000","last_active":"2024-08-17T02:26:42.903383+0000","last_peered":"2024-08-17T02:26:42.903383+0000","last_clean":"2024-08-17T02:26:42.903383+0000","last_became_active":"2024-08-17T02:26:42.902756+0000","last_became_peered":"2024-08-17T02:26:42.902756+0000","last_unstale":"2024-08-17T02:26:42.903383+0000","last_undegraded":"2024-08-17T02:26:42.903383+0000","last_fullsized":"2024-08-17T02:26:42.903383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:17:31.111932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.923406+0000","last_change":"2024-08-17T02:26:41.879446+0000","last_active":"2024-08-17T02:26:42.923406+0000","last_peered":"2024-08-17T02:26:42.923406+0000","last_clean":"2024-08-17T02:26:42.923406+0000","last_became_active":"2024-08-17T02:26:41.878601+0000","last_became_peered":"2024-08-17T02:26:41.878601+0000","last_unstale":"2024-08-17T02:26:42.923406+0000","last_undegraded":"2024-08-17T02:26:42.923406+0000","last_fullsized":"2024-08-17T02:26:42.923406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:09.058484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921187+0000","last_change":"2024-08-17T02:26:42.913449+0000","last_active":"2024-08-17T02:26:42.921187+0000","last_peered":"2024-08-17T02:26:42.921187+0000","last_clean":"2024-08-17T02:26:42.921187+0000","last_became_active":"2024-08-17T02:26:42.913038+0000","last_became_peered":"2024-08-17T02:26:42.913038+0000","last_unstale":"2024-08-17T02:26:42.921187+0000","last_undegraded":"2024-08-17T02:26:42.921187+0000","last_fullsized":"2024-08-17T02:26:42.921187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:14.960789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.923050+0000","last_change":"2024-08-17T02:26:41.884565+0000","last_active":"2024-08-17T02:26:42.923050+0000","last_peered":"2024-08-17T02:26:42.923050+0000","last_clean":"2024-08-17T02:26:42.923050+0000","last_became_active":"2024-08-17T02:26:41.884274+0000","last_became_peered":"2024-08-17T02:26:41.884274+0000","last_unstale":"2024-08-17T02:26:42.923050+0000","last_undegraded":"2024-08-17T02:26:42.923050+0000","last_fullsized":"2024-08-17T02:26:42.923050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:19:55.911978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914882+0000","last_change":"2024-08-17T02:26:42.914882+0000","last_active":"2024-08-17T02:26:42.914882+0000","last_peered":"2024-08-17T02:26:42.914882+0000","last_clean":"2024-08-17T02:26:42.914882+0000","last_became_active":"2024-08-17T02:26:42.914635+0000","last_became_peered":"2024-08-17T02:26:42.914635+0000","last_unstale":"2024-08-17T02:26:42.914882+0000","last_undegraded":"2024-08-17T02:26:42.914882+0000","last_fullsized":"2024-08-17T02:26:42.914882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:09:07.035098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.921129+0000","last_change":"2024-08-17T02:26:41.880827+0000","last_active":"2024-08-17T02:26:42.921129+0000","last_peered":"2024-08-17T02:26:42.921129+0000","last_clean":"2024-08-17T02:26:42.921129+0000","last_became_active":"2024-08-17T02:26:41.880552+0000","last_became_peered":"2024-08-17T02:26:41.880552+0000","last_unstale":"2024-08-17T02:26:42.921129+0000","last_undegraded":"2024-08-17T02:26:42.921129+0000","last_fullsized":"2024-08-17T02:26:42.921129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:30.285004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914122+0000","last_change":"2024-08-17T02:26:42.896769+0000","last_active":"2024-08-17T02:26:42.914122+0000","last_peered":"2024-08-17T02:26:42.914122+0000","last_clean":"2024-08-17T02:26:42.914122+0000","last_became_active":"2024-08-17T02:26:42.896287+0000","last_became_peered":"2024-08-17T02:26:42.896287+0000","last_unstale":"2024-08-17T02:26:42.914122+0000","last_undegraded":"2024-08-17T02:26:42.914122+0000","last_fullsized":"2024-08-17T02:26:42.914122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:15:58.118037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.920929+0000","last_change":"2024-08-17T02:26:41.877534+0000","last_active":"2024-08-17T02:26:42.920929+0000","last_peered":"2024-08-17T02:26:42.920929+0000","last_clean":"2024-08-17T02:26:42.920929+0000","last_became_active":"2024-08-17T02:26:41.877250+0000","last_became_peered":"2024-08-17T02:26:41.877250+0000","last_unstale":"2024-08-17T02:26:42.920929+0000","last_undegraded":"2024-08-17T02:26:42.920929+0000","last_fullsized":"2024-08-17T02:26:42.920929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:26:04.753309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914313+0000","last_change":"2024-08-17T02:26:42.912131+0000","last_active":"2024-08-17T02:26:42.914313+0000","last_peered":"2024-08-17T02:26:42.914313+0000","last_clean":"2024-08-17T02:26:42.914313+0000","last_became_active":"2024-08-17T02:26:42.911821+0000","last_became_peered":"2024-08-17T02:26:42.911821+0000","last_unstale":"2024-08-17T02:26:42.914313+0000","last_undegraded":"2024-08-17T02:26:42.914313+0000","last_fullsized":"2024-08-17T02:26:42.914313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:07.212415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.889669+0000","last_change":"2024-08-17T02:26:41.884913+0000","last_active":"2024-08-17T02:26:42.889669+0000","last_peered":"2024-08-17T02:26:42.889669+0000","last_clean":"2024-08-17T02:26:42.889669+0000","last_became_active":"2024-08-17T02:26:41.884717+0000","last_became_peered":"2024-08-17T02:26:41.884717+0000","last_unstale":"2024-08-17T02:26:42.889669+0000","last_undegraded":"2024-08-17T02:26:42.889669+0000","last_fullsized":"2024-08-17T02:26:42.889669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:49:12.847432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914451+0000","last_change":"2024-08-17T02:26:42.912595+0000","last_active":"2024-08-17T02:26:42.914451+0000","last_peered":"2024-08-17T02:26:42.914451+0000","last_clean":"2024-08-17T02:26:42.914451+0000","last_became_active":"2024-08-17T02:26:42.912167+0000","last_became_peered":"2024-08-17T02:26:42.912167+0000","last_unstale":"2024-08-17T02:26:42.914451+0000","last_undegraded":"2024-08-17T02:26:42.914451+0000","last_fullsized":"2024-08-17T02:26:42.914451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:46:07.035843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.919117+0000","last_change":"2024-08-17T02:26:41.877347+0000","last_active":"2024-08-17T02:26:42.919117+0000","last_peered":"2024-08-17T02:26:42.919117+0000","last_clean":"2024-08-17T02:26:42.919117+0000","last_became_active":"2024-08-17T02:26:41.877073+0000","last_became_peered":"2024-08-17T02:26:41.877073+0000","last_unstale":"2024-08-17T02:26:42.919117+0000","last_undegraded":"2024-08-17T02:26:42.919117+0000","last_fullsized":"2024-08-17T02:26:42.919117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:42:18.050608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.908443+0000","last_change":"2024-08-17T02:26:42.905372+0000","last_active":"2024-08-17T02:26:42.908443+0000","last_peered":"2024-08-17T02:26:42.908443+0000","last_clean":"2024-08-17T02:26:42.908443+0000","last_became_active":"2024-08-17T02:26:42.905075+0000","last_became_peered":"2024-08-17T02:26:42.905075+0000","last_unstale":"2024-08-17T02:26:42.908443+0000","last_undegraded":"2024-08-17T02:26:42.908443+0000","last_fullsized":"2024-08-17T02:26:42.908443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:49.840135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:41.889274+0000","last_change":"2024-08-17T02:26:41.884001+0000","last_active":"2024-08-17T02:26:41.889274+0000","last_peered":"2024-08-17T02:26:41.889274+0000","last_clean":"2024-08-17T02:26:41.889274+0000","last_became_active":"2024-08-17T02:26:41.882276+0000","last_became_peered":"2024-08-17T02:26:41.882276+0000","last_unstale":"2024-08-17T02:26:41.889274+0000","last_undegraded":"2024-08-17T02:26:41.889274+0000","last_fullsized":"2024-08-17T02:26:41.889274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:33:25.083015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.908995+0000","last_change":"2024-08-17T02:26:42.905492+0000","last_active":"2024-08-17T02:26:42.908995+0000","last_peered":"2024-08-17T02:26:42.908995+0000","last_clean":"2024-08-17T02:26:42.908995+0000","last_became_active":"2024-08-17T02:26:42.905187+0000","last_became_peered":"2024-08-17T02:26:42.905187+0000","last_unstale":"2024-08-17T02:26:42.908995+0000","last_undegraded":"2024-08-17T02:26:42.908995+0000","last_fullsized":"2024-08-17T02:26:42.908995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:21:22.234731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.888038+0000","last_change":"2024-08-17T02:26:41.874962+0000","last_active":"2024-08-17T02:26:42.888038+0000","last_peered":"2024-08-17T02:26:42.888038+0000","last_clean":"2024-08-17T02:26:42.888038+0000","last_became_active":"2024-08-17T02:26:41.874358+0000","last_became_peered":"2024-08-17T02:26:41.874358+0000","last_unstale":"2024-08-17T02:26:42.888038+0000","last_undegraded":"2024-08-17T02:26:42.888038+0000","last_fullsized":"2024-08-17T02:26:42.888038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:05:49.073134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.905252+0000","last_change":"2024-08-17T02:26:42.905252+0000","last_active":"2024-08-17T02:26:42.905252+0000","last_peered":"2024-08-17T02:26:42.905252+0000","last_clean":"2024-08-17T02:26:42.905252+0000","last_became_active":"2024-08-17T02:26:42.904353+0000","last_became_peered":"2024-08-17T02:26:42.904353+0000","last_unstale":"2024-08-17T02:26:42.905252+0000","last_undegraded":"2024-08-17T02:26:42.905252+0000","last_fullsized":"2024-08-17T02:26:42.905252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:21.932351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:41.891485+0000","last_change":"2024-08-17T02:26:41.888677+0000","last_active":"2024-08-17T02:26:41.891485+0000","last_peered":"2024-08-17T02:26:41.891485+0000","last_clean":"2024-08-17T02:26:41.891485+0000","last_became_active":"2024-08-17T02:26:41.888226+0000","last_became_peered":"2024-08-17T02:26:41.888226+0000","last_unstale":"2024-08-17T02:26:41.891485+0000","last_undegraded":"2024-08-17T02:26:41.891485+0000","last_fullsized":"2024-08-17T02:26:41.891485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:44:11.558043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.916449+0000","last_change":"2024-08-17T02:26:42.914333+0000","last_active":"2024-08-17T02:26:42.916449+0000","last_peered":"2024-08-17T02:26:42.916449+0000","last_clean":"2024-08-17T02:26:42.916449+0000","last_became_active":"2024-08-17T02:26:42.914006+0000","last_became_peered":"2024-08-17T02:26:42.914006+0000","last_unstale":"2024-08-17T02:26:42.916449+0000","last_undegraded":"2024-08-17T02:26:42.916449+0000","last_fullsized":"2024-08-17T02:26:42.916449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:16:37.504708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.922555+0000","last_change":"2024-08-17T02:26:41.883660+0000","last_active":"2024-08-17T02:26:42.922555+0000","last_peered":"2024-08-17T02:26:42.922555+0000","last_clean":"2024-08-17T02:26:42.922555+0000","last_became_active":"2024-08-17T02:26:41.883321+0000","last_became_peered":"2024-08-17T02:26:41.883321+0000","last_unstale":"2024-08-17T02:26:42.922555+0000","last_undegraded":"2024-08-17T02:26:42.922555+0000","last_fullsized":"2024-08-17T02:26:42.922555+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:02:21.592473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.922095+0000","last_change":"2024-08-17T02:26:42.922095+0000","last_active":"2024-08-17T02:26:42.922095+0000","last_peered":"2024-08-17T02:26:42.922095+0000","last_clean":"2024-08-17T02:26:42.922095+0000","last_became_active":"2024-08-17T02:26:42.921771+0000","last_became_peered":"2024-08-17T02:26:42.921771+0000","last_unstale":"2024-08-17T02:26:42.922095+0000","last_undegraded":"2024-08-17T02:26:42.922095+0000","last_fullsized":"2024-08-17T02:26:42.922095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:39:12.343432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:41.877819+0000","last_change":"2024-08-17T02:26:41.874792+0000","last_active":"2024-08-17T02:26:41.877819+0000","last_peered":"2024-08-17T02:26:41.877819+0000","last_clean":"2024-08-17T02:26:41.877819+0000","last_became_active":"2024-08-17T02:26:41.874503+0000","last_became_peered":"2024-08-17T02:26:41.874503+0000","last_unstale":"2024-08-17T02:26:41.877819+0000","last_undegraded":"2024-08-17T02:26:41.877819+0000","last_fullsized":"2024-08-17T02:26:41.877819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:21.500716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.922400+0000","last_change":"2024-08-17T02:26:42.922400+0000","last_active":"2024-08-17T02:26:42.922400+0000","last_peered":"2024-08-17T02:26:42.922400+0000","last_clean":"2024-08-17T02:26:42.922400+0000","last_became_active":"2024-08-17T02:26:42.922065+0000","last_became_peered":"2024-08-17T02:26:42.922065+0000","last_unstale":"2024-08-17T02:26:42.922400+0000","last_undegraded":"2024-08-17T02:26:42.922400+0000","last_fullsized":"2024-08-17T02:26:42.922400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:59.914776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.888712+0000","last_change":"2024-08-17T02:26:41.877473+0000","last_active":"2024-08-17T02:26:42.888712+0000","last_peered":"2024-08-17T02:26:42.888712+0000","last_clean":"2024-08-17T02:26:42.888712+0000","last_became_active":"2024-08-17T02:26:41.877157+0000","last_became_peered":"2024-08-17T02:26:41.877157+0000","last_unstale":"2024-08-17T02:26:42.888712+0000","last_undegraded":"2024-08-17T02:26:42.888712+0000","last_fullsized":"2024-08-17T02:26:42.888712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:08.217922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904315+0000","last_change":"2024-08-17T02:26:42.904315+0000","last_active":"2024-08-17T02:26:42.904315+0000","last_peered":"2024-08-17T02:26:42.904315+0000","last_clean":"2024-08-17T02:26:42.904315+0000","last_became_active":"2024-08-17T02:26:42.904016+0000","last_became_peered":"2024-08-17T02:26:42.904016+0000","last_unstale":"2024-08-17T02:26:42.904315+0000","last_undegraded":"2024-08-17T02:26:42.904315+0000","last_fullsized":"2024-08-17T02:26:42.904315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:10.061377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:41.880817+0000","last_change":"2024-08-17T02:26:41.879691+0000","last_active":"2024-08-17T02:26:41.880817+0000","last_peered":"2024-08-17T02:26:41.880817+0000","last_clean":"2024-08-17T02:26:41.880817+0000","last_became_active":"2024-08-17T02:26:41.879446+0000","last_became_peered":"2024-08-17T02:26:41.879446+0000","last_unstale":"2024-08-17T02:26:41.880817+0000","last_undegraded":"2024-08-17T02:26:41.880817+0000","last_fullsized":"2024-08-17T02:26:41.880817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:36.149653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.909988+0000","last_change":"2024-08-17T02:26:42.909988+0000","last_active":"2024-08-17T02:26:42.909988+0000","last_peered":"2024-08-17T02:26:42.909988+0000","last_clean":"2024-08-17T02:26:42.909988+0000","last_became_active":"2024-08-17T02:26:42.909489+0000","last_became_peered":"2024-08-17T02:26:42.909489+0000","last_unstale":"2024-08-17T02:26:42.909988+0000","last_undegraded":"2024-08-17T02:26:42.909988+0000","last_fullsized":"2024-08-17T02:26:42.909988+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:01:19.776065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.888072+0000","last_change":"2024-08-17T02:26:41.880030+0000","last_active":"2024-08-17T02:26:42.888072+0000","last_peered":"2024-08-17T02:26:42.888072+0000","last_clean":"2024-08-17T02:26:42.888072+0000","last_became_active":"2024-08-17T02:26:41.879241+0000","last_became_peered":"2024-08-17T02:26:41.879241+0000","last_unstale":"2024-08-17T02:26:42.888072+0000","last_undegraded":"2024-08-17T02:26:42.888072+0000","last_fullsized":"2024-08-17T02:26:42.888072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:34.888550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904660+0000","last_change":"2024-08-17T02:26:42.898024+0000","last_active":"2024-08-17T02:26:42.904660+0000","last_peered":"2024-08-17T02:26:42.904660+0000","last_clean":"2024-08-17T02:26:42.904660+0000","last_became_active":"2024-08-17T02:26:42.896946+0000","last_became_peered":"2024-08-17T02:26:42.896946+0000","last_unstale":"2024-08-17T02:26:42.904660+0000","last_undegraded":"2024-08-17T02:26:42.904660+0000","last_fullsized":"2024-08-17T02:26:42.904660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:12.799975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.888275+0000","last_change":"2024-08-17T02:26:41.875105+0000","last_active":"2024-08-17T02:26:42.888275+0000","last_peered":"2024-08-17T02:26:42.888275+0000","last_clean":"2024-08-17T02:26:42.888275+0000","last_became_active":"2024-08-17T02:26:41.874704+0000","last_became_peered":"2024-08-17T02:26:41.874704+0000","last_unstale":"2024-08-17T02:26:42.888275+0000","last_undegraded":"2024-08-17T02:26:42.888275+0000","last_fullsized":"2024-08-17T02:26:42.888275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:09:57.637856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.914317+0000","last_change":"2024-08-17T02:26:42.904789+0000","last_active":"2024-08-17T02:26:42.914317+0000","last_peered":"2024-08-17T02:26:42.914317+0000","last_clean":"2024-08-17T02:26:42.914317+0000","last_became_active":"2024-08-17T02:26:42.904460+0000","last_became_peered":"2024-08-17T02:26:42.904460+0000","last_unstale":"2024-08-17T02:26:42.914317+0000","last_undegraded":"2024-08-17T02:26:42.914317+0000","last_fullsized":"2024-08-17T02:26:42.914317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:18.766640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.891073+0000","last_change":"2024-08-17T02:26:41.890078+0000","last_active":"2024-08-17T02:26:42.891073+0000","last_peered":"2024-08-17T02:26:42.891073+0000","last_clean":"2024-08-17T02:26:42.891073+0000","last_became_active":"2024-08-17T02:26:41.889688+0000","last_became_peered":"2024-08-17T02:26:41.889688+0000","last_unstale":"2024-08-17T02:26:42.891073+0000","last_undegraded":"2024-08-17T02:26:42.891073+0000","last_fullsized":"2024-08-17T02:26:42.891073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:24:27.230099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:42.904805+0000","last_change":"2024-08-17T02:26:42.904805+0000","last_active":"2024-08-17T02:26:42.904805+0000","last_peered":"2024-08-17T02:26:42.904805+0000","last_clean":"2024-08-17T02:26:42.904805+0000","last_became_active":"2024-08-17T02:26:42.904384+0000","last_became_peered":"2024-08-17T02:26:42.904384+0000","last_unstale":"2024-08-17T02:26:42.904805+0000","last_undegraded":"2024-08-17T02:26:42.904805+0000","last_fullsized":"2024-08-17T02:26:42.904805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:41.853009+0000","last_clean_scrub_stamp":"2024-08-17T02:26:41.853009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:55.687560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:41.883708+0000","last_change":"2024-08-17T02:26:41.882314+0000","last_active":"2024-08-17T02:26:41.883708+0000","last_peered":"2024-08-17T02:26:41.883708+0000","last_clean":"2024-08-17T02:26:41.883708+0000","last_became_active":"2024-08-17T02:26:41.881240+0000","last_became_peered":"2024-08-17T02:26:41.881240+0000","last_unstale":"2024-08-17T02:26:41.883708+0000","last_undegraded":"2024-08-17T02:26:41.883708+0000","last_fullsized":"2024-08-17T02:26:41.883708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:40.850116+0000","last_clean_scrub_stamp":"2024-08-17T02:26:40.850116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:51:06.209522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:41.887286+0000","last_change":"2024-08-17T02:25:51.241912+0000","last_active":"2024-08-17T02:26:41.887286+0000","last_peered":"2024-08-17T02:26:41.887286+0000","last_clean":"2024-08-17T02:26:41.887286+0000","last_became_active":"2024-08-17T02:25:51.239655+0000","last_became_peered":"2024-08-17T02:25:51.239655+0000","last_unstale":"2024-08-17T02:26:41.887286+0000","last_undegraded":"2024-08-17T02:26:41.887286+0000","last_fullsized":"2024-08-17T02:26:41.887286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_clean_scrub_stamp":"2024-08-17T02:25:49.863184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:53.845381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073560,"statfs":{"total":96636764160,"available":96331325440,"internally_reserved":0,"allocated":942080,"data_stored":721019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":352256,"data_stored":131165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":352256,"data_stored":131221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301876,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069964,"statfs":{"total":96636764160,"available":96327643136,"internally_reserved":0,"allocated":364544,"data_stored":136953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]}]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297712,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074128,"statfs":{"total":96636764160,"available":96331907072,"internally_reserved":0,"allocated":360448,"data_stored":132135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":348160,"data_stored":130631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301868,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069972,"statfs":{"total":96636764160,"available":96327651328,"internally_reserved":0,"allocated":360448,"data_stored":132135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":937984,"data_stored":720929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:47.211 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:26:47.211 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:26:47.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee2ae0700 1 Processor -- start 2024-08-17T02:26:47.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee2ae0700 1 -- start start 2024-08-17T02:26:47.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee2ae0700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcedc066e00 0x7fcedc0671d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee2ae0700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcedc0cc080 0x7fcedc0b2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee2ae0700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcedc0b2550 0x7fcedc0b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee2ae0700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcedc0b29d0 con 0x7fcedc0b2550 2024-08-17T02:26:47.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee2ae0700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcedc0cbbf0 con 0x7fcedc0cc080 2024-08-17T02:26:47.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee2ae0700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc067710 con 0x7fcedc066e00 2024-08-17T02:26:47.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee22df700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcedc0b2550 0x7fcedc0b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee22df700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcedc0b2550 0x7fcedc0b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55130/0 (socket says 172.21.15.102:55130) 2024-08-17T02:26:47.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee22df700 1 -- 172.21.15.102:0/367719512 learned_addr learned my addr 172.21.15.102:0/367719512 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:47.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee1ade700 1 --2- 172.21.15.102:0/367719512 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcedc066e00 0x7fcedc0671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee12dd700 1 --2- 172.21.15.102:0/367719512 >> v2:172.21.15.121:3300/0 conn(0x7fcedc0cc080 0x7fcedc0b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee22df700 1 -- 172.21.15.102:0/367719512 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcedc066e00 msgr2=0x7fcedc0671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee22df700 1 --2- 172.21.15.102:0/367719512 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcedc066e00 0x7fcedc0671d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee22df700 1 -- 172.21.15.102:0/367719512 >> v2:172.21.15.121:3300/0 conn(0x7fcedc0cc080 msgr2=0x7fcedc0b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee22df700 1 --2- 172.21.15.102:0/367719512 >> v2:172.21.15.121:3300/0 conn(0x7fcedc0cc080 0x7fcedc0b2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee22df700 1 -- 172.21.15.102:0/367719512 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc0cd440 con 0x7fcedc0b2550 2024-08-17T02:26:47.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.324+0000 7fcee22df700 1 --2- 172.21.15.102:0/367719512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcedc0b2550 0x7fcedc0b2ea0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcedc067ea0 tx=0x7fced4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845fdbcdd132053a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.328+0000 7fcee0adc700 1 -- 172.21.15.102:0/367719512 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced400e070 con 0x7fcedc0b2550 2024-08-17T02:26:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.328+0000 7fcee0adc700 1 -- 172.21.15.102:0/367719512 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced400b970 con 0x7fcedc0b2550 2024-08-17T02:26:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.328+0000 7fcee0adc700 1 -- 172.21.15.102:0/367719512 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced40092e0 con 0x7fcedc0b2550 2024-08-17T02:26:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.328+0000 7fcee2ae0700 1 -- 172.21.15.102:0/367719512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcedc0b2550 msgr2=0x7fcedc0b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.328+0000 7fcee2ae0700 1 --2- 172.21.15.102:0/367719512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcedc0b2550 0x7fcedc0b2ea0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcedc067ea0 tx=0x7fced4009840 comp rx=0 tx=0).stop 2024-08-17T02:26:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.328+0000 7fcee2ae0700 1 -- 172.21.15.102:0/367719512 shutdown_connections 2024-08-17T02:26:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.328+0000 7fcee2ae0700 1 --2- 172.21.15.102:0/367719512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcedc0b2550 0x7fcedc0b2ea0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.328+0000 7fcee2ae0700 1 --2- 172.21.15.102:0/367719512 >> v2:172.21.15.121:3300/0 conn(0x7fcedc0cc080 0x7fcedc0b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.328+0000 7fcee2ae0700 1 --2- 172.21.15.102:0/367719512 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcedc066e00 0x7fcedc0671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.328+0000 7fcee2ae0700 1 -- 172.21.15.102:0/367719512 >> 172.21.15.102:0/367719512 conn(0x7fcedc0682c0 msgr2=0x7fcedc0686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.328+0000 7fcee2ae0700 1 -- 172.21.15.102:0/367719512 shutdown_connections 2024-08-17T02:26:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.328+0000 7fcee2ae0700 1 -- 172.21.15.102:0/367719512 wait complete. 2024-08-17T02:26:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.328+0000 7fcee2ae0700 1 Processor -- start 2024-08-17T02:26:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.328+0000 7fcee2ae0700 1 -- start start 2024-08-17T02:26:47.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee2ae0700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcedc066e00 0x7fcedc0c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee2ae0700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcedc0b2550 0x7fcedc0c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee2ae0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcedc0cc080 0x7fcedc15b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee2ae0700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0c6cc0 con 0x7fcedc0b2550 2024-08-17T02:26:47.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee2ae0700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0c60b0 con 0x7fcedc0cc080 2024-08-17T02:26:47.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee2ae0700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0c6390 con 0x7fcedc066e00 2024-08-17T02:26:47.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee12dd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcedc0b2550 0x7fcedc0c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee12dd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcedc0b2550 0x7fcedc0c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55142/0 (socket says 172.21.15.102:55142) 2024-08-17T02:26:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee12dd700 1 -- 172.21.15.102:0/3883785287 learned_addr learned my addr 172.21.15.102:0/3883785287 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee1ade700 1 --2- 172.21.15.102:0/3883785287 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcedc066e00 0x7fcedc0c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee22df700 1 --2- 172.21.15.102:0/3883785287 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcedc0cc080 0x7fcedc15b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee12dd700 1 -- 172.21.15.102:0/3883785287 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcedc066e00 msgr2=0x7fcedc0c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee12dd700 1 --2- 172.21.15.102:0/3883785287 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcedc066e00 0x7fcedc0c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee12dd700 1 -- 172.21.15.102:0/3883785287 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcedc0cc080 msgr2=0x7fcedc15b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee12dd700 1 --2- 172.21.15.102:0/3883785287 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcedc0cc080 0x7fcedc15b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee12dd700 1 -- 172.21.15.102:0/3883785287 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced4009ae0 con 0x7fcedc0b2550 2024-08-17T02:26:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee1ade700 1 --2- 172.21.15.102:0/3883785287 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcedc066e00 0x7fcedc0c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee12dd700 1 --2- 172.21.15.102:0/3883785287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcedc0b2550 0x7fcedc0c57c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fced000ec80 tx=0x7fced00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcecdffb700 1 -- 172.21.15.102:0/3883785287 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced000c9d0 con 0x7fcedc0b2550 2024-08-17T02:26:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcecdffb700 1 -- 172.21.15.102:0/3883785287 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced000cb30 con 0x7fcedc0b2550 2024-08-17T02:26:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee2ae0700 1 -- 172.21.15.102:0/3883785287 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcedc0c6670 con 0x7fcedc0b2550 2024-08-17T02:26:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcecdffb700 1 -- 172.21.15.102:0/3883785287 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0013470 con 0x7fcedc0b2550 2024-08-17T02:26:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee2ae0700 1 -- 172.21.15.102:0/3883785287 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcedc1564a0 con 0x7fcedc0b2550 2024-08-17T02:26:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.332+0000 7fcee2ae0700 1 -- 172.21.15.102:0/3883785287 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcedc0c6e70 con 0x7fcedc0b2550 2024-08-17T02:26:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.336+0000 7fcecdffb700 1 -- 172.21.15.102:0/3883785287 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fced0013820 con 0x7fcedc0b2550 2024-08-17T02:26:47.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.336+0000 7fcecdffb700 1 --2- 172.21.15.102:0/3883785287 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcec0060860 0x7fcec0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.336+0000 7fcecdffb700 1 -- 172.21.15.102:0/3883785287 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fced007cf60 con 0x7fcedc0b2550 2024-08-17T02:26:47.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.336+0000 7fcee1ade700 1 --2- 172.21.15.102:0/3883785287 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcec0060860 0x7fcec0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.336+0000 7fcee1ade700 1 --2- 172.21.15.102:0/3883785287 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcec0060860 0x7fcec0062d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fced8009ce0 tx=0x7fced8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.344+0000 7fcecdffb700 1 -- 172.21.15.102:0/3883785287 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fced004d310 con 0x7fcedc0b2550 2024-08-17T02:26:47.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.560+0000 7fcee2ae0700 1 -- 172.21.15.102:0/3883785287 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fcedc0638f0 con 0x7fcedc0b2550 2024-08-17T02:26:47.570 INFO:tasks.ceph.mds.a.smithi102.stderr:2024-08-17T02:26:47.568+0000 7eff645a0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:47.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.568+0000 7fcecdffb700 1 -- 172.21.15.102:0/3883785287 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7fced0050930 con 0x7fcedc0b2550 2024-08-17T02:26:47.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.572+0000 7fcee2ae0700 1 -- 172.21.15.102:0/3883785287 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcec0060860 msgr2=0x7fcec0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.572+0000 7fcee2ae0700 1 --2- 172.21.15.102:0/3883785287 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcec0060860 0x7fcec0062d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fced8009ce0 tx=0x7fced8008040 comp rx=0 tx=0).stop 2024-08-17T02:26:47.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.572+0000 7fcee2ae0700 1 -- 172.21.15.102:0/3883785287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcedc0b2550 msgr2=0x7fcedc0c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.572+0000 7fcee2ae0700 1 --2- 172.21.15.102:0/3883785287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcedc0b2550 0x7fcedc0c57c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fced000ec80 tx=0x7fced00091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.572+0000 7fcee2ae0700 1 -- 172.21.15.102:0/3883785287 shutdown_connections 2024-08-17T02:26:47.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.572+0000 7fcee2ae0700 1 --2- 172.21.15.102:0/3883785287 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcec0060860 0x7fcec0062d10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.572+0000 7fcee2ae0700 1 --2- 172.21.15.102:0/3883785287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcedc0b2550 0x7fcedc0c57c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.572+0000 7fcee2ae0700 1 --2- 172.21.15.102:0/3883785287 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcedc0cc080 0x7fcedc15b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.572+0000 7fcee2ae0700 1 --2- 172.21.15.102:0/3883785287 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcedc066e00 0x7fcedc0c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.572+0000 7fcee2ae0700 1 -- 172.21.15.102:0/3883785287 >> 172.21.15.102:0/3883785287 conn(0x7fcedc0682c0 msgr2=0x7fcedc0b5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.572+0000 7fcee2ae0700 1 -- 172.21.15.102:0/3883785287 shutdown_connections 2024-08-17T02:26:47.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.572+0000 7fcee2ae0700 1 -- 172.21.15.102:0/3883785287 wait complete. 2024-08-17T02:26:47.576 INFO:teuthology.orchestra.run.smithi102.stderr:updated caps for client.0 2024-08-17T02:26:47.587 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:47.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.692+0000 7ff5cb59e700 1 Processor -- start 2024-08-17T02:26:47.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.692+0000 7ff5cb59e700 1 -- start start 2024-08-17T02:26:47.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.692+0000 7ff5cb59e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff5cc154900 0x7ff5cc0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.692+0000 7ff5cb59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5cc0cb560 0x7ff5cc160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.692+0000 7ff5cb59e700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5cc0b1730 con 0x7ff5cc0b12d0 2024-08-17T02:26:47.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.692+0000 7ff5cb59e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5cc068790 con 0x7ff5cc154900 2024-08-17T02:26:47.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.692+0000 7ff5cb59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc1583f0 con 0x7ff5cc0cb560 2024-08-17T02:26:47.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.692+0000 7ff5c9d9b700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff5cc0b12d0 0x7ff5cc0cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48244/0 (socket says 172.21.15.102:48244) 2024-08-17T02:26:47.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.692+0000 7ff5c9d9b700 1 -- 172.21.15.102:0/2731418359 learned_addr learned my addr 172.21.15.102:0/2731418359 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:47.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.692+0000 7ff5cad9d700 1 --2- 172.21.15.102:0/2731418359 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5cc0cb560 0x7ff5cc160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.692+0000 7ff5c959a700 1 -- 172.21.15.102:0/2731418359 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129822187 0 0) 0x7ff5b4001110 con 0x7ff5cc0b12d0 2024-08-17T02:26:47.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.692+0000 7ff5c959a700 1 -- 172.21.15.102:0/2731418359 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5ac003570 con 0x7ff5cc0b12d0 2024-08-17T02:26:47.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.692+0000 7ff5ca59c700 1 --2- 172.21.15.102:0/2731418359 >> v2:172.21.15.121:3300/0 conn(0x7ff5cc154900 0x7ff5cc0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 -- 172.21.15.102:0/2731418359 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2658393972 0 0) 0x7ff5ac003570 con 0x7ff5cc0b12d0 2024-08-17T02:26:47.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 -- 172.21.15.102:0/2731418359 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5cc0cb560 msgr2=0x7ff5cc160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 --2- 172.21.15.102:0/2731418359 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5cc0cb560 0x7ff5cc160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 -- 172.21.15.102:0/2731418359 >> v2:172.21.15.121:3300/0 conn(0x7ff5cc154900 msgr2=0x7ff5cc0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 --2- 172.21.15.102:0/2731418359 >> v2:172.21.15.121:3300/0 conn(0x7ff5cc154900 0x7ff5cc0b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 -- 172.21.15.102:0/2731418359 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc0cbaa0 con 0x7ff5cc0b12d0 2024-08-17T02:26:47.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 -- 172.21.15.102:0/2731418359 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7ff5b4001620 con 0x7ff5cc0b12d0 2024-08-17T02:26:47.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 -- 172.21.15.102:0/2731418359 >> v1:172.21.15.102:6789/0 conn(0x7ff5cc0b12d0 legacy=0x7ff5cc0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 --2- 172.21.15.102:0/2731418359 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5cc0cb560 0x7ff5ac003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 --2- 172.21.15.102:0/2731418359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5ac003fe0 0x7ff5ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 --2- 172.21.15.102:0/2731418359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5ac004d50 0x7ff5ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 -- 172.21.15.102:0/2731418359 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc068790 con 0x7ff5ac004d50 2024-08-17T02:26:47.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 -- 172.21.15.102:0/2731418359 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc1583f0 con 0x7ff5ac003fe0 2024-08-17T02:26:47.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 -- 172.21.15.102:0/2731418359 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac00bb40 con 0x7ff5cc0cb560 2024-08-17T02:26:47.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5cad9d700 1 --2- 172.21.15.102:0/2731418359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5ac004d50 0x7ff5ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5ca59c700 1 --2- 172.21.15.102:0/2731418359 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5cc0cb560 0x7ff5ac003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c9d9b700 1 --2- 172.21.15.102:0/2731418359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5ac003fe0 0x7ff5ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5cad9d700 1 -- 172.21.15.102:0/2731418359 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5cc0cb560 msgr2=0x7ff5ac003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5cad9d700 1 --2- 172.21.15.102:0/2731418359 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5cc0cb560 0x7ff5ac003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5cad9d700 1 -- 172.21.15.102:0/2731418359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5ac003fe0 msgr2=0x7ff5ac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5cad9d700 1 --2- 172.21.15.102:0/2731418359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5ac003fe0 0x7ff5ac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5cad9d700 1 -- 172.21.15.102:0/2731418359 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac003570 con 0x7ff5ac004d50 2024-08-17T02:26:47.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5cad9d700 1 --2- 172.21.15.102:0/2731418359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5ac004d50 0x7ff5ac0051c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40094d0 tx=0x7ff5c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b05d4c12b8f9657 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 -- 172.21.15.102:0/2731418359 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c400ea90 con 0x7ff5ac004d50 2024-08-17T02:26:47.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 -- 172.21.15.102:0/2731418359 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c400f040 con 0x7ff5ac004d50 2024-08-17T02:26:47.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5c959a700 1 -- 172.21.15.102:0/2731418359 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c400ee20 con 0x7ff5ac004d50 2024-08-17T02:26:47.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5cb59e700 1 -- 172.21.15.102:0/2731418359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5ac004d50 msgr2=0x7ff5ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5cb59e700 1 --2- 172.21.15.102:0/2731418359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5ac004d50 0x7ff5ac0051c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40094d0 tx=0x7ff5c400b040 comp rx=0 tx=0).stop 2024-08-17T02:26:47.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5cad9d700 1 -- 172.21.15.102:0/2731418359 reap_dead start 2024-08-17T02:26:47.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5cb59e700 1 -- 172.21.15.102:0/2731418359 shutdown_connections 2024-08-17T02:26:47.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5cb59e700 1 -- 172.21.15.102:0/2731418359 >> 172.21.15.102:0/2731418359 conn(0x7ff5cc0678d0 msgr2=0x7ff5cc067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5cb59e700 1 -- 172.21.15.102:0/2731418359 shutdown_connections 2024-08-17T02:26:47.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.696+0000 7ff5cb59e700 1 -- 172.21.15.102:0/2731418359 wait complete. 2024-08-17T02:26:47.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.700+0000 7ff5cb59e700 1 Processor -- start 2024-08-17T02:26:47.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.700+0000 7ff5cb59e700 1 -- start start 2024-08-17T02:26:47.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5cb59e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5cc06e810 0x7ff5cc167e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5cb59e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5cc15d5b0 0x7ff5cc15bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5cb59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5cc06ebe0 0x7ff5cc159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5cb59e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc15c320 con 0x7ff5cc06e810 2024-08-17T02:26:47.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5cb59e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc1509b0 con 0x7ff5cc15d5b0 2024-08-17T02:26:47.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5cb59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc15c510 con 0x7ff5cc06ebe0 2024-08-17T02:26:47.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5ca59c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5cc06e810 0x7ff5cc167e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5ca59c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5cc06e810 0x7ff5cc167e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55164/0 (socket says 172.21.15.102:55164) 2024-08-17T02:26:47.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5ca59c700 1 -- 172.21.15.102:0/2007484833 learned_addr learned my addr 172.21.15.102:0/2007484833 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:47.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5c9d9b700 1 --2- 172.21.15.102:0/2007484833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5cc15d5b0 0x7ff5cc15bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5cad9d700 1 --2- 172.21.15.102:0/2007484833 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5cc06ebe0 0x7ff5cc159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5ca59c700 1 -- 172.21.15.102:0/2007484833 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5cc06ebe0 msgr2=0x7ff5cc159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5ca59c700 1 --2- 172.21.15.102:0/2007484833 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5cc06ebe0 0x7ff5cc159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5ca59c700 1 -- 172.21.15.102:0/2007484833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5cc15d5b0 msgr2=0x7ff5cc15bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5ca59c700 1 --2- 172.21.15.102:0/2007484833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5cc15d5b0 0x7ff5cc15bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5ca59c700 1 -- 172.21.15.102:0/2007484833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc15c7f0 con 0x7ff5cc06e810 2024-08-17T02:26:47.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5ca59c700 1 --2- 172.21.15.102:0/2007484833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5cc06e810 0x7ff5cc167e20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0109f0 tx=0x7ff5bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5c27fc700 1 -- 172.21.15.102:0/2007484833 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00e8d0 con 0x7ff5cc06e810 2024-08-17T02:26:47.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5c27fc700 1 -- 172.21.15.102:0/2007484833 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc00ea30 con 0x7ff5cc06e810 2024-08-17T02:26:47.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5cb59e700 1 -- 172.21.15.102:0/2007484833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5cc15cad0 con 0x7ff5cc06e810 2024-08-17T02:26:47.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5c27fc700 1 -- 172.21.15.102:0/2007484833 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00ee30 con 0x7ff5cc06e810 2024-08-17T02:26:47.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5cb59e700 1 -- 172.21.15.102:0/2007484833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5cc15d090 con 0x7ff5cc06e810 2024-08-17T02:26:47.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5cb59e700 1 -- 172.21.15.102:0/2007484833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5cc0643a0 con 0x7ff5cc06e810 2024-08-17T02:26:47.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.704+0000 7ff5c27fc700 1 -- 172.21.15.102:0/2007484833 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff5bc014640 con 0x7ff5cc06e810 2024-08-17T02:26:47.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.708+0000 7ff5c27fc700 1 --2- 172.21.15.102:0/2007484833 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff5b0060860 0x7ff5b0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.708+0000 7ff5c9d9b700 1 --2- 172.21.15.102:0/2007484833 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff5b0060860 0x7ff5b0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.708+0000 7ff5c27fc700 1 -- 172.21.15.102:0/2007484833 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff5bc07d270 con 0x7ff5cc06e810 2024-08-17T02:26:47.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.708+0000 7ff5c9d9b700 1 --2- 172.21.15.102:0/2007484833 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff5b0060860 0x7ff5b0062d10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4000e10 tx=0x7ff5b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.716+0000 7ff5c27fc700 1 -- 172.21.15.102:0/2007484833 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff5bc051150 con 0x7ff5cc06e810 2024-08-17T02:26:47.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.916+0000 7ff5cb59e700 1 -- 172.21.15.102:0/2007484833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5cc06f5f0 con 0x7ff5cc06e810 2024-08-17T02:26:47.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.916+0000 7ff5c27fc700 1 -- 172.21.15.102:0/2007484833 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4608 (secure 0 0 0) 0x7ff5bc050ce0 con 0x7ff5cc06e810 2024-08-17T02:26:47.921 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:47.921 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3728405798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3728405798},{"type":"v1","addr":"172.21.15.102:6835","nonce":3728405798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2759836087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2759836087},{"type":"v1","addr":"172.21.15.121:6833","nonce":2759836087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2189006578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2189006578},{"type":"v1","addr":"172.21.15.121:6835","nonce":2189006578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:42.224494+0000","modified":"2024-08-17T02:26:45.888060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/1340437033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1340437033},{"type":"v1","addr":"172.21.15.102:6837","nonce":1340437033}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:26:47.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.920+0000 7ff5cb59e700 1 -- 172.21.15.102:0/2007484833 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff5b0060860 msgr2=0x7ff5b0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.920+0000 7ff5cb59e700 1 --2- 172.21.15.102:0/2007484833 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff5b0060860 0x7ff5b0062d10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4000e10 tx=0x7ff5b4009040 comp rx=0 tx=0).stop 2024-08-17T02:26:47.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.920+0000 7ff5cb59e700 1 -- 172.21.15.102:0/2007484833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5cc06e810 msgr2=0x7ff5cc167e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.920+0000 7ff5cb59e700 1 --2- 172.21.15.102:0/2007484833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5cc06e810 0x7ff5cc167e20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0109f0 tx=0x7ff5bc00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:47.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.920+0000 7ff5cb59e700 1 -- 172.21.15.102:0/2007484833 shutdown_connections 2024-08-17T02:26:47.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.920+0000 7ff5cb59e700 1 --2- 172.21.15.102:0/2007484833 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff5b0060860 0x7ff5b0062d10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.920+0000 7ff5cb59e700 1 --2- 172.21.15.102:0/2007484833 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5cc06ebe0 0x7ff5cc159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.920+0000 7ff5cb59e700 1 --2- 172.21.15.102:0/2007484833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5cc15d5b0 0x7ff5cc15bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.920+0000 7ff5cb59e700 1 --2- 172.21.15.102:0/2007484833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5cc06e810 0x7ff5cc167e20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.920+0000 7ff5cb59e700 1 -- 172.21.15.102:0/2007484833 >> 172.21.15.102:0/2007484833 conn(0x7ff5cc0678d0 msgr2=0x7ff5cc0aca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.920+0000 7ff5cb59e700 1 -- 172.21.15.102:0/2007484833 shutdown_connections 2024-08-17T02:26:47.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:47.920+0000 7ff5cb59e700 1 -- 172.21.15.102:0/2007484833 wait complete. 2024-08-17T02:26:47.926 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 14 2024-08-17T02:26:48.342 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:26:42.224494+0000', 'modified': '2024-08-17T02:26:45.888060+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4974}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4974': {'gid': 4974, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.102:6837/1340437033', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6836', 'nonce': 1340437033}, {'type': 'v1', 'addr': '172.21.15.102:6837', 'nonce': 1340437033}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:26:48.342 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:26:48.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-17T02:26:48.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f0887fff700 1 Processor -- start 2024-08-17T02:26:48.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f0887fff700 1 -- start start 2024-08-17T02:26:48.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f0887fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0888154900 0x7f08880b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f0887fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f08880b12d0 0x7f08880cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f0887fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f08880cb390 0x7f088806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f0887fff700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0888068790 con 0x7f08880b12d0 2024-08-17T02:26:48.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f0887fff700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08881583f0 con 0x7f08880cb390 2024-08-17T02:26:48.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f0887fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08880cbaa0 con 0x7f0888154900 2024-08-17T02:26:48.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f08867fc700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f08880b12d0 0x7f08880cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f08867fc700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f08880b12d0 0x7f08880cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55166/0 (socket says 172.21.15.102:55166) 2024-08-17T02:26:48.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f08867fc700 1 -- 172.21.15.102:0/2039965642 learned_addr learned my addr 172.21.15.102:0/2039965642 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:48.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f0886ffd700 1 --2- 172.21.15.102:0/2039965642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0888154900 0x7f08880b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f08877fe700 1 --2- 172.21.15.102:0/2039965642 >> v2:172.21.15.121:3300/0 conn(0x7f08880cb390 0x7f088806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f08867fc700 1 -- 172.21.15.102:0/2039965642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0888154900 msgr2=0x7f08880b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f08867fc700 1 --2- 172.21.15.102:0/2039965642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0888154900 0x7f08880b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f08867fc700 1 -- 172.21.15.102:0/2039965642 >> v2:172.21.15.121:3300/0 conn(0x7f08880cb390 msgr2=0x7f088806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f08867fc700 1 --2- 172.21.15.102:0/2039965642 >> v2:172.21.15.121:3300/0 conn(0x7f08880cb390 0x7f088806df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f08867fc700 1 -- 172.21.15.102:0/2039965642 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08880b1700 con 0x7f08880b12d0 2024-08-17T02:26:48.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f08867fc700 1 --2- 172.21.15.102:0/2039965642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08880b12d0 0x7f08880cae50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0888070340 tx=0x7f0870009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd64054a2db2c5d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f0885ffb700 1 -- 172.21.15.102:0/2039965642 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087000b860 con 0x7f08880b12d0 2024-08-17T02:26:48.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f0885ffb700 1 -- 172.21.15.102:0/2039965642 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087000b9c0 con 0x7f08880b12d0 2024-08-17T02:26:48.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.456+0000 7f0885ffb700 1 -- 172.21.15.102:0/2039965642 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087000bd60 con 0x7f08880b12d0 2024-08-17T02:26:48.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 -- 172.21.15.102:0/2039965642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08880b12d0 msgr2=0x7f08880cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 --2- 172.21.15.102:0/2039965642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08880b12d0 0x7f08880cae50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0888070340 tx=0x7f0870009250 comp rx=0 tx=0).stop 2024-08-17T02:26:48.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 -- 172.21.15.102:0/2039965642 shutdown_connections 2024-08-17T02:26:48.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 --2- 172.21.15.102:0/2039965642 >> v2:172.21.15.121:3300/0 conn(0x7f08880cb390 0x7f088806df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 --2- 172.21.15.102:0/2039965642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08880b12d0 0x7f08880cae50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 --2- 172.21.15.102:0/2039965642 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0888154900 0x7f08880b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 -- 172.21.15.102:0/2039965642 >> 172.21.15.102:0/2039965642 conn(0x7f08880678d0 msgr2=0x7f0888067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 -- 172.21.15.102:0/2039965642 shutdown_connections 2024-08-17T02:26:48.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 -- 172.21.15.102:0/2039965642 wait complete. 2024-08-17T02:26:48.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 Processor -- start 2024-08-17T02:26:48.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 -- start start 2024-08-17T02:26:48.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f08880b12d0 0x7f08880b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08880cb390 0x7f08880aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0888154900 0x7f088816c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08880af0c0 con 0x7f08880cb390 2024-08-17T02:26:48.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088816c5a0 con 0x7f0888154900 2024-08-17T02:26:48.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0887fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08880af340 con 0x7f08880b12d0 2024-08-17T02:26:48.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f08867fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08880cb390 0x7f08880aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f08877fe700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0888154900 0x7f088816c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f08867fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08880cb390 0x7f08880aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55168/0 (socket says 172.21.15.102:55168) 2024-08-17T02:26:48.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f08867fc700 1 -- 172.21.15.102:0/4034153836 learned_addr learned my addr 172.21.15.102:0/4034153836 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:48.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.460+0000 7f0886ffd700 1 --2- 172.21.15.102:0/4034153836 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f08880b12d0 0x7f08880b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.464+0000 7f08877fe700 1 -- 172.21.15.102:0/4034153836 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f08880b12d0 msgr2=0x7f08880b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.464+0000 7f08877fe700 1 --2- 172.21.15.102:0/4034153836 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f08880b12d0 0x7f08880b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.464+0000 7f08877fe700 1 -- 172.21.15.102:0/4034153836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08880cb390 msgr2=0x7f08880aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.464+0000 7f08877fe700 1 --2- 172.21.15.102:0/4034153836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08880cb390 0x7f08880aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.464+0000 7f08877fe700 1 -- 172.21.15.102:0/4034153836 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08700094f0 con 0x7f0888154900 2024-08-17T02:26:48.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.464+0000 7f08877fe700 1 --2- 172.21.15.102:0/4034153836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0888154900 0x7f088816c060 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0880007ed0 tx=0x7f0880009850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.464+0000 7f087effd700 1 -- 172.21.15.102:0/4034153836 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088000eb90 con 0x7f0888154900 2024-08-17T02:26:48.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.464+0000 7f087effd700 1 -- 172.21.15.102:0/4034153836 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088000ecf0 con 0x7f0888154900 2024-08-17T02:26:48.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.464+0000 7f0887fff700 1 -- 172.21.15.102:0/4034153836 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08880af620 con 0x7f0888154900 2024-08-17T02:26:48.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.464+0000 7f087effd700 1 -- 172.21.15.102:0/4034153836 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880014670 con 0x7f0888154900 2024-08-17T02:26:48.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.464+0000 7f0887fff700 1 -- 172.21.15.102:0/4034153836 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08880afbe0 con 0x7f0888154900 2024-08-17T02:26:48.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.464+0000 7f087effd700 1 -- 172.21.15.102:0/4034153836 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0880003020 con 0x7f0888154900 2024-08-17T02:26:48.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f087effd700 1 --2- 172.21.15.102:0/4034153836 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f086c060860 0x7f086c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f088fb18740 1 Processor -- start 2024-08-17T02:26:48.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f0886ffd700 1 --2- 172.21.15.102:0/4034153836 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f086c060860 0x7f086c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f087effd700 1 -- 172.21.15.102:0/4034153836 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f088007ced0 con 0x7f0888154900 2024-08-17T02:26:48.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f088fb18740 1 -- start start 2024-08-17T02:26:48.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f0886ffd700 1 --2- 172.21.15.102:0/4034153836 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f086c060860 0x7f086c062d10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0878006fd0 tx=0x7f0878008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f088fb18740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x26d4ae0 0x29081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f088fb18740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x26d4710 0x2908710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f088fb18740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x271f790 0x290bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f088fb18740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x2880ba0 con 0x271f790 2024-08-17T02:26:48.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f088fb18740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x287cb40 con 0x26d4ae0 2024-08-17T02:26:48.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f088fb18740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x28420a0 con 0x26d4710 2024-08-17T02:26:48.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f08877fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x271f790 0x290bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f08877fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x271f790 0x290bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55176/0 (socket says 172.21.15.102:55176) 2024-08-17T02:26:48.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f08877fe700 1 -- 172.21.15.102:0/1997585500 learned_addr learned my addr 172.21.15.102:0/1997585500 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:48.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f0886ffd700 1 --2- 172.21.15.102:0/1997585500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x26d4ae0 0x29081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f08867fc700 1 --2- 172.21.15.102:0/1997585500 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x26d4710 0x2908710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f08877fe700 1 -- 172.21.15.102:0/1997585500 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x26d4710 msgr2=0x2908710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f08877fe700 1 --2- 172.21.15.102:0/1997585500 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x26d4710 0x2908710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f08877fe700 1 -- 172.21.15.102:0/1997585500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x26d4ae0 msgr2=0x29081d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f08877fe700 1 --2- 172.21.15.102:0/1997585500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x26d4ae0 0x29081d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f08877fe700 1 -- 172.21.15.102:0/1997585500 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x27209e0 con 0x271f790 2024-08-17T02:26:48.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f08877fe700 1 --2- 172.21.15.102:0/1997585500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x271f790 0x290bc60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0880000f80 tx=0x7f0880054040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48e91d985db2b5b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f0877fff700 1 -- 172.21.15.102:0/1997585500 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088000ee60 con 0x271f790 2024-08-17T02:26:48.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f0877fff700 1 -- 172.21.15.102:0/1997585500 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0880051720 con 0x271f790 2024-08-17T02:26:48.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.468+0000 7f0877fff700 1 -- 172.21.15.102:0/1997585500 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880054270 con 0x271f790 2024-08-17T02:26:48.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 -- 172.21.15.102:0/1997585500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x271f790 msgr2=0x290bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 --2- 172.21.15.102:0/1997585500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x271f790 0x290bc60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0880000f80 tx=0x7f0880054040 comp rx=0 tx=0).stop 2024-08-17T02:26:48.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 -- 172.21.15.102:0/1997585500 shutdown_connections 2024-08-17T02:26:48.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 --2- 172.21.15.102:0/1997585500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x271f790 0x290bc60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 --2- 172.21.15.102:0/1997585500 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x26d4710 0x2908710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 --2- 172.21.15.102:0/1997585500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x26d4ae0 0x29081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 -- 172.21.15.102:0/1997585500 >> 172.21.15.102:0/1997585500 conn(0x26d4eb0 msgr2=0x290e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 -- 172.21.15.102:0/1997585500 shutdown_connections 2024-08-17T02:26:48.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 -- 172.21.15.102:0/1997585500 wait complete. 2024-08-17T02:26:48.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 -- start start 2024-08-17T02:26:48.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 Processor -- start 2024-08-17T02:26:48.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x26d4710 0x2955aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x26d4ae0 0x2955fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x271f790 0x290ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x2841d40 con 0x271f790 2024-08-17T02:26:48.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x281a970 con 0x26d4710 2024-08-17T02:26:48.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x27f5cb0 con 0x26d4ae0 2024-08-17T02:26:48.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f088fb18740 10 client.0 _ll_register_callbacks cb 0x281ef00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:26:48.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f08877fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x271f790 0x290ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f08877fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x271f790 0x290ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55182/0 (socket says 172.21.15.102:55182) 2024-08-17T02:26:48.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f08877fe700 1 -- 172.21.15.102:0/3782045208 learned_addr learned my addr 172.21.15.102:0/3782045208 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:48.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f08867fc700 1 --2- 172.21.15.102:0/3782045208 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x26d4ae0 0x2955fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f0886ffd700 1 --2- 172.21.15.102:0/3782045208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x26d4710 0x2955aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f08877fe700 1 -- 172.21.15.102:0/3782045208 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x26d4ae0 msgr2=0x2955fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f08877fe700 1 --2- 172.21.15.102:0/3782045208 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x26d4ae0 0x2955fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f08877fe700 1 -- 172.21.15.102:0/3782045208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x26d4710 msgr2=0x2955aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f08877fe700 1 --2- 172.21.15.102:0/3782045208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x26d4710 0x2955aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f08877fe700 1 -- 172.21.15.102:0/3782045208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08880afbe0 con 0x271f790 2024-08-17T02:26:48.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.472+0000 7f08877fe700 1 --2- 172.21.15.102:0/3782045208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x271f790 0x290ffd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0880007ea0 tx=0x7f0880020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d193e57b443847 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f08757fa700 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-08-17T02:26:48.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f08757fa700 1 -- 172.21.15.102:0/3782045208 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880054270 con 0x271f790 2024-08-17T02:26:48.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f08757fa700 1 -- 172.21.15.102:0/3782045208 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f088004f380 con 0x271f790 2024-08-17T02:26:48.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 1 -- 172.21.15.102:0/3782045208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x26e2260 con 0x271f790 2024-08-17T02:26:48.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f08757fa700 1 -- 172.21.15.102:0/3782045208 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08800484f0 con 0x271f790 2024-08-17T02:26:48.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 10 client.5163 fetch_fsmap learned FSMap version 14 2024-08-17T02:26:48.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 1 -- 172.21.15.102:0/3782045208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x284a370 con 0x271f790 2024-08-17T02:26:48.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f08757fa700 1 -- 172.21.15.102:0/3782045208 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0880079020 con 0x271f790 2024-08-17T02:26:48.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f08757fa700 1 -- 172.21.15.102:0/3782045208 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f088006b120 con 0x271f790 2024-08-17T02:26:48.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 10 client.5163 fetch_fsmap finished waiting for FSMap version 14 2024-08-17T02:26:48.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 10 client.5163 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:26:48.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 20 client.5163 populate_metadata read hostname 'smithi102' 2024-08-17T02:26:48.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 1 --2- 172.21.15.102:0/3782045208 >> [v2:172.21.15.102:6836/1340437033,v1:172.21.15.102:6837/1340437033] conn(0x295ec30 0x2961010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 4 client.5163 mds_command: new command op to 4974 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:26:48.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 1 -- 172.21.15.102:0/3782045208 --> [v2:172.21.15.102:6836/1340437033,v1:172.21.15.102:6837/1340437033] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x272c4e0 con 0x295ec30 2024-08-17T02:26:48.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f0886ffd700 1 --2- 172.21.15.102:0/3782045208 >> [v2:172.21.15.102:6836/1340437033,v1:172.21.15.102:6837/1340437033] conn(0x295ec30 0x2961010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f08757fa700 10 client.5163 ms_handle_connect on v2:172.21.15.102:6836/1340437033 2024-08-17T02:26:48.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f0886ffd700 1 --2- 172.21.15.102:0/3782045208 >> [v2:172.21.15.102:6836/1340437033,v1:172.21.15.102:6837/1340437033] conn(0x295ec30 0x2961010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7902f0237be55a5 server_cookie=10da374a095f2c54 in_seq=0 out_seq=0 2024-08-17T02:26:48.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f08757fa700 1 -- 172.21.15.102:0/3782045208 <== mds.0 v2:172.21.15.102:6836/1340437033 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x272c4e0 con 0x295ec30 2024-08-17T02:26:48.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f08757fa700 10 client.5163 handle_command_reply: tid=0 2024-08-17T02:26:48.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 1 client.5163 shutdown 2024-08-17T02:26:48.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 1 -- 172.21.15.102:0/3782045208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x271f790 msgr2=0x290ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 1 --2- 172.21.15.102:0/3782045208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x271f790 0x290ffd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0880007ea0 tx=0x7f0880020000 comp rx=0 tx=0).stop 2024-08-17T02:26:48.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 1 -- 172.21.15.102:0/3782045208 shutdown_connections 2024-08-17T02:26:48.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 1 --2- 172.21.15.102:0/3782045208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x271f790 0x290ffd0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 1 --2- 172.21.15.102:0/3782045208 >> [v2:172.21.15.102:6836/1340437033,v1:172.21.15.102:6837/1340437033] conn(0x295ec30 0x2961010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 1 --2- 172.21.15.102:0/3782045208 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x26d4ae0 0x2955fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f08757fa700 0 client.5163 ms_handle_reset on v2:172.21.15.102:6836/1340437033 2024-08-17T02:26:48.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 1 --2- 172.21.15.102:0/3782045208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x26d4710 0x2955aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 1 -- 172.21.15.102:0/3782045208 >> 172.21.15.102:0/3782045208 conn(0x26d4eb0 msgr2=0x290dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 1 -- 172.21.15.102:0/3782045208 shutdown_connections 2024-08-17T02:26:48.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 1 -- 172.21.15.102:0/3782045208 wait complete. 2024-08-17T02:26:48.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.476+0000 7f088fb18740 20 client.5163 trim_cache size 0 max 16384 2024-08-17T02:26:48.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 Processor -- start 2024-08-17T02:26:48.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 -- start start 2024-08-17T02:26:48.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x26d4710 0x29a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x26d4ae0 0x29aa070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x271f790 0x29aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x2880640 con 0x26d4710 2024-08-17T02:26:48.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x28b2bb0 con 0x26d4ae0 2024-08-17T02:26:48.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x2882da0 con 0x271f790 2024-08-17T02:26:48.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f0886ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x26d4710 0x29a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f0886ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x26d4710 0x29a9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55196/0 (socket says 172.21.15.102:55196) 2024-08-17T02:26:48.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f0886ffd700 1 -- 172.21.15.102:0/1364431482 learned_addr learned my addr 172.21.15.102:0/1364431482 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:48.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f08877fe700 1 --2- 172.21.15.102:0/1364431482 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x271f790 0x29aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f08867fc700 1 --2- 172.21.15.102:0/1364431482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x26d4ae0 0x29aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f0886ffd700 1 -- 172.21.15.102:0/1364431482 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x271f790 msgr2=0x29aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f0886ffd700 1 --2- 172.21.15.102:0/1364431482 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x271f790 0x29aa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f0886ffd700 1 -- 172.21.15.102:0/1364431482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x26d4ae0 msgr2=0x29aa070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f0886ffd700 1 --2- 172.21.15.102:0/1364431482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x26d4ae0 0x29aa070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f0886ffd700 1 -- 172.21.15.102:0/1364431482 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2830d80 con 0x26d4710 2024-08-17T02:26:48.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f0886ffd700 1 --2- 172.21.15.102:0/1364431482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x26d4710 0x29a9b30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0878006b90 tx=0x7f0878019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97845c1e8768a347 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f087cff9700 1 -- 172.21.15.102:0/1364431482 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087802a1e0 con 0x26d4710 2024-08-17T02:26:48.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f087cff9700 1 -- 172.21.15.102:0/1364431482 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087802ac70 con 0x26d4710 2024-08-17T02:26:48.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f087cff9700 1 -- 172.21.15.102:0/1364431482 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08780166b0 con 0x26d4710 2024-08-17T02:26:48.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 -- 172.21.15.102:0/1364431482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x26d4710 msgr2=0x29a9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 --2- 172.21.15.102:0/1364431482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x26d4710 0x29a9b30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0878006b90 tx=0x7f0878019040 comp rx=0 tx=0).stop 2024-08-17T02:26:48.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 -- 172.21.15.102:0/1364431482 shutdown_connections 2024-08-17T02:26:48.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 --2- 172.21.15.102:0/1364431482 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x271f790 0x29aa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 --2- 172.21.15.102:0/1364431482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x26d4ae0 0x29aa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 --2- 172.21.15.102:0/1364431482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x26d4710 0x29a9b30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 -- 172.21.15.102:0/1364431482 >> 172.21.15.102:0/1364431482 conn(0x26d4eb0 msgr2=0x290e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 -- 172.21.15.102:0/1364431482 shutdown_connections 2024-08-17T02:26:48.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 -- 172.21.15.102:0/1364431482 wait complete. 2024-08-17T02:26:48.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 -- start start 2024-08-17T02:26:48.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.500+0000 7f088fb18740 1 Processor -- start 2024-08-17T02:26:48.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f088fb18740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x26d4710 0x298d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f088fb18740 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x26d4ae0 0x295f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f088fb18740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x271f790 0x295f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f088fb18740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x274d7c0 con 0x26d4710 2024-08-17T02:26:48.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f088fb18740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x2854570 con 0x271f790 2024-08-17T02:26:48.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f088fb18740 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x287f200 con 0x26d4ae0 2024-08-17T02:26:48.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f088fb18740 10 client.0 _ll_register_callbacks cb 0x26a09d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:26:48.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f0886ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x26d4710 0x298d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f0886ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x26d4710 0x298d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55204/0 (socket says 172.21.15.102:55204) 2024-08-17T02:26:48.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f0886ffd700 1 -- 172.21.15.102:0/2128547504 learned_addr learned my addr 172.21.15.102:0/2128547504 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:48.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f08867fc700 1 --2- 172.21.15.102:0/2128547504 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x26d4ae0 0x295f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f08877fe700 1 --2- 172.21.15.102:0/2128547504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x271f790 0x295f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f0886ffd700 1 -- 172.21.15.102:0/2128547504 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x26d4ae0 msgr2=0x295f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f0886ffd700 1 --2- 172.21.15.102:0/2128547504 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x26d4ae0 0x295f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f0886ffd700 1 -- 172.21.15.102:0/2128547504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x271f790 msgr2=0x295f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f0886ffd700 1 --2- 172.21.15.102:0/2128547504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x271f790 0x295f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f0886ffd700 1 -- 172.21.15.102:0/2128547504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087800e040 con 0x26d4710 2024-08-17T02:26:48.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f08877fe700 1 --2- 172.21.15.102:0/2128547504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x271f790 0x295f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:48.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f0886ffd700 1 --2- 172.21.15.102:0/2128547504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x26d4710 0x298d960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f08780075d0 tx=0x7f0878025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d5ffe565cec2f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f08757fa700 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-08-17T02:26:48.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f08757fa700 1 -- 172.21.15.102:0/2128547504 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087802a260 con 0x26d4710 2024-08-17T02:26:48.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f08757fa700 1 -- 172.21.15.102:0/2128547504 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0878038020 con 0x26d4710 2024-08-17T02:26:48.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f088fb18740 1 -- 172.21.15.102:0/2128547504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0880051720 con 0x26d4710 2024-08-17T02:26:48.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f08757fa700 1 -- 172.21.15.102:0/2128547504 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0878016480 con 0x26d4710 2024-08-17T02:26:48.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f088fb18740 10 client.5169 fetch_fsmap learned FSMap version 14 2024-08-17T02:26:48.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f088fb18740 1 -- 172.21.15.102:0/2128547504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x2825130 con 0x26d4710 2024-08-17T02:26:48.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f08757fa700 1 -- 172.21.15.102:0/2128547504 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0880051720 con 0x26d4710 2024-08-17T02:26:48.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f08757fa700 1 -- 172.21.15.102:0/2128547504 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f08780165e0 con 0x26d4710 2024-08-17T02:26:48.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f088fb18740 10 client.5169 fetch_fsmap finished waiting for FSMap version 14 2024-08-17T02:26:48.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f088fb18740 10 client.5169 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:26:48.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f088fb18740 20 client.5169 populate_metadata read hostname 'smithi102' 2024-08-17T02:26:48.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f088fb18740 1 --2- 172.21.15.102:0/2128547504 >> [v2:172.21.15.102:6836/1340437033,v1:172.21.15.102:6837/1340437033] conn(0x29ad540 0x29ad910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f088fb18740 4 client.5169 mds_command: new command op to 4974 tid=0[{"prefix": "status"}] 2024-08-17T02:26:48.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f088fb18740 1 -- 172.21.15.102:0/2128547504 --> [v2:172.21.15.102:6836/1340437033,v1:172.21.15.102:6837/1340437033] -- command(tid 0: {"prefix": "status"}) v1 -- 0x2751260 con 0x29ad540 2024-08-17T02:26:48.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f08867fc700 1 --2- 172.21.15.102:0/2128547504 >> [v2:172.21.15.102:6836/1340437033,v1:172.21.15.102:6837/1340437033] conn(0x29ad540 0x29ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f08757fa700 10 client.5169 ms_handle_connect on v2:172.21.15.102:6836/1340437033 2024-08-17T02:26:48.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.504+0000 7f08867fc700 1 --2- 172.21.15.102:0/2128547504 >> [v2:172.21.15.102:6836/1340437033,v1:172.21.15.102:6837/1340437033] conn(0x29ad540 0x29ad910 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2de568b628e618fc server_cookie=e91c445459267d87 in_seq=0 out_seq=0 2024-08-17T02:26:48.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f08757fa700 1 -- 172.21.15.102:0/2128547504 <== mds.0 v2:172.21.15.102:6836/1340437033 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x2751260 con 0x29ad540 2024-08-17T02:26:48.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f08757fa700 10 client.5169 handle_command_reply: tid=0 2024-08-17T02:26:48.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f088fb18740 1 client.5169 shutdown 2024-08-17T02:26:48.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f088fb18740 1 -- 172.21.15.102:0/2128547504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x26d4710 msgr2=0x298d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f088fb18740 1 --2- 172.21.15.102:0/2128547504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x26d4710 0x298d960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f08780075d0 tx=0x7f0878025000 comp rx=0 tx=0).stop 2024-08-17T02:26:48.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f088fb18740 1 -- 172.21.15.102:0/2128547504 shutdown_connections 2024-08-17T02:26:48.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f088fb18740 1 --2- 172.21.15.102:0/2128547504 >> [v2:172.21.15.102:6836/1340437033,v1:172.21.15.102:6837/1340437033] conn(0x29ad540 0x29ad910 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f088fb18740 1 --2- 172.21.15.102:0/2128547504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x271f790 0x295f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f088fb18740 1 --2- 172.21.15.102:0/2128547504 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x26d4ae0 0x295f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f088fb18740 1 --2- 172.21.15.102:0/2128547504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x26d4710 0x298d960 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f088fb18740 1 -- 172.21.15.102:0/2128547504 >> 172.21.15.102:0/2128547504 conn(0x26d4eb0 msgr2=0x2954570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f08757fa700 0 client.5169 ms_handle_reset on v2:172.21.15.102:6836/1340437033 2024-08-17T02:26:48.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f088fb18740 1 -- 172.21.15.102:0/2128547504 shutdown_connections 2024-08-17T02:26:48.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f088fb18740 1 -- 172.21.15.102:0/2128547504 wait complete. 2024-08-17T02:26:48.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f088fb18740 20 client.5169 trim_cache size 0 max 16384 2024-08-17T02:26:48.515 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-08-17T02:26:48.515 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "0c0c2578-b641-472b-9b35-bef011c543fd", 2024-08-17T02:26:48.515 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 0, 2024-08-17T02:26:48.515 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4974, 2024-08-17T02:26:48.515 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2024-08-17T02:26:48.516 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2024-08-17T02:26:48.516 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2024-08-17T02:26:48.516 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 5.6130656669999999, 2024-08-17T02:26:48.516 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 14, 2024-08-17T02:26:48.516 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 32, 2024-08-17T02:26:48.516 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 32, 2024-08-17T02:26:48.516 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 12.845525531 2024-08-17T02:26:48.516 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-08-17T02:26:48.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f0887fff700 1 -- 172.21.15.102:0/4034153836 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f086c060860 msgr2=0x7f086c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f0887fff700 1 --2- 172.21.15.102:0/4034153836 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f086c060860 0x7f086c062d10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0878006fd0 tx=0x7f0878008040 comp rx=0 tx=0).stop 2024-08-17T02:26:48.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f0887fff700 1 -- 172.21.15.102:0/4034153836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0888154900 msgr2=0x7f088816c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f0887fff700 1 --2- 172.21.15.102:0/4034153836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0888154900 0x7f088816c060 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0880007ed0 tx=0x7f0880009850 comp rx=0 tx=0).stop 2024-08-17T02:26:48.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f0887fff700 1 -- 172.21.15.102:0/4034153836 shutdown_connections 2024-08-17T02:26:48.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f0887fff700 1 --2- 172.21.15.102:0/4034153836 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f086c060860 0x7f086c062d10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f0887fff700 1 --2- 172.21.15.102:0/4034153836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08880cb390 0x7f08880aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f0887fff700 1 --2- 172.21.15.102:0/4034153836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0888154900 0x7f088816c060 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f0887fff700 1 --2- 172.21.15.102:0/4034153836 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f08880b12d0 0x7f08880b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f0887fff700 1 -- 172.21.15.102:0/4034153836 >> 172.21.15.102:0/4034153836 conn(0x7f08880678d0 msgr2=0x7f088806d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f0887fff700 1 -- 172.21.15.102:0/4034153836 shutdown_connections 2024-08-17T02:26:48.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.508+0000 7f0887fff700 1 -- 172.21.15.102:0/4034153836 wait complete. 2024-08-17T02:26:48.528 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:48.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f39473700 1 Processor -- start 2024-08-17T02:26:48.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f39473700 1 -- start start 2024-08-17T02:26:48.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f39473700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2f340a9430 0x7f2f340b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f39473700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f340b0270 con 0x7f2f3415d540 2024-08-17T02:26:48.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f39473700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f340af660 con 0x7f2f340af030 2024-08-17T02:26:48.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f39473700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f340af940 con 0x7f2f340a9430 2024-08-17T02:26:48.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f32ffd700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2f3415d540 0x7f2f3406e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48256/0 (socket says 172.21.15.102:48256) 2024-08-17T02:26:48.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f32ffd700 1 -- 172.21.15.102:0/3883560062 learned_addr learned my addr 172.21.15.102:0/3883560062 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:48.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f337fe700 1 --2- 172.21.15.102:0/3883560062 >> v2:172.21.15.121:3300/0 conn(0x7f2f340a9430 0x7f2f340b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f31ffb700 1 -- 172.21.15.102:0/3883560062 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869797824 0 0) 0x7f2f340b0270 con 0x7f2f3415d540 2024-08-17T02:26:48.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f31ffb700 1 -- 172.21.15.102:0/3883560062 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f20003570 con 0x7f2f3415d540 2024-08-17T02:26:48.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f337fe700 1 -- 172.21.15.102:0/3883560062 >> v1:172.21.15.121:6789/0 conn(0x7f2f340af030 legacy=0x7f2f340a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f337fe700 1 -- 172.21.15.102:0/3883560062 >> v1:172.21.15.102:6789/0 conn(0x7f2f3415d540 legacy=0x7f2f3406e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f337fe700 1 -- 172.21.15.102:0/3883560062 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340afc20 con 0x7f2f340a9430 2024-08-17T02:26:48.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f337fe700 1 --2- 172.21.15.102:0/3883560062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f340a9430 0x7f2f340b0700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c009e60 tx=0x7f2f2c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42b0f77fd5cf145c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f31ffb700 1 -- 172.21.15.102:0/3883560062 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c00e070 con 0x7f2f340a9430 2024-08-17T02:26:48.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f31ffb700 1 -- 172.21.15.102:0/3883560062 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c00bb60 con 0x7f2f340a9430 2024-08-17T02:26:48.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f31ffb700 1 -- 172.21.15.102:0/3883560062 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c012430 con 0x7f2f340a9430 2024-08-17T02:26:48.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f39473700 1 -- 172.21.15.102:0/3883560062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f340a9430 msgr2=0x7f2f340b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f39473700 1 --2- 172.21.15.102:0/3883560062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f340a9430 0x7f2f340b0700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c009e60 tx=0x7f2f2c009780 comp rx=0 tx=0).stop 2024-08-17T02:26:48.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f39473700 1 -- 172.21.15.102:0/3883560062 shutdown_connections 2024-08-17T02:26:48.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f39473700 1 --2- 172.21.15.102:0/3883560062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f340a9430 0x7f2f340b0700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f39473700 1 -- 172.21.15.102:0/3883560062 >> 172.21.15.102:0/3883560062 conn(0x7f2f34066e00 msgr2=0x7f2f34067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f39473700 1 -- 172.21.15.102:0/3883560062 shutdown_connections 2024-08-17T02:26:48.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.640+0000 7f2f39473700 1 -- 172.21.15.102:0/3883560062 wait complete. 2024-08-17T02:26:48.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f39473700 1 Processor -- start 2024-08-17T02:26:48.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f39473700 1 -- start start 2024-08-17T02:26:48.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f39473700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f340a9430 0x7f2f340ad320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f39473700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f340af030 0x7f2f3406d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f39473700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f3415d540 0x7f2f3406dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f39473700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340977c0 con 0x7f2f340af030 2024-08-17T02:26:48.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f39473700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f34096bb0 con 0x7f2f340a9430 2024-08-17T02:26:48.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f39473700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f34096e90 con 0x7f2f3415d540 2024-08-17T02:26:48.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f327fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f340af030 0x7f2f3406d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f32ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f340a9430 0x7f2f340ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f327fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f340af030 0x7f2f3406d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55216/0 (socket says 172.21.15.102:55216) 2024-08-17T02:26:48.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f32ffd700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f340a9430 0x7f2f340ad320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:39302/0 (socket says 172.21.15.102:39302) 2024-08-17T02:26:48.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f327fc700 1 -- 172.21.15.102:0/1239513354 learned_addr learned my addr 172.21.15.102:0/1239513354 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:48.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f337fe700 1 --2- 172.21.15.102:0/1239513354 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f3415d540 0x7f2f3406dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f32ffd700 1 -- 172.21.15.102:0/1239513354 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f3415d540 msgr2=0x7f2f3406dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f32ffd700 1 --2- 172.21.15.102:0/1239513354 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f3415d540 0x7f2f3406dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f32ffd700 1 -- 172.21.15.102:0/1239513354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f340af030 msgr2=0x7f2f3406d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f32ffd700 1 --2- 172.21.15.102:0/1239513354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f340af030 0x7f2f3406d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f32ffd700 1 -- 172.21.15.102:0/1239513354 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c009a20 con 0x7f2f340a9430 2024-08-17T02:26:48.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f32ffd700 1 --2- 172.21.15.102:0/1239513354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f340a9430 0x7f2f340ad320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400c560 tx=0x7f2f24007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f2affd700 1 -- 172.21.15.102:0/1239513354 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f24005b30 con 0x7f2f340a9430 2024-08-17T02:26:48.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f2affd700 1 -- 172.21.15.102:0/1239513354 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f24005cb0 con 0x7f2f340a9430 2024-08-17T02:26:48.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f39473700 1 -- 172.21.15.102:0/1239513354 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f34097170 con 0x7f2f340a9430 2024-08-17T02:26:48.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f2affd700 1 -- 172.21.15.102:0/1239513354 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f24007320 con 0x7f2f340a9430 2024-08-17T02:26:48.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.644+0000 7f2f39473700 1 -- 172.21.15.102:0/1239513354 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f34158b40 con 0x7f2f340a9430 2024-08-17T02:26:48.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.648+0000 7f2f39473700 1 -- 172.21.15.102:0/1239513354 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f340645c0 con 0x7f2f340a9430 2024-08-17T02:26:48.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.648+0000 7f2f2affd700 1 -- 172.21.15.102:0/1239513354 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2f2401b3b0 con 0x7f2f340a9430 2024-08-17T02:26:48.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.648+0000 7f2f2affd700 1 --2- 172.21.15.102:0/1239513354 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2f14060860 0x7f2f14062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.648+0000 7f2f2affd700 1 -- 172.21.15.102:0/1239513354 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f2407bf90 con 0x7f2f340a9430 2024-08-17T02:26:48.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.648+0000 7f2f327fc700 1 --2- 172.21.15.102:0/1239513354 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2f14060860 0x7f2f14062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.648+0000 7f2f327fc700 1 --2- 172.21.15.102:0/1239513354 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2f14060860 0x7f2f14062d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0078a0 tx=0x7f2f1c007830 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.656+0000 7f2f2affd700 1 -- 172.21.15.102:0/1239513354 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2f240ac480 con 0x7f2f340a9430 2024-08-17T02:26:48.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.860+0000 7f2f39473700 1 -- 172.21.15.102:0/1239513354 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2f340a9210 con 0x7f2f340a9430 2024-08-17T02:26:48.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.860+0000 7f2f2affd700 1 -- 172.21.15.102:0/1239513354 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2f24017020 con 0x7f2f340a9430 2024-08-17T02:26:48.865 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:48.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.864+0000 7f2f39473700 1 -- 172.21.15.102:0/1239513354 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2f14060860 msgr2=0x7f2f14062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.864+0000 7f2f39473700 1 --2- 172.21.15.102:0/1239513354 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2f14060860 0x7f2f14062d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0078a0 tx=0x7f2f1c007830 comp rx=0 tx=0).stop 2024-08-17T02:26:48.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.864+0000 7f2f39473700 1 -- 172.21.15.102:0/1239513354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f340a9430 msgr2=0x7f2f340ad320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.864+0000 7f2f39473700 1 --2- 172.21.15.102:0/1239513354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f340a9430 0x7f2f340ad320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400c560 tx=0x7f2f24007d50 comp rx=0 tx=0).stop 2024-08-17T02:26:48.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.864+0000 7f2f39473700 1 -- 172.21.15.102:0/1239513354 shutdown_connections 2024-08-17T02:26:48.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.864+0000 7f2f39473700 1 --2- 172.21.15.102:0/1239513354 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2f14060860 0x7f2f14062d10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.864+0000 7f2f39473700 1 --2- 172.21.15.102:0/1239513354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f340af030 0x7f2f3406d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.864+0000 7f2f39473700 1 --2- 172.21.15.102:0/1239513354 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2f3415d540 0x7f2f3406dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.864+0000 7f2f39473700 1 --2- 172.21.15.102:0/1239513354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f340a9430 0x7f2f340ad320 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.864+0000 7f2f39473700 1 -- 172.21.15.102:0/1239513354 >> 172.21.15.102:0/1239513354 conn(0x7f2f34066e00 msgr2=0x7f2f3415b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.864+0000 7f2f39473700 1 -- 172.21.15.102:0/1239513354 shutdown_connections 2024-08-17T02:26:48.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:48.864+0000 7f2f39473700 1 -- 172.21.15.102:0/1239513354 wait complete. 2024-08-17T02:26:48.884 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:48.884 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:48.884 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-08-17T02:26:48.884 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:26:48.885 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:48.885 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:48.885 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:48.885 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:48.885 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:48.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:48.885 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-08-17T02:26:48.891 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:48.891 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:48.891 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:48.891 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:48.892 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:48.892 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:48.892 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:48.892 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:48.892 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:48.892 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:48.892 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:48.892 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:48.892 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:48.892 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:48.892 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:26:48.892 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42554sec preferred_lft 42554sec 2024-08-17T02:26:48.893 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2024-08-17T02:26:48.893 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:48.893 INFO:teuthology.orchestra.run.smithi102.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:26:48.893 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 02:42:f1:69:1c:f7 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:48.893 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:26:48.893 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:48.893 INFO:teuthology.orchestra.run.smithi102.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:48.893 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 5e:90:cd:23:ef:ed brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:48.893 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:26:48.893 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:48.893 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::20f8:9bff:fee0:c586/64 scope link 2024-08-17T02:26:48.894 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:48.894 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:48.894 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether d2:25:78:af:04:17 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:26:48.894 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::d025:78ff:feaf:417/64 scope link 2024-08-17T02:26:48.894 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:48.894 INFO:teuthology.orchestra.run.smithi102.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:48.894 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 5e:90:cd:23:ef:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:26:48.894 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::5c90:cdff:fe23:efed/64 scope link 2024-08-17T02:26:48.894 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:48.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:48.895 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:48.948 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-08-17T02:26:48.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:48.950 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-08-17T02:26:48.957 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-08-17T02:26:48.957 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:48.957 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:26:48.958 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:48.958 INFO:teuthology.orchestra.run.smithi102.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:26:48.958 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:26:48.958 INFO:teuthology.orchestra.run.smithi102.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:26:48.958 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:48.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:48.958 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2024-08-17T02:26:48.958 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-08-17T02:26:48.959 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:48.959 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:48.959 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:48.959 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-08-17T02:26:48.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:48.998 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-08-17T02:26:49.049 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:26:49.049 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:26:49.049 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:49.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.049 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-08-17T02:26:49.063 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-17T02:26:49.064 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:49.064 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:49.069 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:49.069 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:49.069 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:49.075 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2024-08-17T02:26:49.132 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:49.132 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:49.144 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:49.144 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:49.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:49.145 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2024-08-17T02:26:49.151 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:26:49.151 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-17T02:26:49.153 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2024-08-17T02:26:49.169 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:49.169 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:49.223 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:49.224 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:49.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:49.225 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2024-08-17T02:26:49.234 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2024-08-17T02:26:49.232+0000 7f7fb0441380 -1 init, newargv = 0x5621450e4750 newargc=15 2024-08-17T02:26:49.234 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[33232]: starting ceph client 2024-08-17T02:26:49.241 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[33232]: starting fuse 2024-08-17T02:26:50.331 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2024-08-17T02:26:50.350 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:50.350 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:50.409 INFO:teuthology.orchestra.run.smithi102.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:50.410 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:50.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:50.411 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2024-08-17T02:26:50.418 INFO:teuthology.orchestra.run.smithi102.stdout:52 2024-08-17T02:26:50.418 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:26:50.418 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:26:50.418 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2024-08-17T02:26:50.418 DEBUG:teuthology.orchestra.run.smithi102:> import re 2024-08-17T02:26:50.419 DEBUG:teuthology.orchestra.run.smithi102:> import os 2024-08-17T02:26:50.419 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2024-08-17T02:26:50.419 DEBUG:teuthology.orchestra.run.smithi102:> 2024-08-17T02:26:50.419 DEBUG:teuthology.orchestra.run.smithi102:> def _find_admin_socket(client_name): 2024-08-17T02:26:50.419 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-17T02:26:50.419 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2024-08-17T02:26:50.419 DEBUG:teuthology.orchestra.run.smithi102:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-17T02:26:50.419 DEBUG:teuthology.orchestra.run.smithi102:> 2024-08-17T02:26:50.419 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2024-08-17T02:26:50.419 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2024-08-17T02:26:50.419 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2024-08-17T02:26:50.419 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2024-08-17T02:26:50.419 DEBUG:teuthology.orchestra.run.smithi102:> 2024-08-17T02:26:50.419 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2024-08-17T02:26:50.420 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:26:50.420 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:26:50.420 DEBUG:teuthology.orchestra.run.smithi102:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:26:50.420 DEBUG:teuthology.orchestra.run.smithi102:> contents = proc_f.read() 2024-08-17T02:26:50.420 DEBUG:teuthology.orchestra.run.smithi102:> if mountpoint in contents: 2024-08-17T02:26:50.420 DEBUG:teuthology.orchestra.run.smithi102:> return f 2024-08-17T02:26:50.420 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:26:50.420 DEBUG:teuthology.orchestra.run.smithi102:> 2024-08-17T02:26:50.420 DEBUG:teuthology.orchestra.run.smithi102:> print(_find_admin_socket("client.0")) 2024-08-17T02:26:50.420 DEBUG:teuthology.orchestra.run.smithi102:> ' 2024-08-17T02:26:50.500 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.33232.asok 2024-08-17T02:26:50.685 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33232.asok 2024-08-17T02:26:50.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:50.685 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33232.asok status 2024-08-17T02:26:50.829 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-08-17T02:26:50.830 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2024-08-17T02:26:50.830 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:26:50.830 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:26:50.830 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2024-08-17T02:26:50.830 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2024-08-17T02:26:50.830 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-17T02:26:50.830 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "33232", 2024-08-17T02:26:50.830 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2024-08-17T02:26:50.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:50.830 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2024-08-17T02:26:50.831 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2024-08-17T02:26:50.831 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 5181, 2024-08-17T02:26:50.831 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2024-08-17T02:26:50.831 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2024-08-17T02:26:50.831 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2024-08-17T02:26:50.831 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 5181 2024-08-17T02:26:50.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:50.831 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2024-08-17T02:26:50.831 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-08-17T02:26:50.831 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:26:50.831 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4013711739 2024-08-17T02:26:50.831 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:50.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:50.831 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2024-08-17T02:26:50.832 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-08-17T02:26:50.832 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:26:50.832 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4013711739 2024-08-17T02:26:50.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:50.832 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.5181 192.168.0.1:0/4013711739", 2024-08-17T02:26:50.832 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "192.168.0.1:0/4013711739", 2024-08-17T02:26:50.832 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2024-08-17T02:26:50.832 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 14, 2024-08-17T02:26:50.832 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 32, 2024-08-17T02:26:50.832 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:26:50.832 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklisted": false, 2024-08-17T02:26:50.832 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2024-08-17T02:26:50.832 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-08-17T02:26:50.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:50.839 DEBUG:teuthology.orchestra.run.smithi102:> stat --file-system '--printf=%T 2024-08-17T02:26:50.839 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:50.847 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2024-08-17T02:26:50.847 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:50.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:50.847 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:50.859 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:50.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c2ee96700 1 Processor -- start 2024-08-17T02:26:50.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c2ee96700 1 -- start start 2024-08-17T02:26:50.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c2ee96700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4c280b26d0 0x7f4c280caf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c2ee96700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4c280ccd30 0x7f4c280ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c2ee96700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c280cef60 con 0x7f4c280ceb00 2024-08-17T02:26:50.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c2ee96700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c280cb8d0 con 0x7f4c280ccd30 2024-08-17T02:26:50.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c2ee96700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c280cbbb0 con 0x7f4c280b26d0 2024-08-17T02:26:50.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c27fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4c280ccd30 0x7f4c280ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c27fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4c280ccd30 0x7f4c280ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55228/0 (socket says 172.21.15.102:55228) 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c27fff700 1 -- 172.21.15.102:0/2817574245 learned_addr learned my addr 172.21.15.102:0/2817574245 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c27fff700 1 -- 172.21.15.102:0/2817574245 >> v2:172.21.15.121:3300/0 conn(0x7f4c280b26d0 msgr2=0x7f4c280caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c2cc32700 1 --2- 172.21.15.102:0/2817574245 >> v2:172.21.15.121:3300/0 conn(0x7f4c280b26d0 0x7f4c280caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c27fff700 1 --2- 172.21.15.102:0/2817574245 >> v2:172.21.15.121:3300/0 conn(0x7f4c280b26d0 0x7f4c280caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c27fff700 1 -- 172.21.15.102:0/2817574245 >> v1:172.21.15.102:6789/0 conn(0x7f4c280ceb00 legacy=0x7f4c2815cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c27fff700 1 -- 172.21.15.102:0/2817574245 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c280cbe90 con 0x7f4c280ccd30 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c2cc32700 1 --2- 172.21.15.102:0/2817574245 >> v2:172.21.15.121:3300/0 conn(0x7f4c280b26d0 0x7f4c280caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:50.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c27fff700 1 --2- 172.21.15.102:0/2817574245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280ccd30 0x7f4c280ce5c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4c28088b10 tx=0x7f4c10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf8370e23ed1788 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c277fe700 1 -- 172.21.15.102:0/2817574245 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000b8f0 con 0x7f4c280ccd30 2024-08-17T02:26:50.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c277fe700 1 -- 172.21.15.102:0/2817574245 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1000ba50 con 0x7f4c280ccd30 2024-08-17T02:26:50.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c277fe700 1 -- 172.21.15.102:0/2817574245 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000bdf0 con 0x7f4c280ccd30 2024-08-17T02:26:50.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c2ee96700 1 -- 172.21.15.102:0/2817574245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280ccd30 msgr2=0x7f4c280ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.968+0000 7f4c2ee96700 1 --2- 172.21.15.102:0/2817574245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280ccd30 0x7f4c280ce5c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4c28088b10 tx=0x7f4c10009250 comp rx=0 tx=0).stop 2024-08-17T02:26:50.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2ee96700 1 -- 172.21.15.102:0/2817574245 shutdown_connections 2024-08-17T02:26:50.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2ee96700 1 --2- 172.21.15.102:0/2817574245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280ccd30 0x7f4c280ce5c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2ee96700 1 --2- 172.21.15.102:0/2817574245 >> v2:172.21.15.121:3300/0 conn(0x7f4c280b26d0 0x7f4c280caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2ee96700 1 -- 172.21.15.102:0/2817574245 >> 172.21.15.102:0/2817574245 conn(0x7f4c280994f0 msgr2=0x7f4c28067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:50.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2ee96700 1 -- 172.21.15.102:0/2817574245 shutdown_connections 2024-08-17T02:26:50.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2ee96700 1 -- 172.21.15.102:0/2817574245 wait complete. 2024-08-17T02:26:50.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2ee96700 1 Processor -- start 2024-08-17T02:26:50.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2ee96700 1 -- start start 2024-08-17T02:26:50.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2ee96700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280b26d0 0x7f4c280c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2ee96700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c280ccd30 0x7f4c28152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2ee96700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c280ceb00 0x7f4c2816cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2ee96700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2809a3e0 con 0x7f4c280b26d0 2024-08-17T02:26:50.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2ee96700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280c8e70 con 0x7f4c280ceb00 2024-08-17T02:26:50.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2ee96700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280c88b0 con 0x7f4c280ccd30 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2cc32700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280b26d0 0x7f4c280c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2cc32700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280b26d0 0x7f4c280c9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55234/0 (socket says 172.21.15.102:55234) 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2cc32700 1 -- 172.21.15.102:0/2484230380 learned_addr learned my addr 172.21.15.102:0/2484230380 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c27fff700 1 --2- 172.21.15.102:0/2484230380 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c280ccd30 0x7f4c28152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2d433700 1 --2- 172.21.15.102:0/2484230380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c280ceb00 0x7f4c2816cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2cc32700 1 -- 172.21.15.102:0/2484230380 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c280ccd30 msgr2=0x7f4c28152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2cc32700 1 --2- 172.21.15.102:0/2484230380 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c280ccd30 0x7f4c28152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2cc32700 1 -- 172.21.15.102:0/2484230380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c280ceb00 msgr2=0x7f4c2816cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2cc32700 1 --2- 172.21.15.102:0/2484230380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c280ceb00 0x7f4c2816cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.972+0000 7f4c2cc32700 1 -- 172.21.15.102:0/2484230380 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c100094f0 con 0x7f4c280b26d0 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.976+0000 7f4c2d433700 1 --2- 172.21.15.102:0/2484230380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c280ceb00 0x7f4c2816cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:50.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.976+0000 7f4c2cc32700 1 --2- 172.21.15.102:0/2484230380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280b26d0 0x7f4c280c9430 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800c830 tx=0x7f4c18008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.976+0000 7f4c24ff9700 1 -- 172.21.15.102:0/2484230380 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18011600 con 0x7f4c280b26d0 2024-08-17T02:26:50.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.976+0000 7f4c24ff9700 1 -- 172.21.15.102:0/2484230380 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c18011760 con 0x7f4c280b26d0 2024-08-17T02:26:50.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.976+0000 7f4c2ee96700 1 -- 172.21.15.102:0/2484230380 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c280c8b90 con 0x7f4c280b26d0 2024-08-17T02:26:50.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.976+0000 7f4c24ff9700 1 -- 172.21.15.102:0/2484230380 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18011b20 con 0x7f4c280b26d0 2024-08-17T02:26:50.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.976+0000 7f4c2ee96700 1 -- 172.21.15.102:0/2484230380 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c280c9970 con 0x7f4c280b26d0 2024-08-17T02:26:50.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.976+0000 7f4c24ff9700 1 -- 172.21.15.102:0/2484230380 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4c180193b0 con 0x7f4c280b26d0 2024-08-17T02:26:50.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.976+0000 7f4c2ee96700 1 -- 172.21.15.102:0/2484230380 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c280645c0 con 0x7f4c280b26d0 2024-08-17T02:26:50.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.976+0000 7f4c24ff9700 1 --2- 172.21.15.102:0/2484230380 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4c0c060860 0x7f4c0c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.980+0000 7f4c24ff9700 1 -- 172.21.15.102:0/2484230380 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c1807cc10 con 0x7f4c280b26d0 2024-08-17T02:26:50.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.980+0000 7f4c27fff700 1 --2- 172.21.15.102:0/2484230380 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4c0c060860 0x7f4c0c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.980+0000 7f4c27fff700 1 --2- 172.21.15.102:0/2484230380 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4c0c060860 0x7f4c0c062d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4c28088b10 tx=0x7f4c10017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:50.984+0000 7f4c24ff9700 1 -- 172.21.15.102:0/2484230380 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4c1804d060 con 0x7f4c280b26d0 2024-08-17T02:26:51.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:51.184+0000 7f4c2ee96700 1 -- 172.21.15.102:0/2484230380 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4c280cd6b0 con 0x7f4c280b26d0 2024-08-17T02:26:51.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:51.184+0000 7f4c24ff9700 1 -- 172.21.15.102:0/2484230380 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4c18050680 con 0x7f4c280b26d0 2024-08-17T02:26:51.189 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:51.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:51.188+0000 7f4c2ee96700 1 -- 172.21.15.102:0/2484230380 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4c0c060860 msgr2=0x7f4c0c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:51.188+0000 7f4c2ee96700 1 --2- 172.21.15.102:0/2484230380 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4c0c060860 0x7f4c0c062d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4c28088b10 tx=0x7f4c10017000 comp rx=0 tx=0).stop 2024-08-17T02:26:51.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:51.188+0000 7f4c2ee96700 1 -- 172.21.15.102:0/2484230380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280b26d0 msgr2=0x7f4c280c9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:51.188+0000 7f4c2ee96700 1 --2- 172.21.15.102:0/2484230380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280b26d0 0x7f4c280c9430 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800c830 tx=0x7f4c18008040 comp rx=0 tx=0).stop 2024-08-17T02:26:51.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:51.188+0000 7f4c2ee96700 1 -- 172.21.15.102:0/2484230380 shutdown_connections 2024-08-17T02:26:51.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:51.188+0000 7f4c2ee96700 1 --2- 172.21.15.102:0/2484230380 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4c0c060860 0x7f4c0c062d10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:51.188+0000 7f4c2ee96700 1 --2- 172.21.15.102:0/2484230380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c280ceb00 0x7f4c2816cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:51.188+0000 7f4c2ee96700 1 --2- 172.21.15.102:0/2484230380 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c280ccd30 0x7f4c28152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:51.188+0000 7f4c2ee96700 1 --2- 172.21.15.102:0/2484230380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280b26d0 0x7f4c280c9430 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:51.188+0000 7f4c2ee96700 1 -- 172.21.15.102:0/2484230380 >> 172.21.15.102:0/2484230380 conn(0x7f4c280994f0 msgr2=0x7f4c28068670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:51.188+0000 7f4c2ee96700 1 -- 172.21.15.102:0/2484230380 shutdown_connections 2024-08-17T02:26:51.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:51.188+0000 7f4c2ee96700 1 -- 172.21.15.102:0/2484230380 wait complete. 2024-08-17T02:26:51.202 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:51.202 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:51.202 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-08-17T02:26:51.202 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:26:51.203 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:51.203 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:51.203 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:51.203 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:51.203 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:26:51.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:51.203 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-08-17T02:26:51.212 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:51.212 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:51.212 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:51.212 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.212 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:51.212 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.212 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:51.212 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:51.212 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:51.213 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:51.213 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:51.213 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:51.213 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:51.213 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:51.213 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:26:51.213 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42561sec preferred_lft 42561sec 2024-08-17T02:26:51.213 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link 2024-08-17T02:26:51.213 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.213 INFO:teuthology.orchestra.run.smithi121.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:26:51.213 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 02:42:b7:03:fd:58 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:51.213 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:26:51.213 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.213 INFO:teuthology.orchestra.run.smithi121.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:51.213 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 22:76:53:14:ab:33 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:51.214 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:26:51.214 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.214 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::f487:1dff:fe5e:1539/64 scope link 2024-08-17T02:26:51.214 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.214 INFO:teuthology.orchestra.run.smithi121.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:51.214 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether da:87:b7:be:45:fe brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:26:51.214 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::d887:b7ff:febe:45fe/64 scope link 2024-08-17T02:26:51.214 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.214 INFO:teuthology.orchestra.run.smithi121.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:51.214 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 22:76:53:14:ab:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:26:51.214 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::2076:53ff:fe14:ab33/64 scope link 2024-08-17T02:26:51.214 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:51.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:51.215 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:51.271 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-08-17T02:26:51.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:51.272 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-08-17T02:26:51.281 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-08-17T02:26:51.281 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:51.281 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:26:51.282 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:51.282 INFO:teuthology.orchestra.run.smithi121.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:26:51.282 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:26:51.282 INFO:teuthology.orchestra.run.smithi121.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:26:51.282 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:51.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:51.282 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec bash -c ' 2024-08-17T02:26:51.282 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-08-17T02:26:51.282 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:51.282 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:51.282 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:51.283 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-08-17T02:26:51.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:51.320 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-08-17T02:26:51.327 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:26:51.327 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:26:51.328 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:26:51.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:51.328 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-08-17T02:26:51.385 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-17T02:26:51.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:51.385 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:51.389 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:26:51.390 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:51.390 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:51.396 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-08-17T02:26:51.459 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:51.460 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:51.472 INFO:teuthology.orchestra.run.smithi121.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:51.473 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:51.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:51.473 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-08-17T02:26:51.480 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:26:51.480 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-17T02:26:51.483 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-08-17T02:26:51.497 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:51.497 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:51.553 INFO:teuthology.orchestra.run.smithi121.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:51.554 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:51.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:51.554 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-08-17T02:26:51.562 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:2024-08-17T02:26:51.560+0000 7f505b3ad380 -1 init, newargv = 0x5583dfb9d690 newargc=15 2024-08-17T02:26:51.563 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[29504]: starting ceph client 2024-08-17T02:26:51.572 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[29504]: starting fuse 2024-08-17T02:26:52.663 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-08-17T02:26:52.680 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:52.680 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:52.736 INFO:teuthology.orchestra.run.smithi121.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:52.737 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:52.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:52.738 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-08-17T02:26:52.745 INFO:teuthology.orchestra.run.smithi121.stdout:52 2024-08-17T02:26:52.745 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:26:52.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:26:52.746 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-08-17T02:26:52.746 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-08-17T02:26:52.746 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-08-17T02:26:52.746 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-08-17T02:26:52.746 DEBUG:teuthology.orchestra.run.smithi121:> 2024-08-17T02:26:52.746 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-08-17T02:26:52.746 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-17T02:26:52.746 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-08-17T02:26:52.746 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-17T02:26:52.746 DEBUG:teuthology.orchestra.run.smithi121:> 2024-08-17T02:26:52.746 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-08-17T02:26:52.747 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-08-17T02:26:52.747 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-08-17T02:26:52.747 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-08-17T02:26:52.747 DEBUG:teuthology.orchestra.run.smithi121:> 2024-08-17T02:26:52.747 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-08-17T02:26:52.747 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:26:52.747 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:26:52.747 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:26:52.747 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-08-17T02:26:52.747 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-08-17T02:26:52.747 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-08-17T02:26:52.747 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:26:52.747 DEBUG:teuthology.orchestra.run.smithi121:> 2024-08-17T02:26:52.747 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-08-17T02:26:52.747 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-08-17T02:26:52.828 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.29504.asok 2024-08-17T02:26:53.014 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.29504.asok 2024-08-17T02:26:53.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:53.015 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.29504.asok status 2024-08-17T02:26:53.106 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-17T02:26:53.107 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-08-17T02:26:53.107 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:26:53.107 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:26:53.107 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "1", 2024-08-17T02:26:53.107 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-08-17T02:26:53.107 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-17T02:26:53.107 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "29504", 2024-08-17T02:26:53.107 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-08-17T02:26:53.107 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-17T02:26:53.107 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-08-17T02:26:53.107 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-08-17T02:26:53.107 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4832, 2024-08-17T02:26:53.107 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-08-17T02:26:53.108 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-08-17T02:26:53.108 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-08-17T02:26:53.108 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4832 2024-08-17T02:26:53.108 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-17T02:26:53.108 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-08-17T02:26:53.108 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-08-17T02:26:53.108 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:26:53.108 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 1521012960 2024-08-17T02:26:53.108 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-17T02:26:53.108 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-17T02:26:53.108 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-08-17T02:26:53.108 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-08-17T02:26:53.108 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:26:53.108 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 1521012960 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4832 192.168.0.1:0/1521012960", 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.1:0/1521012960", 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 14, 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 32, 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-17T02:26:53.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:53.115 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-08-17T02:26:53.116 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:53.121 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-08-17T02:26:53.121 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:53.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:53.121 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:53.135 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:26:53.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.256+0000 7ff5f21a5700 1 Processor -- start 2024-08-17T02:26:53.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.256+0000 7ff5f21a5700 1 -- start start 2024-08-17T02:26:53.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f21a5700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff5ec0ce640 0x7ff5ec0b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f21a5700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff5ec0cc400 0x7ff5ec0c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f21a5700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ec0c5bb0 con 0x7ff5ec0cea10 2024-08-17T02:26:53.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f21a5700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ec0c4fa0 con 0x7ff5ec0ce640 2024-08-17T02:26:53.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f21a5700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ec0c5280 con 0x7ff5ec0cc400 2024-08-17T02:26:53.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f11a3700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff5ec0ce640 0x7ff5ec0b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f11a3700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff5ec0ce640 0x7ff5ec0b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43610/0 (socket says 172.21.15.102:43610) 2024-08-17T02:26:53.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f09a2700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff5ec0cea10 0x7ff5ec0cbcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:38520/0 (socket says 172.21.15.102:38520) 2024-08-17T02:26:53.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f11a3700 1 -- 172.21.15.102:0/85814367 learned_addr learned my addr 172.21.15.102:0/85814367 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:53.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f19a4700 1 --2- 172.21.15.102:0/85814367 >> v2:172.21.15.121:3300/0 conn(0x7ff5ec0cc400 0x7ff5ec0c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f11a3700 1 -- 172.21.15.102:0/85814367 >> v2:172.21.15.121:3300/0 conn(0x7ff5ec0cc400 msgr2=0x7ff5ec0c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f11a3700 1 --2- 172.21.15.102:0/85814367 >> v2:172.21.15.121:3300/0 conn(0x7ff5ec0cc400 0x7ff5ec0c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f11a3700 1 -- 172.21.15.102:0/85814367 >> v1:172.21.15.102:6789/0 conn(0x7ff5ec0cea10 legacy=0x7ff5ec0cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f11a3700 1 -- 172.21.15.102:0/85814367 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec0c5560 con 0x7ff5ec0ce640 2024-08-17T02:26:53.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5ebfff700 1 -- 172.21.15.102:0/85814367 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374229495 0 0) 0x7ff5ec0c5bb0 con 0x7ff5ec0cea10 2024-08-17T02:26:53.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f11a3700 1 --2- 172.21.15.102:0/85814367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5ec0ce640 0x7ff5ec0b2e70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0710b0 tx=0x7ff5dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa156dd3c1690df1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5ebfff700 1 -- 172.21.15.102:0/85814367 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc009e70 con 0x7ff5ec0ce640 2024-08-17T02:26:53.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5ebfff700 1 -- 172.21.15.102:0/85814367 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc00b860 con 0x7ff5ec0ce640 2024-08-17T02:26:53.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5ebfff700 1 -- 172.21.15.102:0/85814367 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc00bc00 con 0x7ff5ec0ce640 2024-08-17T02:26:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f21a5700 1 -- 172.21.15.102:0/85814367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5ec0ce640 msgr2=0x7ff5ec0b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f21a5700 1 --2- 172.21.15.102:0/85814367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5ec0ce640 0x7ff5ec0b2e70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0710b0 tx=0x7ff5dc009250 comp rx=0 tx=0).stop 2024-08-17T02:26:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f21a5700 1 -- 172.21.15.102:0/85814367 shutdown_connections 2024-08-17T02:26:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f21a5700 1 --2- 172.21.15.102:0/85814367 >> v2:172.21.15.121:3300/0 conn(0x7ff5ec0cc400 0x7ff5ec0c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f21a5700 1 --2- 172.21.15.102:0/85814367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5ec0ce640 0x7ff5ec0b2e70 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f21a5700 1 -- 172.21.15.102:0/85814367 >> 172.21.15.102:0/85814367 conn(0x7ff5ec099410 msgr2=0x7ff5ec0675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f21a5700 1 -- 172.21.15.102:0/85814367 shutdown_connections 2024-08-17T02:26:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.260+0000 7ff5f21a5700 1 -- 172.21.15.102:0/85814367 wait complete. 2024-08-17T02:26:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f21a5700 1 Processor -- start 2024-08-17T02:26:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f21a5700 1 -- start start 2024-08-17T02:26:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f21a5700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5ec0cc400 0x7ff5ec151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f21a5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5ec0ce640 0x7ff5ec0c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f21a5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5ec0cea10 0x7ff5ec0b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f21a5700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec152ca0 con 0x7ff5ec0cea10 2024-08-17T02:26:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f21a5700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec0c7b60 con 0x7ff5ec0ce640 2024-08-17T02:26:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f21a5700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec0c7e40 con 0x7ff5ec0cc400 2024-08-17T02:26:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f19a4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5ec0cea10 0x7ff5ec0b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f19a4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5ec0cea10 0x7ff5ec0b5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43618/0 (socket says 172.21.15.102:43618) 2024-08-17T02:26:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f19a4700 1 -- 172.21.15.102:0/3490841893 learned_addr learned my addr 172.21.15.102:0/3490841893 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f11a3700 1 --2- 172.21.15.102:0/3490841893 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5ec0cc400 0x7ff5ec151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f09a2700 1 --2- 172.21.15.102:0/3490841893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5ec0ce640 0x7ff5ec0c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f19a4700 1 -- 172.21.15.102:0/3490841893 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5ec0cc400 msgr2=0x7ff5ec151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f19a4700 1 --2- 172.21.15.102:0/3490841893 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5ec0cc400 0x7ff5ec151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f19a4700 1 -- 172.21.15.102:0/3490841893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5ec0ce640 msgr2=0x7ff5ec0c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f19a4700 1 --2- 172.21.15.102:0/3490841893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5ec0ce640 0x7ff5ec0c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f19a4700 1 -- 172.21.15.102:0/3490841893 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc0094f0 con 0x7ff5ec0cea10 2024-08-17T02:26:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f19a4700 1 --2- 172.21.15.102:0/3490841893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5ec0cea10 0x7ff5ec0b5400 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009e90 tx=0x7ff5e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5e97fa700 1 -- 172.21.15.102:0/3490841893 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e400cb70 con 0x7ff5ec0cea10 2024-08-17T02:26:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5e97fa700 1 -- 172.21.15.102:0/3490841893 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e400f040 con 0x7ff5ec0cea10 2024-08-17T02:26:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f21a5700 1 -- 172.21.15.102:0/3490841893 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ec0c8120 con 0x7ff5ec0cea10 2024-08-17T02:26:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5e97fa700 1 -- 172.21.15.102:0/3490841893 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4014480 con 0x7ff5ec0cea10 2024-08-17T02:26:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.264+0000 7ff5f21a5700 1 -- 172.21.15.102:0/3490841893 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ec152190 con 0x7ff5ec0cea10 2024-08-17T02:26:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.268+0000 7ff5f21a5700 1 -- 172.21.15.102:0/3490841893 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ec152a70 con 0x7ff5ec0cea10 2024-08-17T02:26:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.268+0000 7ff5e97fa700 1 -- 172.21.15.102:0/3490841893 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff5e4014830 con 0x7ff5ec0cea10 2024-08-17T02:26:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.268+0000 7ff5e97fa700 1 --2- 172.21.15.102:0/3490841893 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff5d8060860 0x7ff5d8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.268+0000 7ff5f11a3700 1 --2- 172.21.15.102:0/3490841893 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff5d8060860 0x7ff5d8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.268+0000 7ff5e97fa700 1 -- 172.21.15.102:0/3490841893 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff5e407d580 con 0x7ff5ec0cea10 2024-08-17T02:26:53.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.268+0000 7ff5f11a3700 1 --2- 172.21.15.102:0/3490841893 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff5d8060860 0x7ff5d8062d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0710b0 tx=0x7ff5dc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.276+0000 7ff5e97fa700 1 -- 172.21.15.102:0/3490841893 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff5ec152a70 con 0x7ff5ec0cea10 2024-08-17T02:26:53.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:53.476+0000 7ff5f21a5700 1 -- 172.21.15.102:0/3490841893 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff5ec152a70 con 0x7ff5ec0cea10 2024-08-17T02:26:54.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.264+0000 7ff5e97fa700 1 -- 172.21.15.102:0/3490841893 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 136+0+0 (secure 0 0 0) 0x7ff5ec152a70 con 0x7ff5ec0cea10 2024-08-17T02:26:54.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.268+0000 7ff5f21a5700 1 -- 172.21.15.102:0/3490841893 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff5d8060860 msgr2=0x7ff5d8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.268+0000 7ff5f21a5700 1 --2- 172.21.15.102:0/3490841893 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff5d8060860 0x7ff5d8062d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0710b0 tx=0x7ff5dc017000 comp rx=0 tx=0).stop 2024-08-17T02:26:54.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.268+0000 7ff5f21a5700 1 -- 172.21.15.102:0/3490841893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5ec0cea10 msgr2=0x7ff5ec0b5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.268+0000 7ff5f21a5700 1 --2- 172.21.15.102:0/3490841893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5ec0cea10 0x7ff5ec0b5400 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009e90 tx=0x7ff5e400b040 comp rx=0 tx=0).stop 2024-08-17T02:26:54.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.268+0000 7ff5f21a5700 1 -- 172.21.15.102:0/3490841893 shutdown_connections 2024-08-17T02:26:54.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.268+0000 7ff5f21a5700 1 --2- 172.21.15.102:0/3490841893 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff5d8060860 0x7ff5d8062d10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.268+0000 7ff5f21a5700 1 --2- 172.21.15.102:0/3490841893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5ec0cea10 0x7ff5ec0b5400 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.268+0000 7ff5f21a5700 1 --2- 172.21.15.102:0/3490841893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5ec0ce640 0x7ff5ec0c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.268+0000 7ff5f21a5700 1 --2- 172.21.15.102:0/3490841893 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff5ec0cc400 0x7ff5ec151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.268+0000 7ff5f21a5700 1 -- 172.21.15.102:0/3490841893 >> 172.21.15.102:0/3490841893 conn(0x7ff5ec099410 msgr2=0x7ff5ec069590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.268+0000 7ff5f21a5700 1 -- 172.21.15.102:0/3490841893 shutdown_connections 2024-08-17T02:26:54.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.268+0000 7ff5f21a5700 1 -- 172.21.15.102:0/3490841893 wait complete. 2024-08-17T02:26:54.285 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:26:54.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ffc8b6700 1 Processor -- start 2024-08-17T02:26:54.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ffc8b6700 1 -- start start 2024-08-17T02:26:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ffc8b6700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ff80b0d20 0x7f0ff806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ffc8b6700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0ff806e450 0x7f0ff80b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ffc8b6700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff8141a00 con 0x7f0ff80b1630 2024-08-17T02:26:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ffc8b6700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff806e8a0 con 0x7f0ff806e450 2024-08-17T02:26:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ffc8b6700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8140b10 con 0x7f0ff80b0d20 2024-08-17T02:26:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ff6d9d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ff80b0d20 0x7f0ff806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ff659c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0ff806e450 0x7f0ff80b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ff6d9d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ff80b0d20 0x7f0ff806df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:48574/0 (socket says 172.21.15.102:48574) 2024-08-17T02:26:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ff6d9d700 1 -- 172.21.15.102:0/1031741696 learned_addr learned my addr 172.21.15.102:0/1031741696 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:54.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ff659c700 1 -- 172.21.15.102:0/1031741696 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ff80b0d20 msgr2=0x7f0ff806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:54.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ff659c700 1 --2- 172.21.15.102:0/1031741696 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ff80b0d20 0x7f0ff806df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ff659c700 1 -- 172.21.15.102:0/1031741696 >> v1:172.21.15.121:6789/0 conn(0x7f0ff80b1630 legacy=0x7f0ff81610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ff659c700 1 -- 172.21.15.102:0/1031741696 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff8140df0 con 0x7f0ff806e450 2024-08-17T02:26:54.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ff6d9d700 1 --2- 172.21.15.102:0/1031741696 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ff80b0d20 0x7f0ff806df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:54.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ff659c700 1 --2- 172.21.15.102:0/1031741696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff806e450 0x7f0ff80b10f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009e60 tx=0x7f0ff0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=298b423cc526c8e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ff5d9b700 1 -- 172.21.15.102:0/1031741696 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff000e070 con 0x7f0ff806e450 2024-08-17T02:26:54.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ff5d9b700 1 -- 172.21.15.102:0/1031741696 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff000bb60 con 0x7f0ff806e450 2024-08-17T02:26:54.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.396+0000 7f0ff5d9b700 1 -- 172.21.15.102:0/1031741696 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0012430 con 0x7f0ff806e450 2024-08-17T02:26:54.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ffc8b6700 1 -- 172.21.15.102:0/1031741696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff806e450 msgr2=0x7f0ff80b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ffc8b6700 1 --2- 172.21.15.102:0/1031741696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff806e450 0x7f0ff80b10f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009e60 tx=0x7f0ff0009780 comp rx=0 tx=0).stop 2024-08-17T02:26:54.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ffc8b6700 1 -- 172.21.15.102:0/1031741696 shutdown_connections 2024-08-17T02:26:54.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ffc8b6700 1 --2- 172.21.15.102:0/1031741696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff806e450 0x7f0ff80b10f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ffc8b6700 1 --2- 172.21.15.102:0/1031741696 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ff80b0d20 0x7f0ff806df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ffc8b6700 1 -- 172.21.15.102:0/1031741696 >> 172.21.15.102:0/1031741696 conn(0x7f0ff80678d0 msgr2=0x7f0ff8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ffc8b6700 1 -- 172.21.15.102:0/1031741696 shutdown_connections 2024-08-17T02:26:54.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ffc8b6700 1 -- 172.21.15.102:0/1031741696 wait complete. 2024-08-17T02:26:54.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ffc8b6700 1 Processor -- start 2024-08-17T02:26:54.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ffc8b6700 1 -- start start 2024-08-17T02:26:54.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ffc8b6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ff806e450 0x7f0ff80adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ffc8b6700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ff80b0d20 0x7f0ff8069e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ffc8b6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff80b1630 0x7f0ff806a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ffc8b6700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8069290 con 0x7f0ff806e450 2024-08-17T02:26:54.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ffc8b6700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80ae230 con 0x7f0ff80b1630 2024-08-17T02:26:54.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ffc8b6700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff816f510 con 0x7f0ff80b0d20 2024-08-17T02:26:54.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ff6d9d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ff806e450 0x7f0ff80adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ff659c700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ff80b0d20 0x7f0ff8069e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ff6d9d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ff806e450 0x7f0ff80adcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43622/0 (socket says 172.21.15.102:43622) 2024-08-17T02:26:54.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ff6d9d700 1 -- 172.21.15.102:0/251082462 learned_addr learned my addr 172.21.15.102:0/251082462 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:54.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.400+0000 7f0ff759e700 1 --2- 172.21.15.102:0/251082462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff80b1630 0x7f0ff806a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0ff6d9d700 1 -- 172.21.15.102:0/251082462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ff80b0d20 msgr2=0x7f0ff8069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0ff6d9d700 1 --2- 172.21.15.102:0/251082462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ff80b0d20 0x7f0ff8069e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0ff6d9d700 1 -- 172.21.15.102:0/251082462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff80b1630 msgr2=0x7f0ff806a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0ff6d9d700 1 --2- 172.21.15.102:0/251082462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff80b1630 0x7f0ff806a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0ff6d9d700 1 -- 172.21.15.102:0/251082462 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe00094f0 con 0x7f0ff806e450 2024-08-17T02:26:54.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0ff659c700 1 --2- 172.21.15.102:0/251082462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ff80b0d20 0x7f0ff8069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:54.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0ff6d9d700 1 --2- 172.21.15.102:0/251082462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ff806e450 0x7f0ff80adcf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000ec50 tx=0x7f0fe0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0feeffd700 1 -- 172.21.15.102:0/251082462 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe000c850 con 0x7f0ff806e450 2024-08-17T02:26:54.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0ffc8b6700 1 -- 172.21.15.102:0/251082462 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff0009a20 con 0x7f0ff806e450 2024-08-17T02:26:54.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0feeffd700 1 -- 172.21.15.102:0/251082462 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe000c9b0 con 0x7f0ff806e450 2024-08-17T02:26:54.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0feeffd700 1 -- 172.21.15.102:0/251082462 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe000cd50 con 0x7f0ff806e450 2024-08-17T02:26:54.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0ffc8b6700 1 -- 172.21.15.102:0/251082462 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff816fb50 con 0x7f0ff806e450 2024-08-17T02:26:54.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0ffc8b6700 1 -- 172.21.15.102:0/251082462 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff80643a0 con 0x7f0ff806e450 2024-08-17T02:26:54.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0feeffd700 1 -- 172.21.15.102:0/251082462 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0fe0013680 con 0x7f0ff806e450 2024-08-17T02:26:54.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0feeffd700 1 --2- 172.21.15.102:0/251082462 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0fd8060860 0x7f0fd8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0feeffd700 1 -- 172.21.15.102:0/251082462 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0fe007d2b0 con 0x7f0ff806e450 2024-08-17T02:26:54.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.404+0000 7f0ff659c700 1 --2- 172.21.15.102:0/251082462 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0fd8060860 0x7f0fd8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.408+0000 7f0ff659c700 1 --2- 172.21.15.102:0/251082462 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0fd8060860 0x7f0fd8062d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00097c0 tx=0x7f0ff0019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.416+0000 7f0feeffd700 1 -- 172.21.15.102:0/251082462 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0fe004d700 con 0x7f0ff806e450 2024-08-17T02:26:54.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.600+0000 7f0ffc8b6700 1 -- 172.21.15.102:0/251082462 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ff81439d0 con 0x7f0fd8060860 2024-08-17T02:26:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.604+0000 7f0feeffd700 1 -- 172.21.15.102:0/251082462 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f0ff81439d0 con 0x7f0fd8060860 2024-08-17T02:26:54.607 INFO:teuthology.orchestra.run.smithi102.stdout:[ 2024-08-17T02:26:54.607 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:54.607 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cephfs" 2024-08-17T02:26:54.607 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:54.607 INFO:teuthology.orchestra.run.smithi102.stdout:] 2024-08-17T02:26:54.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.604+0000 7f0ffc8b6700 1 -- 172.21.15.102:0/251082462 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0fd8060860 msgr2=0x7f0fd8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.604+0000 7f0ffc8b6700 1 --2- 172.21.15.102:0/251082462 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0fd8060860 0x7f0fd8062d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00097c0 tx=0x7f0ff0019000 comp rx=0 tx=0).stop 2024-08-17T02:26:54.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.604+0000 7f0ffc8b6700 1 -- 172.21.15.102:0/251082462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ff806e450 msgr2=0x7f0ff80adcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.604+0000 7f0ffc8b6700 1 --2- 172.21.15.102:0/251082462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ff806e450 0x7f0ff80adcf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000ec50 tx=0x7f0fe0009250 comp rx=0 tx=0).stop 2024-08-17T02:26:54.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.604+0000 7f0ffc8b6700 1 -- 172.21.15.102:0/251082462 shutdown_connections 2024-08-17T02:26:54.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.604+0000 7f0ffc8b6700 1 --2- 172.21.15.102:0/251082462 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f0fd8060860 0x7f0fd8062d10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.604+0000 7f0ffc8b6700 1 --2- 172.21.15.102:0/251082462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ff80b1630 0x7f0ff806a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.604+0000 7f0ffc8b6700 1 --2- 172.21.15.102:0/251082462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f0ff80b0d20 0x7f0ff8069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.604+0000 7f0ffc8b6700 1 --2- 172.21.15.102:0/251082462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ff806e450 0x7f0ff80adcf0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.604+0000 7f0ffc8b6700 1 -- 172.21.15.102:0/251082462 >> 172.21.15.102:0/251082462 conn(0x7f0ff80678d0 msgr2=0x7f0ff815db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.604+0000 7f0ffc8b6700 1 -- 172.21.15.102:0/251082462 shutdown_connections 2024-08-17T02:26:54.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.604+0000 7f0ffc8b6700 1 -- 172.21.15.102:0/251082462 wait complete. 2024-08-17T02:26:54.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:26:54.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.736+0000 7fc745e9d700 1 Processor -- start 2024-08-17T02:26:54.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.736+0000 7fc745e9d700 1 -- start start 2024-08-17T02:26:54.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.736+0000 7fc745e9d700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc7400cfb00 0x7fc740067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.736+0000 7fc745e9d700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7400cf670 con 0x7fc740158cc0 2024-08-17T02:26:54.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.736+0000 7fc745e9d700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7400cea60 con 0x7fc740067030 2024-08-17T02:26:54.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.736+0000 7fc745e9d700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7400ced40 con 0x7fc7400cfb00 2024-08-17T02:26:54.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc74569c700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc740158cc0 0x7fc7401590d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:38534/0 (socket says 172.21.15.102:38534) 2024-08-17T02:26:54.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc74569c700 1 -- 172.21.15.102:0/1835315140 learned_addr learned my addr 172.21.15.102:0/1835315140 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:54.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc73ffff700 1 --2- 172.21.15.102:0/1835315140 >> v2:172.21.15.102:3300/0 conn(0x7fc7400cfb00 0x7fc740067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc73f7fe700 1 -- 172.21.15.102:0/1835315140 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426476430 0 0) 0x7fc7400cf670 con 0x7fc740158cc0 2024-08-17T02:26:54.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc73f7fe700 1 -- 172.21.15.102:0/1835315140 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc728003570 con 0x7fc740158cc0 2024-08-17T02:26:54.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc73ffff700 1 -- 172.21.15.102:0/1835315140 >> v1:172.21.15.121:6789/0 conn(0x7fc740067030 legacy=0x7fc7400cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc73ffff700 1 -- 172.21.15.102:0/1835315140 >> v1:172.21.15.102:6789/0 conn(0x7fc740158cc0 legacy=0x7fc7401590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc73ffff700 1 -- 172.21.15.102:0/1835315140 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7400cf020 con 0x7fc7400cfb00 2024-08-17T02:26:54.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc73ffff700 1 --2- 172.21.15.102:0/1835315140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7400cfb00 0x7fc740067400 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc7300098e0 tx=0x7fc7300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514042c15ebdaa60 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc73f7fe700 1 -- 172.21.15.102:0/1835315140 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73000b640 con 0x7fc7400cfb00 2024-08-17T02:26:54.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc73f7fe700 1 -- 172.21.15.102:0/1835315140 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73000b7a0 con 0x7fc7400cfb00 2024-08-17T02:26:54.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc73f7fe700 1 -- 172.21.15.102:0/1835315140 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73000bb40 con 0x7fc7400cfb00 2024-08-17T02:26:54.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc745e9d700 1 -- 172.21.15.102:0/1835315140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7400cfb00 msgr2=0x7fc740067400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc745e9d700 1 --2- 172.21.15.102:0/1835315140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7400cfb00 0x7fc740067400 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc7300098e0 tx=0x7fc7300091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc745e9d700 1 -- 172.21.15.102:0/1835315140 shutdown_connections 2024-08-17T02:26:54.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc745e9d700 1 --2- 172.21.15.102:0/1835315140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7400cfb00 0x7fc740067400 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc745e9d700 1 -- 172.21.15.102:0/1835315140 >> 172.21.15.102:0/1835315140 conn(0x7fc7400d0b50 msgr2=0x7fc7400ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc745e9d700 1 -- 172.21.15.102:0/1835315140 shutdown_connections 2024-08-17T02:26:54.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.740+0000 7fc745e9d700 1 -- 172.21.15.102:0/1835315140 wait complete. 2024-08-17T02:26:54.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc745e9d700 1 Processor -- start 2024-08-17T02:26:54.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc745e9d700 1 -- start start 2024-08-17T02:26:54.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc745e9d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc740067030 0x7fc740145260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc745e9d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7400cfb00 0x7fc740145b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc745e9d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc740158cc0 0x7fc7400c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc745e9d700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400c8bd0 con 0x7fc740067030 2024-08-17T02:26:54.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc745e9d700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400c7fc0 con 0x7fc740158cc0 2024-08-17T02:26:54.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc745e9d700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400c82a0 con 0x7fc7400cfb00 2024-08-17T02:26:54.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc744e9b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc740067030 0x7fc740145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc744e9b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc740067030 0x7fc740145260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43634/0 (socket says 172.21.15.102:43634) 2024-08-17T02:26:54.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc744e9b700 1 -- 172.21.15.102:0/285764131 learned_addr learned my addr 172.21.15.102:0/285764131 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:54.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc74569c700 1 --2- 172.21.15.102:0/285764131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc740158cc0 0x7fc7400c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc73ffff700 1 --2- 172.21.15.102:0/285764131 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7400cfb00 0x7fc740145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc744e9b700 1 -- 172.21.15.102:0/285764131 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7400cfb00 msgr2=0x7fc740145b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc744e9b700 1 --2- 172.21.15.102:0/285764131 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7400cfb00 0x7fc740145b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc744e9b700 1 -- 172.21.15.102:0/285764131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc740158cc0 msgr2=0x7fc7400c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc744e9b700 1 --2- 172.21.15.102:0/285764131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc740158cc0 0x7fc7400c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc744e9b700 1 -- 172.21.15.102:0/285764131 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc730009420 con 0x7fc740067030 2024-08-17T02:26:54.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc73ffff700 1 --2- 172.21.15.102:0/285764131 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7400cfb00 0x7fc740145b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:54.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc744e9b700 1 --2- 172.21.15.102:0/285764131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc740067030 0x7fc740145260 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc73400c590 tx=0x7fc73400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc73cff9700 1 -- 172.21.15.102:0/285764131 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734011590 con 0x7fc740067030 2024-08-17T02:26:54.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc73cff9700 1 -- 172.21.15.102:0/285764131 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7340116f0 con 0x7fc740067030 2024-08-17T02:26:54.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc745e9d700 1 -- 172.21.15.102:0/285764131 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7400c8580 con 0x7fc740067030 2024-08-17T02:26:54.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc73cff9700 1 -- 172.21.15.102:0/285764131 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734011ab0 con 0x7fc740067030 2024-08-17T02:26:54.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.744+0000 7fc745e9d700 1 -- 172.21.15.102:0/285764131 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7401457a0 con 0x7fc740067030 2024-08-17T02:26:54.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.748+0000 7fc73cff9700 1 -- 172.21.15.102:0/285764131 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc73401b3b0 con 0x7fc740067030 2024-08-17T02:26:54.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.748+0000 7fc73cff9700 1 --2- 172.21.15.102:0/285764131 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc72c060860 0x7fc72c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.748+0000 7fc745e9d700 1 -- 172.21.15.102:0/285764131 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7400638f0 con 0x7fc740067030 2024-08-17T02:26:54.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.748+0000 7fc73cff9700 1 -- 172.21.15.102:0/285764131 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc73407c150 con 0x7fc740067030 2024-08-17T02:26:54.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.748+0000 7fc73ffff700 1 --2- 172.21.15.102:0/285764131 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc72c060860 0x7fc72c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.748+0000 7fc73ffff700 1 --2- 172.21.15.102:0/285764131 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc72c060860 0x7fc72c062d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc74015d7f0 tx=0x7fc730017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.752+0000 7fc73cff9700 1 -- 172.21.15.102:0/285764131 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc734017070 con 0x7fc740067030 2024-08-17T02:26:54.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.920+0000 7fc745e9d700 1 -- 172.21.15.102:0/285764131 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc7400cb870 con 0x7fc740067030 2024-08-17T02:26:54.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.920+0000 7fc73cff9700 1 -- 172.21.15.102:0/285764131 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc73404c5a0 con 0x7fc740067030 2024-08-17T02:26:54.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.924+0000 7fc745e9d700 1 -- 172.21.15.102:0/285764131 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc72c060860 msgr2=0x7fc72c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.924+0000 7fc745e9d700 1 --2- 172.21.15.102:0/285764131 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc72c060860 0x7fc72c062d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc74015d7f0 tx=0x7fc730017000 comp rx=0 tx=0).stop 2024-08-17T02:26:54.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.924+0000 7fc745e9d700 1 -- 172.21.15.102:0/285764131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc740067030 msgr2=0x7fc740145260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.924+0000 7fc745e9d700 1 --2- 172.21.15.102:0/285764131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc740067030 0x7fc740145260 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc73400c590 tx=0x7fc73400c950 comp rx=0 tx=0).stop 2024-08-17T02:26:54.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.924+0000 7fc745e9d700 1 -- 172.21.15.102:0/285764131 shutdown_connections 2024-08-17T02:26:54.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.924+0000 7fc745e9d700 1 --2- 172.21.15.102:0/285764131 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc72c060860 0x7fc72c062d10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.924+0000 7fc745e9d700 1 --2- 172.21.15.102:0/285764131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc740158cc0 0x7fc7400c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.924+0000 7fc745e9d700 1 --2- 172.21.15.102:0/285764131 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc7400cfb00 0x7fc740145b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.924+0000 7fc745e9d700 1 --2- 172.21.15.102:0/285764131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc740067030 0x7fc740145260 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.924+0000 7fc745e9d700 1 -- 172.21.15.102:0/285764131 >> 172.21.15.102:0/285764131 conn(0x7fc7400d0b50 msgr2=0x7fc740157dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.924+0000 7fc745e9d700 1 -- 172.21.15.102:0/285764131 shutdown_connections 2024-08-17T02:26:54.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:54.924+0000 7fc745e9d700 1 -- 172.21.15.102:0/285764131 wait complete. 2024-08-17T02:26:54.939 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000658238 2024-08-17T02:26:55.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.048+0000 7fd3226c4700 1 Processor -- start 2024-08-17T02:26:55.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.048+0000 7fd3226c4700 1 -- start start 2024-08-17T02:26:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.048+0000 7fd3226c4700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd31c1596d0 0x7fd31c066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.048+0000 7fd3226c4700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd31c15dbc0 0x7fd31c067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.048+0000 7fd3226c4700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31c0cba90 con 0x7fd31c159300 2024-08-17T02:26:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.048+0000 7fd3226c4700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd31c0b2b60 con 0x7fd31c1596d0 2024-08-17T02:26:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.048+0000 7fd3226c4700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd31c0b2940 con 0x7fd31c15dbc0 2024-08-17T02:26:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.048+0000 7fd31b7fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd31c1596d0 0x7fd31c066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.048+0000 7fd31b7fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd31c1596d0 0x7fd31c066e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43644/0 (socket says 172.21.15.102:43644) 2024-08-17T02:26:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.048+0000 7fd31b7fe700 1 -- 172.21.15.102:0/2266856693 learned_addr learned my addr 172.21.15.102:0/2266856693 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.048+0000 7fd31bfff700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd31c159300 0x7fd31c0b2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:38550/0 (socket says 172.21.15.102:38550) 2024-08-17T02:26:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd320c61700 1 --2- 172.21.15.102:0/2266856693 >> v2:172.21.15.121:3300/0 conn(0x7fd31c15dbc0 0x7fd31c067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd31b7fe700 1 -- 172.21.15.102:0/2266856693 >> v2:172.21.15.121:3300/0 conn(0x7fd31c15dbc0 msgr2=0x7fd31c067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd31b7fe700 1 --2- 172.21.15.102:0/2266856693 >> v2:172.21.15.121:3300/0 conn(0x7fd31c15dbc0 0x7fd31c067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd31b7fe700 1 -- 172.21.15.102:0/2266856693 >> v1:172.21.15.102:6789/0 conn(0x7fd31c159300 legacy=0x7fd31c0b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd31affd700 1 -- 172.21.15.102:0/2266856693 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698256988 0 0) 0x7fd31c0cba90 con 0x7fd31c159300 2024-08-17T02:26:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd31b7fe700 1 -- 172.21.15.102:0/2266856693 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c0cb160 con 0x7fd31c1596d0 2024-08-17T02:26:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd320c61700 1 --2- 172.21.15.102:0/2266856693 >> v2:172.21.15.121:3300/0 conn(0x7fd31c15dbc0 0x7fd31c067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd31b7fe700 1 --2- 172.21.15.102:0/2266856693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c1596d0 0x7fd31c066e00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0cd7b0 tx=0x7fd30c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d88f5c61f7875d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd31affd700 1 -- 172.21.15.102:0/2266856693 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c00b820 con 0x7fd31c1596d0 2024-08-17T02:26:55.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd31affd700 1 -- 172.21.15.102:0/2266856693 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c00b980 con 0x7fd31c1596d0 2024-08-17T02:26:55.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd31affd700 1 -- 172.21.15.102:0/2266856693 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c00bd20 con 0x7fd31c1596d0 2024-08-17T02:26:55.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd3226c4700 1 -- 172.21.15.102:0/2266856693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c1596d0 msgr2=0x7fd31c066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd3226c4700 1 --2- 172.21.15.102:0/2266856693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c1596d0 0x7fd31c066e00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0cd7b0 tx=0x7fd30c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:55.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd3226c4700 1 -- 172.21.15.102:0/2266856693 shutdown_connections 2024-08-17T02:26:55.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd3226c4700 1 --2- 172.21.15.102:0/2266856693 >> v2:172.21.15.121:3300/0 conn(0x7fd31c15dbc0 0x7fd31c067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd3226c4700 1 --2- 172.21.15.102:0/2266856693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c1596d0 0x7fd31c066e00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd3226c4700 1 -- 172.21.15.102:0/2266856693 >> 172.21.15.102:0/2266856693 conn(0x7fd31c0682c0 msgr2=0x7fd31c0686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd3226c4700 1 -- 172.21.15.102:0/2266856693 shutdown_connections 2024-08-17T02:26:55.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.052+0000 7fd3226c4700 1 -- 172.21.15.102:0/2266856693 wait complete. 2024-08-17T02:26:55.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd3226c4700 1 Processor -- start 2024-08-17T02:26:55.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd3226c4700 1 -- start start 2024-08-17T02:26:55.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd3226c4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd31c159300 0x7fd31c150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd3226c4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c1596d0 0x7fd31c16a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd3226c4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd31c15dbc0 0x7fd31c0c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd3226c4700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c0c49f0 con 0x7fd31c1596d0 2024-08-17T02:26:55.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd3226c4700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c16ac70 con 0x7fd31c159300 2024-08-17T02:26:55.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd3226c4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c0c3de0 con 0x7fd31c15dbc0 2024-08-17T02:26:55.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd31b7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c1596d0 0x7fd31c16a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd31b7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c1596d0 0x7fd31c16a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43650/0 (socket says 172.21.15.102:43650) 2024-08-17T02:26:55.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd31b7fe700 1 -- 172.21.15.102:0/2236249821 learned_addr learned my addr 172.21.15.102:0/2236249821 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd31bfff700 1 --2- 172.21.15.102:0/2236249821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd31c159300 0x7fd31c150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd320c61700 1 --2- 172.21.15.102:0/2236249821 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd31c15dbc0 0x7fd31c0c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd31b7fe700 1 -- 172.21.15.102:0/2236249821 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd31c15dbc0 msgr2=0x7fd31c0c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd31b7fe700 1 --2- 172.21.15.102:0/2236249821 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd31c15dbc0 0x7fd31c0c4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd31b7fe700 1 -- 172.21.15.102:0/2236249821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd31c159300 msgr2=0x7fd31c150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd31b7fe700 1 --2- 172.21.15.102:0/2236249821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd31c159300 0x7fd31c150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd31b7fe700 1 -- 172.21.15.102:0/2236249821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c0094f0 con 0x7fd31c1596d0 2024-08-17T02:26:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd31bfff700 1 --2- 172.21.15.102:0/2236249821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd31c159300 0x7fd31c150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd31b7fe700 1 --2- 172.21.15.102:0/2236249821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c1596d0 0x7fd31c16a730 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0094c0 tx=0x7fd30c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd313fff700 1 -- 172.21.15.102:0/2236249821 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c01a450 con 0x7fd31c1596d0 2024-08-17T02:26:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd313fff700 1 -- 172.21.15.102:0/2236249821 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c01a5d0 con 0x7fd31c1596d0 2024-08-17T02:26:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd3226c4700 1 -- 172.21.15.102:0/2236249821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c0c40c0 con 0x7fd31c1596d0 2024-08-17T02:26:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd313fff700 1 -- 172.21.15.102:0/2236249821 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c01a990 con 0x7fd31c1596d0 2024-08-17T02:26:55.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.056+0000 7fd3226c4700 1 -- 172.21.15.102:0/2236249821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31c0c4680 con 0x7fd31c1596d0 2024-08-17T02:26:55.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.060+0000 7fd3226c4700 1 -- 172.21.15.102:0/2236249821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31c0645c0 con 0x7fd31c1596d0 2024-08-17T02:26:55.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.060+0000 7fd313fff700 1 -- 172.21.15.102:0/2236249821 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd30c01ad40 con 0x7fd31c1596d0 2024-08-17T02:26:55.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.060+0000 7fd313fff700 1 --2- 172.21.15.102:0/2236249821 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd2fc060860 0x7fd2fc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.060+0000 7fd31bfff700 1 --2- 172.21.15.102:0/2236249821 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd2fc060860 0x7fd2fc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.060+0000 7fd313fff700 1 -- 172.21.15.102:0/2236249821 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd30c07e270 con 0x7fd31c1596d0 2024-08-17T02:26:55.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.060+0000 7fd31bfff700 1 --2- 172.21.15.102:0/2236249821 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd2fc060860 0x7fd2fc062d10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd304007fd0 tx=0x7fd304007e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.068+0000 7fd313fff700 1 -- 172.21.15.102:0/2236249821 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd30c04e6c0 con 0x7fd31c1596d0 2024-08-17T02:26:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:55.260+0000 7fd3226c4700 1 -- 172.21.15.102:0/2236249821 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000658238", "target": ["mon-mgr", ""]}) v1 -- 0x7fd31c0cea90 con 0x7fd2fc060860 2024-08-17T02:26:58.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.320+0000 7fd313fff700 1 -- 172.21.15.102:0/2236249821 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7fd31c0cea90 con 0x7fd2fc060860 2024-08-17T02:26:58.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.324+0000 7fd3226c4700 1 -- 172.21.15.102:0/2236249821 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd2fc060860 msgr2=0x7fd2fc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.324+0000 7fd3226c4700 1 --2- 172.21.15.102:0/2236249821 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd2fc060860 0x7fd2fc062d10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd304007fd0 tx=0x7fd304007e30 comp rx=0 tx=0).stop 2024-08-17T02:26:58.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.324+0000 7fd3226c4700 1 -- 172.21.15.102:0/2236249821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c1596d0 msgr2=0x7fd31c16a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.324+0000 7fd3226c4700 1 --2- 172.21.15.102:0/2236249821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c1596d0 0x7fd31c16a730 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0094c0 tx=0x7fd30c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:58.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.324+0000 7fd3226c4700 1 -- 172.21.15.102:0/2236249821 shutdown_connections 2024-08-17T02:26:58.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.324+0000 7fd3226c4700 1 --2- 172.21.15.102:0/2236249821 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd2fc060860 0x7fd2fc062d10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.324+0000 7fd3226c4700 1 --2- 172.21.15.102:0/2236249821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd31c1596d0 0x7fd31c16a730 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.324+0000 7fd3226c4700 1 --2- 172.21.15.102:0/2236249821 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd31c15dbc0 0x7fd31c0c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.324+0000 7fd3226c4700 1 --2- 172.21.15.102:0/2236249821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd31c159300 0x7fd31c150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.324+0000 7fd3226c4700 1 -- 172.21.15.102:0/2236249821 >> 172.21.15.102:0/2236249821 conn(0x7fd31c0682c0 msgr2=0x7fd31c14d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.324+0000 7fd3226c4700 1 -- 172.21.15.102:0/2236249821 shutdown_connections 2024-08-17T02:26:58.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.324+0000 7fd3226c4700 1 -- 172.21.15.102:0/2236249821 wait complete. 2024-08-17T02:26:58.330 INFO:teuthology.orchestra.run.smithi102.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:26:58.340 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:26:58.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.432+0000 7fa04deb1700 1 Processor -- start 2024-08-17T02:26:58.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.432+0000 7fa04deb1700 1 -- start start 2024-08-17T02:26:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.436+0000 7fa04deb1700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa048068c10 0x7fa048158a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.436+0000 7fa04deb1700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0480aa270 con 0x7fa048158fa0 2024-08-17T02:26:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.436+0000 7fa04deb1700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0480aa550 con 0x7fa048068840 2024-08-17T02:26:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.436+0000 7fa04deb1700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa048069090 con 0x7fa048068c10 2024-08-17T02:26:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.436+0000 7fa04d6b0700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa048158fa0 0x7fa0480ab310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:38562/0 (socket says 172.21.15.102:38562) 2024-08-17T02:26:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.436+0000 7fa04d6b0700 1 -- 172.21.15.102:0/2481126590 learned_addr learned my addr 172.21.15.102:0/2481126590 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.436+0000 7fa047fff700 1 --2- 172.21.15.102:0/2481126590 >> v2:172.21.15.121:3300/0 conn(0x7fa048068c10 0x7fa048158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.436+0000 7fa0477fe700 1 -- 172.21.15.102:0/2481126590 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859300619 0 0) 0x7fa0480aa270 con 0x7fa048158fa0 2024-08-17T02:26:58.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.436+0000 7fa0477fe700 1 -- 172.21.15.102:0/2481126590 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa030003570 con 0x7fa048158fa0 2024-08-17T02:26:58.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.436+0000 7fa047fff700 1 -- 172.21.15.102:0/2481126590 >> v1:172.21.15.121:6789/0 conn(0x7fa048068840 legacy=0x7fa0480a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.436+0000 7fa047fff700 1 -- 172.21.15.102:0/2481126590 >> v1:172.21.15.102:6789/0 conn(0x7fa048158fa0 legacy=0x7fa0480ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.436+0000 7fa047fff700 1 -- 172.21.15.102:0/2481126590 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480aa830 con 0x7fa048068c10 2024-08-17T02:26:58.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.436+0000 7fa047fff700 1 --2- 172.21.15.102:0/2481126590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa048068c10 0x7fa048158a60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa038009910 tx=0x7fa0380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75dcb14e0087ebb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.436+0000 7fa0477fe700 1 -- 172.21.15.102:0/2481126590 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03800b640 con 0x7fa048068c10 2024-08-17T02:26:58.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.436+0000 7fa0477fe700 1 -- 172.21.15.102:0/2481126590 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03800b7a0 con 0x7fa048068c10 2024-08-17T02:26:58.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.436+0000 7fa0477fe700 1 -- 172.21.15.102:0/2481126590 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03800bb60 con 0x7fa048068c10 2024-08-17T02:26:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.440+0000 7fa04deb1700 1 -- 172.21.15.102:0/2481126590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa048068c10 msgr2=0x7fa048158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.440+0000 7fa04deb1700 1 --2- 172.21.15.102:0/2481126590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa048068c10 0x7fa048158a60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa038009910 tx=0x7fa0380091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.440+0000 7fa04deb1700 1 -- 172.21.15.102:0/2481126590 shutdown_connections 2024-08-17T02:26:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.440+0000 7fa04deb1700 1 --2- 172.21.15.102:0/2481126590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa048068c10 0x7fa048158a60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.440+0000 7fa04deb1700 1 -- 172.21.15.102:0/2481126590 >> 172.21.15.102:0/2481126590 conn(0x7fa04806d800 msgr2=0x7fa04806dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.440+0000 7fa04deb1700 1 -- 172.21.15.102:0/2481126590 shutdown_connections 2024-08-17T02:26:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.440+0000 7fa04deb1700 1 -- 172.21.15.102:0/2481126590 wait complete. 2024-08-17T02:26:58.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.440+0000 7fa04deb1700 1 Processor -- start 2024-08-17T02:26:58.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.440+0000 7fa04deb1700 1 -- start start 2024-08-17T02:26:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa04deb1700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa048068840 0x7fa04814a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa04deb1700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa048068c10 0x7fa048156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa04deb1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa048158fa0 0x7fa04814b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa04deb1700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04814a5b0 con 0x7fa048068c10 2024-08-17T02:26:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa04deb1700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04814c410 con 0x7fa048158fa0 2024-08-17T02:26:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa04deb1700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04814c6f0 con 0x7fa048068840 2024-08-17T02:26:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa047fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa048068c10 0x7fa048156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa047fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa048068c10 0x7fa048156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43656/0 (socket says 172.21.15.102:43656) 2024-08-17T02:26:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa047fff700 1 -- 172.21.15.102:0/1777198249 learned_addr learned my addr 172.21.15.102:0/1777198249 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa04ceaf700 1 --2- 172.21.15.102:0/1777198249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa048068840 0x7fa04814a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa04d6b0700 1 --2- 172.21.15.102:0/1777198249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa048158fa0 0x7fa04814b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa047fff700 1 -- 172.21.15.102:0/1777198249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa048068840 msgr2=0x7fa04814a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa047fff700 1 --2- 172.21.15.102:0/1777198249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa048068840 0x7fa04814a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa047fff700 1 -- 172.21.15.102:0/1777198249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa048158fa0 msgr2=0x7fa04814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa047fff700 1 --2- 172.21.15.102:0/1777198249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa048158fa0 0x7fa04814b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa047fff700 1 -- 172.21.15.102:0/1777198249 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa038009420 con 0x7fa048068c10 2024-08-17T02:26:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa047fff700 1 --2- 172.21.15.102:0/1777198249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa048068c10 0x7fa048156270 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa0380093f0 tx=0x7fa038017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa044ff9700 1 -- 172.21.15.102:0/1777198249 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03801f070 con 0x7fa048068c10 2024-08-17T02:26:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa044ff9700 1 -- 172.21.15.102:0/1777198249 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa038000bc0 con 0x7fa048068c10 2024-08-17T02:26:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa04deb1700 1 -- 172.21.15.102:0/1777198249 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04814c9d0 con 0x7fa048068c10 2024-08-17T02:26:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa044ff9700 1 -- 172.21.15.102:0/1777198249 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03800bb60 con 0x7fa048068c10 2024-08-17T02:26:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.444+0000 7fa04deb1700 1 -- 172.21.15.102:0/1777198249 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04814ab70 con 0x7fa048068c10 2024-08-17T02:26:58.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.448+0000 7fa04deb1700 1 -- 172.21.15.102:0/1777198249 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04814ad60 con 0x7fa048068c10 2024-08-17T02:26:58.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.448+0000 7fa044ff9700 1 -- 172.21.15.102:0/1777198249 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa038023070 con 0x7fa048068c10 2024-08-17T02:26:58.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.448+0000 7fa044ff9700 1 --2- 172.21.15.102:0/1777198249 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa034060860 0x7fa034062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.448+0000 7fa044ff9700 1 -- 172.21.15.102:0/1777198249 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fa03807e110 con 0x7fa048068c10 2024-08-17T02:26:58.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.448+0000 7fa04ceaf700 1 --2- 172.21.15.102:0/1777198249 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa034060860 0x7fa034062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.448+0000 7fa04ceaf700 1 --2- 172.21.15.102:0/1777198249 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa034060860 0x7fa034062d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa03c003a80 tx=0x7fa03c007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.460+0000 7fa044ff9700 1 -- 172.21.15.102:0/1777198249 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa03804e220 con 0x7fa048068c10 2024-08-17T02:26:58.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.640+0000 7fa04deb1700 1 -- 172.21.15.102:0/1777198249 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0480638f0 con 0x7fa034060860 2024-08-17T02:26:58.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.644+0000 7fa044ff9700 1 -- 172.21.15.102:0/1777198249 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7fa0480638f0 con 0x7fa034060860 2024-08-17T02:26:58.647 INFO:teuthology.orchestra.run.smithi102.stdout:[ 2024-08-17T02:26:58.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:58.647 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cephfs" 2024-08-17T02:26:58.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-08-17T02:26:58.647 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-08-17T02:26:58.647 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "volume_0000000000658238" 2024-08-17T02:26:58.647 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-08-17T02:26:58.647 INFO:teuthology.orchestra.run.smithi102.stdout:] 2024-08-17T02:26:58.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.648+0000 7fa04deb1700 1 -- 172.21.15.102:0/1777198249 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa034060860 msgr2=0x7fa034062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.648+0000 7fa04deb1700 1 --2- 172.21.15.102:0/1777198249 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa034060860 0x7fa034062d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa03c003a80 tx=0x7fa03c007ec0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.648+0000 7fa04deb1700 1 -- 172.21.15.102:0/1777198249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa048068c10 msgr2=0x7fa048156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.648+0000 7fa04deb1700 1 --2- 172.21.15.102:0/1777198249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa048068c10 0x7fa048156270 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa0380093f0 tx=0x7fa038017000 comp rx=0 tx=0).stop 2024-08-17T02:26:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.648+0000 7fa04deb1700 1 -- 172.21.15.102:0/1777198249 shutdown_connections 2024-08-17T02:26:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.648+0000 7fa04deb1700 1 --2- 172.21.15.102:0/1777198249 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa034060860 0x7fa034062d10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.648+0000 7fa04deb1700 1 --2- 172.21.15.102:0/1777198249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa048068c10 0x7fa048156270 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.648+0000 7fa04deb1700 1 --2- 172.21.15.102:0/1777198249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa048158fa0 0x7fa04814b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.648+0000 7fa04deb1700 1 --2- 172.21.15.102:0/1777198249 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa048068840 0x7fa04814a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.648+0000 7fa04deb1700 1 -- 172.21.15.102:0/1777198249 >> 172.21.15.102:0/1777198249 conn(0x7fa04806d800 msgr2=0x7fa0480ac530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.648+0000 7fa04deb1700 1 -- 172.21.15.102:0/1777198249 shutdown_connections 2024-08-17T02:26:58.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.648+0000 7fa04deb1700 1 -- 172.21.15.102:0/1777198249 wait complete. 2024-08-17T02:26:58.668 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:26:58.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.772+0000 7fc17f59e700 1 Processor -- start 2024-08-17T02:26:58.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.772+0000 7fc17f59e700 1 -- start start 2024-08-17T02:26:58.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17f59e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc18006ead0 0x7fc18006eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17f59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc180152bd0 0x7fc180152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17f59e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1800ace30 con 0x7fc1800b1830 2024-08-17T02:26:58.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17f59e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc180156dd0 con 0x7fc18006ead0 2024-08-17T02:26:58.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17f59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc180156450 con 0x7fc180152bd0 2024-08-17T02:26:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17ed9d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc180152bd0 0x7fc180152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17e59c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc18006ead0 0x7fc18006eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17ed9d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc180152bd0 0x7fc180152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:48602/0 (socket says 172.21.15.102:48602) 2024-08-17T02:26:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17ed9d700 1 -- 172.21.15.102:0/1439920462 learned_addr learned my addr 172.21.15.102:0/1439920462 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17dd9b700 1 --1- 172.21.15.102:0/1439920462 >> v1:172.21.15.121:6789/0 conn(0x7fc1800b1830 0x7fc180155c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:46198/0 (socket says 172.21.15.102:46198) 2024-08-17T02:26:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17d59a700 1 -- 172.21.15.102:0/1439920462 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936405727 0 0) 0x7fc1800ace30 con 0x7fc1800b1830 2024-08-17T02:26:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17d59a700 1 -- 172.21.15.102:0/1439920462 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc16c003570 con 0x7fc1800b1830 2024-08-17T02:26:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17ed9d700 1 -- 172.21.15.102:0/1439920462 >> v2:172.21.15.121:3300/0 conn(0x7fc18006ead0 msgr2=0x7fc18006eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17ed9d700 1 --2- 172.21.15.102:0/1439920462 >> v2:172.21.15.121:3300/0 conn(0x7fc18006ead0 0x7fc18006eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17ed9d700 1 -- 172.21.15.102:0/1439920462 >> v1:172.21.15.121:6789/0 conn(0x7fc1800b1830 legacy=0x7fc180155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17ed9d700 1 -- 172.21.15.102:0/1439920462 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc180156730 con 0x7fc180152bd0 2024-08-17T02:26:58.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17ed9d700 1 --2- 172.21.15.102:0/1439920462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc180152bd0 0x7fc180152fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc1780099b0 tx=0x7fc178009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b50a653aa6d0f94d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17d59a700 1 -- 172.21.15.102:0/1439920462 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17800b680 con 0x7fc180152bd0 2024-08-17T02:26:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17d59a700 1 -- 172.21.15.102:0/1439920462 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17800b7e0 con 0x7fc180152bd0 2024-08-17T02:26:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17d59a700 1 -- 172.21.15.102:0/1439920462 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17800bb60 con 0x7fc180152bd0 2024-08-17T02:26:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17f59e700 1 -- 172.21.15.102:0/1439920462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc180152bd0 msgr2=0x7fc180152fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17f59e700 1 --2- 172.21.15.102:0/1439920462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc180152bd0 0x7fc180152fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc1780099b0 tx=0x7fc178009250 comp rx=0 tx=0).stop 2024-08-17T02:26:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17f59e700 1 -- 172.21.15.102:0/1439920462 shutdown_connections 2024-08-17T02:26:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17f59e700 1 --2- 172.21.15.102:0/1439920462 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc180152bd0 0x7fc180152fe0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17f59e700 1 --2- 172.21.15.102:0/1439920462 >> v2:172.21.15.121:3300/0 conn(0x7fc18006ead0 0x7fc18006eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.776+0000 7fc17f59e700 1 -- 172.21.15.102:0/1439920462 >> 172.21.15.102:0/1439920462 conn(0x7fc1800678a0 msgr2=0x7fc180067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17f59e700 1 -- 172.21.15.102:0/1439920462 shutdown_connections 2024-08-17T02:26:58.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17f59e700 1 -- 172.21.15.102:0/1439920462 wait complete. 2024-08-17T02:26:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17f59e700 1 Processor -- start 2024-08-17T02:26:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17f59e700 1 -- start start 2024-08-17T02:26:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17f59e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc18006ead0 0x7fc18014d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17f59e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1800b1830 0x7fc180166f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17f59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc180152bd0 0x7fc1800a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17f59e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18014d840 con 0x7fc18006ead0 2024-08-17T02:26:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17f59e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1800ab710 con 0x7fc1800b1830 2024-08-17T02:26:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17f59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc180167450 con 0x7fc180152bd0 2024-08-17T02:26:58.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17e59c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc18006ead0 0x7fc18014d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17e59c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc18006ead0 0x7fc18014d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43668/0 (socket says 172.21.15.102:43668) 2024-08-17T02:26:58.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17e59c700 1 -- 172.21.15.102:0/3665798186 learned_addr learned my addr 172.21.15.102:0/3665798186 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:58.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17ed9d700 1 --2- 172.21.15.102:0/3665798186 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc180152bd0 0x7fc1800a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17dd9b700 1 --2- 172.21.15.102:0/3665798186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1800b1830 0x7fc180166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17e59c700 1 -- 172.21.15.102:0/3665798186 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc180152bd0 msgr2=0x7fc1800a8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17e59c700 1 --2- 172.21.15.102:0/3665798186 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc180152bd0 0x7fc1800a8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17e59c700 1 -- 172.21.15.102:0/3665798186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1800b1830 msgr2=0x7fc180166f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17e59c700 1 --2- 172.21.15.102:0/3665798186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1800b1830 0x7fc180166f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17e59c700 1 -- 172.21.15.102:0/3665798186 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1780094f0 con 0x7fc18006ead0 2024-08-17T02:26:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17dd9b700 1 --2- 172.21.15.102:0/3665798186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1800b1830 0x7fc180166f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17e59c700 1 --2- 172.21.15.102:0/3665798186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc18006ead0 0x7fc18014d300 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc17000e930 tx=0x7fc1700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc1767fc700 1 -- 172.21.15.102:0/3665798186 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170013680 con 0x7fc18006ead0 2024-08-17T02:26:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc1767fc700 1 -- 172.21.15.102:0/3665798186 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1700137e0 con 0x7fc18006ead0 2024-08-17T02:26:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17f59e700 1 -- 172.21.15.102:0/3665798186 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1800aab00 con 0x7fc18006ead0 2024-08-17T02:26:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc1767fc700 1 -- 172.21.15.102:0/3665798186 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170013b80 con 0x7fc18006ead0 2024-08-17T02:26:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.780+0000 7fc17f59e700 1 -- 172.21.15.102:0/3665798186 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1800ab0c0 con 0x7fc18006ead0 2024-08-17T02:26:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.784+0000 7fc17f59e700 1 -- 172.21.15.102:0/3665798186 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc180064330 con 0x7fc18006ead0 2024-08-17T02:26:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.784+0000 7fc1767fc700 1 -- 172.21.15.102:0/3665798186 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc17000c3e0 con 0x7fc18006ead0 2024-08-17T02:26:58.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.784+0000 7fc1767fc700 1 --2- 172.21.15.102:0/3665798186 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc160060860 0x7fc160062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.784+0000 7fc1767fc700 1 -- 172.21.15.102:0/3665798186 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fc17007d0f0 con 0x7fc18006ead0 2024-08-17T02:26:58.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.784+0000 7fc17dd9b700 1 --2- 172.21.15.102:0/3665798186 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc160060860 0x7fc160062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.784+0000 7fc17dd9b700 1 --2- 172.21.15.102:0/3665798186 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc160060860 0x7fc160062d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc1800cb590 tx=0x7fc168000f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.792+0000 7fc1767fc700 1 -- 172.21.15.102:0/3665798186 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc17004d120 con 0x7fc18006ead0 2024-08-17T02:26:58.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.960+0000 7fc17f59e700 1 -- 172.21.15.102:0/3665798186 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7fc1800685f0 con 0x7fc18006ead0 2024-08-17T02:26:58.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.960+0000 7fc1767fc700 1 -- 172.21.15.102:0/3665798186 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v35) v1 ==== 97+0+8050 (secure 0 0 0) 0x7fc170050740 con 0x7fc18006ead0 2024-08-17T02:26:58.963 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:58.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.960+0000 7fc17f59e700 1 -- 172.21.15.102:0/3665798186 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc160060860 msgr2=0x7fc160062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.960+0000 7fc17f59e700 1 --2- 172.21.15.102:0/3665798186 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc160060860 0x7fc160062d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc1800cb590 tx=0x7fc168000f40 comp rx=0 tx=0).stop 2024-08-17T02:26:58.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.960+0000 7fc17f59e700 1 -- 172.21.15.102:0/3665798186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc18006ead0 msgr2=0x7fc18014d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.960+0000 7fc17f59e700 1 --2- 172.21.15.102:0/3665798186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc18006ead0 0x7fc18014d300 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc17000e930 tx=0x7fc1700091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.960+0000 7fc17f59e700 1 -- 172.21.15.102:0/3665798186 shutdown_connections 2024-08-17T02:26:58.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.960+0000 7fc17f59e700 1 --2- 172.21.15.102:0/3665798186 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc160060860 0x7fc160062d10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.960+0000 7fc17f59e700 1 --2- 172.21.15.102:0/3665798186 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc180152bd0 0x7fc1800a8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.960+0000 7fc17f59e700 1 --2- 172.21.15.102:0/3665798186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1800b1830 0x7fc180166f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.960+0000 7fc17f59e700 1 --2- 172.21.15.102:0/3665798186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc18006ead0 0x7fc18014d300 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.960+0000 7fc17f59e700 1 -- 172.21.15.102:0/3665798186 >> 172.21.15.102:0/3665798186 conn(0x7fc1800678a0 msgr2=0x7fc1800aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.960+0000 7fc17f59e700 1 -- 172.21.15.102:0/3665798186 shutdown_connections 2024-08-17T02:26:58.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:58.960+0000 7fc17f59e700 1 -- 172.21.15.102:0/3665798186 wait complete. 2024-08-17T02:26:58.977 INFO:teuthology.orchestra.run.smithi102.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:40.530641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:41.227445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000658238.meta","create_time":"2024-08-17T02:26:55.316074+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000658238"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000658238.data","create_time":"2024-08-17T02:26:56.329435+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000658238"}}}] 2024-08-17T02:26:58.977 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000658238 --format=json 2024-08-17T02:26:59.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.080+0000 7fd76b59e700 1 Processor -- start 2024-08-17T02:26:59.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.080+0000 7fd76b59e700 1 -- start start 2024-08-17T02:26:59.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd76b59e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd76c155d20 0x7fd76c0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd76b59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd76c06df10 0x7fd76c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd76b59e700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76c06e8b0 con 0x7fd76c0ad7c0 2024-08-17T02:26:59.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd76b59e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76c0adc10 con 0x7fd76c155d20 2024-08-17T02:26:59.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd76b59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c0af2b0 con 0x7fd76c06df10 2024-08-17T02:26:59.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd763fff700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd76c0ad7c0 0x7fd76c0aea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:38574/0 (socket says 172.21.15.102:38574) 2024-08-17T02:26:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd763fff700 1 -- 172.21.15.102:0/1144610110 learned_addr learned my addr 172.21.15.102:0/1144610110 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:26:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd76a59c700 1 --2- 172.21.15.102:0/1144610110 >> v2:172.21.15.121:3300/0 conn(0x7fd76c155d20 0x7fd76c0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd76ad9d700 1 --2- 172.21.15.102:0/1144610110 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd76c06df10 0x7fd76c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 -- 172.21.15.102:0/1144610110 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064777286 0 0) 0x7fd754001110 con 0x7fd76c0ad7c0 2024-08-17T02:26:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 -- 172.21.15.102:0/1144610110 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd758003570 con 0x7fd76c0ad7c0 2024-08-17T02:26:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 -- 172.21.15.102:0/1144610110 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 108760700 0 0) 0x7fd758003570 con 0x7fd76c0ad7c0 2024-08-17T02:26:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 -- 172.21.15.102:0/1144610110 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd76c06df10 msgr2=0x7fd76c06e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 --2- 172.21.15.102:0/1144610110 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd76c06df10 0x7fd76c06e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 -- 172.21.15.102:0/1144610110 >> v2:172.21.15.121:3300/0 conn(0x7fd76c155d20 msgr2=0x7fd76c0b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 --2- 172.21.15.102:0/1144610110 >> v2:172.21.15.121:3300/0 conn(0x7fd76c155d20 0x7fd76c0b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 -- 172.21.15.102:0/1144610110 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c0af590 con 0x7fd76c0ad7c0 2024-08-17T02:26:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 -- 172.21.15.102:0/1144610110 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7fd754001600 con 0x7fd76c0ad7c0 2024-08-17T02:26:59.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 -- 172.21.15.102:0/1144610110 >> v1:172.21.15.102:6789/0 conn(0x7fd76c0ad7c0 legacy=0x7fd76c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 --2- 172.21.15.102:0/1144610110 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd76c06df10 0x7fd758003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 --2- 172.21.15.102:0/1144610110 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd758003fe0 0x7fd758004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 --2- 172.21.15.102:0/1144610110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd758004d50 0x7fd7580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 -- 172.21.15.102:0/1144610110 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c0adc10 con 0x7fd758003fe0 2024-08-17T02:26:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 -- 172.21.15.102:0/1144610110 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c0af2b0 con 0x7fd758004d50 2024-08-17T02:26:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 -- 172.21.15.102:0/1144610110 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75800ba90 con 0x7fd76c06df10 2024-08-17T02:26:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd763fff700 1 --2- 172.21.15.102:0/1144610110 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd758003fe0 0x7fd758004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd76a59c700 1 --2- 172.21.15.102:0/1144610110 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd76c06df10 0x7fd758003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd76ad9d700 1 --2- 172.21.15.102:0/1144610110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd758004d50 0x7fd7580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd763fff700 1 -- 172.21.15.102:0/1144610110 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd76c06df10 msgr2=0x7fd758003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd763fff700 1 --2- 172.21.15.102:0/1144610110 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd76c06df10 0x7fd758003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd763fff700 1 -- 172.21.15.102:0/1144610110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd758004d50 msgr2=0x7fd7580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd763fff700 1 --2- 172.21.15.102:0/1144610110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd758004d50 0x7fd7580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd763fff700 1 -- 172.21.15.102:0/1144610110 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd758003570 con 0x7fd758003fe0 2024-08-17T02:26:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd763fff700 1 --2- 172.21.15.102:0/1144610110 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd758003fe0 0x7fd758004810 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd75400c5f0 tx=0x7fd754007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef1c0df07990dd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 -- 172.21.15.102:0/1144610110 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75400cd90 con 0x7fd758003fe0 2024-08-17T02:26:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 -- 172.21.15.102:0/1144610110 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd754005920 con 0x7fd758003fe0 2024-08-17T02:26:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.084+0000 7fd769d9b700 1 -- 172.21.15.102:0/1144610110 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754005ce0 con 0x7fd758003fe0 2024-08-17T02:26:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.088+0000 7fd76b59e700 1 -- 172.21.15.102:0/1144610110 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd758003fe0 msgr2=0x7fd758004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.088+0000 7fd76b59e700 1 --2- 172.21.15.102:0/1144610110 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd758003fe0 0x7fd758004810 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd75400c5f0 tx=0x7fd754007a80 comp rx=0 tx=0).stop 2024-08-17T02:26:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.088+0000 7fd76ad9d700 1 -- 172.21.15.102:0/1144610110 reap_dead start 2024-08-17T02:26:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.088+0000 7fd76b59e700 1 -- 172.21.15.102:0/1144610110 shutdown_connections 2024-08-17T02:26:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.088+0000 7fd76b59e700 1 -- 172.21.15.102:0/1144610110 >> 172.21.15.102:0/1144610110 conn(0x7fd76c0678d0 msgr2=0x7fd76c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.088+0000 7fd76b59e700 1 -- 172.21.15.102:0/1144610110 shutdown_connections 2024-08-17T02:26:59.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.088+0000 7fd76b59e700 1 -- 172.21.15.102:0/1144610110 wait complete. 2024-08-17T02:26:59.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.088+0000 7fd76b59e700 1 Processor -- start 2024-08-17T02:26:59.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.088+0000 7fd76b59e700 1 -- start start 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd76b59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd758003fe0 0x7fd76c14b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd76b59e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd76c1560f0 0x7fd76c142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd76b59e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd76c06a160 0x7fd76c06a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd76b59e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c157080 con 0x7fd76c1560f0 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd76b59e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c06ab10 con 0x7fd76c06a160 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd76b59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c143b20 con 0x7fd758003fe0 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd763fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd76c1560f0 0x7fd76c142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd763fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd76c1560f0 0x7fd76c142b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43674/0 (socket says 172.21.15.102:43674) 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd763fff700 1 -- 172.21.15.102:0/282121884 learned_addr learned my addr 172.21.15.102:0/282121884 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd76a59c700 1 --2- 172.21.15.102:0/282121884 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd758003fe0 0x7fd76c14b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd76ad9d700 1 --2- 172.21.15.102:0/282121884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd76c06a160 0x7fd76c06a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd763fff700 1 -- 172.21.15.102:0/282121884 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd758003fe0 msgr2=0x7fd76c14b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd763fff700 1 --2- 172.21.15.102:0/282121884 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd758003fe0 0x7fd76c14b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd763fff700 1 -- 172.21.15.102:0/282121884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd76c06a160 msgr2=0x7fd76c06a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd763fff700 1 --2- 172.21.15.102:0/282121884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd76c06a160 0x7fd76c06a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd763fff700 1 -- 172.21.15.102:0/282121884 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c143090 con 0x7fd76c1560f0 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd76ad9d700 1 --2- 172.21.15.102:0/282121884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd76c06a160 0x7fd76c06a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd763fff700 1 --2- 172.21.15.102:0/282121884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd76c1560f0 0x7fd76c142b50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd758004730 tx=0x7fd754015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd7627fc700 1 -- 172.21.15.102:0/282121884 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754005d70 con 0x7fd76c1560f0 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd7627fc700 1 -- 172.21.15.102:0/282121884 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7540072e0 con 0x7fd76c1560f0 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd76b59e700 1 -- 172.21.15.102:0/282121884 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76c1437f0 con 0x7fd76c1560f0 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd7627fc700 1 -- 172.21.15.102:0/282121884 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7540076a0 con 0x7fd76c1560f0 2024-08-17T02:26:59.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd76b59e700 1 -- 172.21.15.102:0/282121884 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76c1567e0 con 0x7fd76c1560f0 2024-08-17T02:26:59.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd76b59e700 1 -- 172.21.15.102:0/282121884 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76c143cb0 con 0x7fd76c1560f0 2024-08-17T02:26:59.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.092+0000 7fd7627fc700 1 -- 172.21.15.102:0/282121884 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd754019070 con 0x7fd76c1560f0 2024-08-17T02:26:59.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.096+0000 7fd7627fc700 1 --2- 172.21.15.102:0/282121884 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd74c060890 0x7fd74c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.096+0000 7fd76a59c700 1 --2- 172.21.15.102:0/282121884 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd74c060890 0x7fd74c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.096+0000 7fd7627fc700 1 -- 172.21.15.102:0/282121884 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fd75407ec20 con 0x7fd76c1560f0 2024-08-17T02:26:59.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.096+0000 7fd76a59c700 1 --2- 172.21.15.102:0/282121884 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd74c060890 0x7fd74c062d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd75c006f00 tx=0x7fd75c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.100+0000 7fd7627fc700 1 -- 172.21.15.102:0/282121884 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd75407ee60 con 0x7fd76c1560f0 2024-08-17T02:26:59.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.304+0000 7fd76b59e700 1 -- 172.21.15.102:0/282121884 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000658238", "format": "json"} v 0) v1 -- 0x7fd76c06e8b0 con 0x7fd76c1560f0 2024-08-17T02:26:59.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.304+0000 7fd7627fc700 1 -- 172.21.15.102:0/282121884 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000658238", "format": "json"}]=0 v17) v1 ==== 110+0+1847 (secure 0 0 0) 0x7fd754017750 con 0x7fd76c1560f0 2024-08-17T02:26:59.309 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:26:59.309 INFO:teuthology.orchestra.run.smithi102.stdout:{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:57.316251+0000","modified":"2024-08-17T02:26:58.534785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4676":{"gid":4676,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6835/2189006578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2189006578},{"type":"v1","addr":"172.21.15.121:6835","nonce":2189006578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000658238","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:26:59.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.308+0000 7fd76b59e700 1 -- 172.21.15.102:0/282121884 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd74c060890 msgr2=0x7fd74c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.308+0000 7fd76b59e700 1 --2- 172.21.15.102:0/282121884 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd74c060890 0x7fd74c062d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd75c006f00 tx=0x7fd75c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.308+0000 7fd76b59e700 1 -- 172.21.15.102:0/282121884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd76c1560f0 msgr2=0x7fd76c142b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.308+0000 7fd76b59e700 1 --2- 172.21.15.102:0/282121884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd76c1560f0 0x7fd76c142b50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd758004730 tx=0x7fd754015000 comp rx=0 tx=0).stop 2024-08-17T02:26:59.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.308+0000 7fd76b59e700 1 -- 172.21.15.102:0/282121884 shutdown_connections 2024-08-17T02:26:59.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.308+0000 7fd76b59e700 1 --2- 172.21.15.102:0/282121884 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd74c060890 0x7fd74c062d40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.308+0000 7fd76b59e700 1 --2- 172.21.15.102:0/282121884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd76c1560f0 0x7fd76c142b50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.308+0000 7fd76b59e700 1 --2- 172.21.15.102:0/282121884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd76c06a160 0x7fd76c06a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.308+0000 7fd76b59e700 1 --2- 172.21.15.102:0/282121884 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd758003fe0 0x7fd76c14b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.308+0000 7fd76b59e700 1 -- 172.21.15.102:0/282121884 >> 172.21.15.102:0/282121884 conn(0x7fd76c0678d0 msgr2=0x7fd76c0abfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.308+0000 7fd76b59e700 1 -- 172.21.15.102:0/282121884 shutdown_connections 2024-08-17T02:26:59.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.308+0000 7fd76b59e700 1 -- 172.21.15.102:0/282121884 wait complete. 2024-08-17T02:26:59.322 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000658238 --yes-i-really-mean-it 2024-08-17T02:26:59.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.428+0000 7f195555f700 1 Processor -- start 2024-08-17T02:26:59.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.428+0000 7f195555f700 1 -- start start 2024-08-17T02:26:59.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.428+0000 7f195555f700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f19500a9040 0x7f19500a9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.428+0000 7f195555f700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f195006d2a0 0x7f19501569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.428+0000 7f195555f700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19500aa890 con 0x7f19500acf00 2024-08-17T02:26:59.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.428+0000 7f195555f700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19500aa030 con 0x7f19500a9040 2024-08-17T02:26:59.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.428+0000 7f195555f700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19500ad360 con 0x7f195006d2a0 2024-08-17T02:26:59.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.428+0000 7f194effd700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f19500a9040 0x7f19500a9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.428+0000 7f194effd700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f19500a9040 0x7f19500a9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43686/0 (socket says 172.21.15.102:43686) 2024-08-17T02:26:59.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.428+0000 7f194effd700 1 -- 172.21.15.102:0/1600672449 learned_addr learned my addr 172.21.15.102:0/1600672449 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:59.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.428+0000 7f194f7fe700 1 --2- 172.21.15.102:0/1600672449 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f195006d2a0 0x7f19501569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f194dffb700 1 -- 172.21.15.102:0/1600672449 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211905004 0 0) 0x7f19500aa890 con 0x7f19500acf00 2024-08-17T02:26:59.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f194dffb700 1 -- 172.21.15.102:0/1600672449 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f193c003570 con 0x7f19500acf00 2024-08-17T02:26:59.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f194effd700 1 -- 172.21.15.102:0/1600672449 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f195006d2a0 msgr2=0x7f19501569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f194effd700 1 --2- 172.21.15.102:0/1600672449 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f195006d2a0 0x7f19501569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f194effd700 1 -- 172.21.15.102:0/1600672449 >> v1:172.21.15.121:6789/0 conn(0x7f19500acf00 legacy=0x7f19500adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f194effd700 1 -- 172.21.15.102:0/1600672449 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195006d720 con 0x7f19500a9040 2024-08-17T02:26:59.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f194f7fe700 1 --2- 172.21.15.102:0/1600672449 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f195006d2a0 0x7f19501569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:59.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f194effd700 1 --2- 172.21.15.102:0/1600672449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19500a9040 0x7f19500a9410 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f19380099b0 tx=0x7f1938009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d343a902b124579 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f194dffb700 1 -- 172.21.15.102:0/1600672449 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193800b680 con 0x7f19500a9040 2024-08-17T02:26:59.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f194dffb700 1 -- 172.21.15.102:0/1600672449 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193800b7e0 con 0x7f19500a9040 2024-08-17T02:26:59.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f194dffb700 1 -- 172.21.15.102:0/1600672449 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193800bb80 con 0x7f19500a9040 2024-08-17T02:26:59.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f195555f700 1 -- 172.21.15.102:0/1600672449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19500a9040 msgr2=0x7f19500a9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f195555f700 1 --2- 172.21.15.102:0/1600672449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19500a9040 0x7f19500a9410 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f19380099b0 tx=0x7f1938009250 comp rx=0 tx=0).stop 2024-08-17T02:26:59.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f195555f700 1 -- 172.21.15.102:0/1600672449 shutdown_connections 2024-08-17T02:26:59.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f195555f700 1 --2- 172.21.15.102:0/1600672449 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f195006d2a0 0x7f19501569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f195555f700 1 --2- 172.21.15.102:0/1600672449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19500a9040 0x7f19500a9410 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f195555f700 1 -- 172.21.15.102:0/1600672449 >> 172.21.15.102:0/1600672449 conn(0x7f1950066e00 msgr2=0x7f1950067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f195555f700 1 -- 172.21.15.102:0/1600672449 shutdown_connections 2024-08-17T02:26:59.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.432+0000 7f195555f700 1 -- 172.21.15.102:0/1600672449 wait complete. 2024-08-17T02:26:59.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f195555f700 1 Processor -- start 2024-08-17T02:26:59.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f195555f700 1 -- start start 2024-08-17T02:26:59.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f195555f700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f195006d2a0 0x7f1950097d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f195555f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19500a9040 0x7f1950099150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f195555f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19500acf00 0x7f195006dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f195555f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1950097330 con 0x7f19500acf00 2024-08-17T02:26:59.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f195555f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19500978f0 con 0x7f19500a9040 2024-08-17T02:26:59.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f195555f700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19500c9c90 con 0x7f195006d2a0 2024-08-17T02:26:59.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f194f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19500acf00 0x7f195006dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f194e7fc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19500a9040 0x7f1950099150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f194f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19500acf00 0x7f195006dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43694/0 (socket says 172.21.15.102:43694) 2024-08-17T02:26:59.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f194f7fe700 1 -- 172.21.15.102:0/46656150 learned_addr learned my addr 172.21.15.102:0/46656150 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:26:59.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f194effd700 1 --2- 172.21.15.102:0/46656150 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f195006d2a0 0x7f1950097d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f194f7fe700 1 -- 172.21.15.102:0/46656150 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f195006d2a0 msgr2=0x7f1950097d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f194f7fe700 1 --2- 172.21.15.102:0/46656150 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f195006d2a0 0x7f1950097d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f194f7fe700 1 -- 172.21.15.102:0/46656150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19500a9040 msgr2=0x7f1950099150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f194f7fe700 1 --2- 172.21.15.102:0/46656150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19500a9040 0x7f1950099150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f194f7fe700 1 -- 172.21.15.102:0/46656150 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1948009a20 con 0x7f19500acf00 2024-08-17T02:26:59.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f194e7fc700 1 --2- 172.21.15.102:0/46656150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19500a9040 0x7f1950099150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:59.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f194f7fe700 1 --2- 172.21.15.102:0/46656150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19500acf00 0x7f195006dfb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1948009f50 tx=0x7f194800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f1946ffd700 1 -- 172.21.15.102:0/46656150 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194800cb50 con 0x7f19500acf00 2024-08-17T02:26:59.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f1946ffd700 1 -- 172.21.15.102:0/46656150 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194800f040 con 0x7f19500acf00 2024-08-17T02:26:59.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f195555f700 1 -- 172.21.15.102:0/46656150 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19380094f0 con 0x7f19500acf00 2024-08-17T02:26:59.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f1946ffd700 1 -- 172.21.15.102:0/46656150 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948014480 con 0x7f19500acf00 2024-08-17T02:26:59.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.436+0000 7f195555f700 1 -- 172.21.15.102:0/46656150 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1950099b10 con 0x7f19500acf00 2024-08-17T02:26:59.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.440+0000 7f195555f700 1 -- 172.21.15.102:0/46656150 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19500645c0 con 0x7f19500acf00 2024-08-17T02:26:59.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.440+0000 7f1946ffd700 1 -- 172.21.15.102:0/46656150 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1948003020 con 0x7f19500acf00 2024-08-17T02:26:59.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.440+0000 7f1946ffd700 1 --2- 172.21.15.102:0/46656150 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1930060860 0x7f1930062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.440+0000 7f1946ffd700 1 -- 172.21.15.102:0/46656150 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f194807d7e0 con 0x7f19500acf00 2024-08-17T02:26:59.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.440+0000 7f194effd700 1 --2- 172.21.15.102:0/46656150 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1930060860 0x7f1930062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.440+0000 7f194effd700 1 --2- 172.21.15.102:0/46656150 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1930060860 0x7f1930062d10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f19380099b0 tx=0x7f1938017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.452+0000 7f1946ffd700 1 -- 172.21.15.102:0/46656150 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f194804d8b0 con 0x7f19500acf00 2024-08-17T02:26:59.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:26:59.640+0000 7f195555f700 1 -- 172.21.15.102:0/46656150 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000658238", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f1950097a30 con 0x7f1930060860 2024-08-17T02:27:00.515 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:00.517 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:02.572 INFO:tasks.ceph.mds.d.smithi121.stderr:2024-08-17T02:27:02.568+0000 7f1833b32700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:27:30.593 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:30.596 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:00.649 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:00.652 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:30.716 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:30.719 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:59.340 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:28:59.342 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:28:59.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:28:59.359 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:28:59.382 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:28:59.382 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2024-08-17T02:28:59.382 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:28:59.382 DEBUG:teuthology.orchestra.run.smithi102:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:59.416 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[33232]: fuse finished with error 0 and tester_r 0 2024-08-17T02:28:59.417 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-08-17T02:28:59.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:59.418 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:28:59.541 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-08-17T02:28:59.541 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:28:59.541 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:59.557 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[29504]: fuse finished with error 0 and tester_r 0 2024-08-17T02:28:59.558 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-08-17T02:28:59.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:59.559 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:28:59.725 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-08-17T02:28:59.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:59.725 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:28:59.732 INFO:teuthology.orchestra.run.smithi102.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-08-17T02:28:59.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:28:59.733 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-08-17T02:28:59.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:59.734 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:28:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-08-17T02:28:59.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:28:59.742 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:59.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.849+0000 7f7a90eb6700 1 Processor -- start 2024-08-17T02:28:59.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.849+0000 7f7a90eb6700 1 -- start start 2024-08-17T02:28:59.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a90eb6700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7a8c0cb560 0x7f7a8c161ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:59.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a90eb6700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8c0cbaa0 con 0x7f7a8c154900 2024-08-17T02:28:59.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a90eb6700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8c157630 con 0x7f7a8c0b14a0 2024-08-17T02:28:59.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a90eb6700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a8c068790 con 0x7f7a8c0cb560 2024-08-17T02:28:59.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a8b7fe700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f7a8c154900 0x7f7a8c0b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:58614/0 (socket says 172.21.15.102:58614) 2024-08-17T02:28:59.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a8b7fe700 1 -- 172.21.15.102:0/3873856487 learned_addr learned my addr 172.21.15.102:0/3873856487 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:28:59.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a8bfff700 1 --2- 172.21.15.102:0/3873856487 >> v2:172.21.15.102:3300/0 conn(0x7f7a8c0cb560 0x7f7a8c161ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:59.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a8a7fc700 1 -- 172.21.15.102:0/3873856487 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450019005 0 0) 0x7f7a8c0cbaa0 con 0x7f7a8c154900 2024-08-17T02:28:59.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a8a7fc700 1 -- 172.21.15.102:0/3873856487 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a74003570 con 0x7f7a8c154900 2024-08-17T02:28:59.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a8a7fc700 1 -- 172.21.15.102:0/3873856487 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4145570012 0 0) 0x7f7a74003570 con 0x7f7a8c154900 2024-08-17T02:28:59.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a8bfff700 1 -- 172.21.15.102:0/3873856487 >> v1:172.21.15.121:6789/0 conn(0x7f7a8c0b14a0 legacy=0x7f7a8c0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:59.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a8bfff700 1 -- 172.21.15.102:0/3873856487 >> v1:172.21.15.102:6789/0 conn(0x7f7a8c154900 legacy=0x7f7a8c0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:59.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a8bfff700 1 -- 172.21.15.102:0/3873856487 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c157910 con 0x7f7a8c0cb560 2024-08-17T02:28:59.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a8bfff700 1 --2- 172.21.15.102:0/3873856487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a8c0cb560 0x7f7a8c161ad0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c0098e0 tx=0x7f7a7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1021f1cb888b5986 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:59.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a8a7fc700 1 -- 172.21.15.102:0/3873856487 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a840017f0 con 0x7f7a8c0cb560 2024-08-17T02:28:59.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a8a7fc700 1 -- 172.21.15.102:0/3873856487 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c011420 con 0x7f7a8c0cb560 2024-08-17T02:28:59.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a8a7fc700 1 -- 172.21.15.102:0/3873856487 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c0117c0 con 0x7f7a8c0cb560 2024-08-17T02:28:59.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a90eb6700 1 -- 172.21.15.102:0/3873856487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a8c0cb560 msgr2=0x7f7a8c161ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:59.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a90eb6700 1 --2- 172.21.15.102:0/3873856487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a8c0cb560 0x7f7a8c161ad0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c0098e0 tx=0x7f7a7c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a90eb6700 1 -- 172.21.15.102:0/3873856487 shutdown_connections 2024-08-17T02:28:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a90eb6700 1 --2- 172.21.15.102:0/3873856487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a8c0cb560 0x7f7a8c161ad0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a90eb6700 1 -- 172.21.15.102:0/3873856487 >> 172.21.15.102:0/3873856487 conn(0x7f7a8c0678d0 msgr2=0x7f7a8c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a90eb6700 1 -- 172.21.15.102:0/3873856487 shutdown_connections 2024-08-17T02:28:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.853+0000 7f7a90eb6700 1 -- 172.21.15.102:0/3873856487 wait complete. 2024-08-17T02:28:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a90eb6700 1 Processor -- start 2024-08-17T02:28:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a90eb6700 1 -- start start 2024-08-17T02:28:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a90eb6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a8c0b14a0 0x7f7a8c151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a90eb6700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a8c0cb560 0x7f7a8c145580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a90eb6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a8c154900 0x7f7a8c0c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a90eb6700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c1510d0 con 0x7f7a8c154900 2024-08-17T02:28:59.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a90eb6700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c151a70 con 0x7f7a8c0b14a0 2024-08-17T02:28:59.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a90eb6700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c16cc20 con 0x7f7a8c0cb560 2024-08-17T02:28:59.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a8bfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a8c154900 0x7f7a8c0c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:59.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a8bfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a8c154900 0x7f7a8c0c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38810/0 (socket says 172.21.15.102:38810) 2024-08-17T02:28:59.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a8bfff700 1 -- 172.21.15.102:0/1423512613 learned_addr learned my addr 172.21.15.102:0/1423512613 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:28:59.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a8affd700 1 --2- 172.21.15.102:0/1423512613 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a8c0cb560 0x7f7a8c145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:59.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a8b7fe700 1 --2- 172.21.15.102:0/1423512613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a8c0b14a0 0x7f7a8c151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:59.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a8bfff700 1 -- 172.21.15.102:0/1423512613 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a8c0cb560 msgr2=0x7f7a8c145580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a8bfff700 1 --2- 172.21.15.102:0/1423512613 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a8c0cb560 0x7f7a8c145580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a8bfff700 1 -- 172.21.15.102:0/1423512613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a8c0b14a0 msgr2=0x7f7a8c151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a8bfff700 1 --2- 172.21.15.102:0/1423512613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a8c0b14a0 0x7f7a8c151530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a8bfff700 1 -- 172.21.15.102:0/1423512613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c009420 con 0x7f7a8c154900 2024-08-17T02:28:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a8b7fe700 1 --2- 172.21.15.102:0/1423512613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a8c0b14a0 0x7f7a8c151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a8bfff700 1 --2- 172.21.15.102:0/1423512613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a8c154900 0x7f7a8c0c9630 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009f80 tx=0x7f7a7c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a737fe700 1 -- 172.21.15.102:0/1423512613 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c01cd30 con 0x7f7a8c154900 2024-08-17T02:28:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a737fe700 1 -- 172.21.15.102:0/1423512613 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c01ce90 con 0x7f7a8c154900 2024-08-17T02:28:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a90eb6700 1 -- 172.21.15.102:0/1423512613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8c16c610 con 0x7f7a8c154900 2024-08-17T02:28:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a737fe700 1 -- 172.21.15.102:0/1423512613 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c01a6a0 con 0x7f7a8c154900 2024-08-17T02:28:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.857+0000 7f7a90eb6700 1 -- 172.21.15.102:0/1423512613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8c16c8b0 con 0x7f7a8c154900 2024-08-17T02:28:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.861+0000 7f7a90eb6700 1 -- 172.21.15.102:0/1423512613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a8c0643a0 con 0x7f7a8c154900 2024-08-17T02:28:59.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.861+0000 7f7a737fe700 1 -- 172.21.15.102:0/1423512613 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7a7c01aa10 con 0x7f7a8c154900 2024-08-17T02:28:59.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.861+0000 7f7a737fe700 1 --2- 172.21.15.102:0/1423512613 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7a78060890 0x7f7a78062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:59.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.861+0000 7f7a8b7fe700 1 --2- 172.21.15.102:0/1423512613 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7a78060890 0x7f7a78062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:59.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.861+0000 7f7a737fe700 1 -- 172.21.15.102:0/1423512613 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f7a7c07eb20 con 0x7f7a8c154900 2024-08-17T02:28:59.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.861+0000 7f7a8b7fe700 1 --2- 172.21.15.102:0/1423512613 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7a78060890 0x7f7a78062d40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7a84007fd0 tx=0x7f7a84000f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:59.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:28:59.865+0000 7f7a737fe700 1 -- 172.21.15.102:0/1423512613 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7a7c04eb50 con 0x7f7a8c154900 2024-08-17T02:29:00.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.081+0000 7f7a90eb6700 1 -- 172.21.15.102:0/1423512613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a8c06f5f0 con 0x7f7a8c154900 2024-08-17T02:29:00.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.081+0000 7f7a737fe700 1 -- 172.21.15.102:0/1423512613 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5695 (secure 0 0 0) 0x7f7a7c052170 con 0x7f7a8c154900 2024-08-17T02:29:00.089 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:00.089 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3728405798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3728405798},{"type":"v1","addr":"172.21.15.102:6835","nonce":3728405798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2759836087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2759836087},{"type":"v1","addr":"172.21.15.121:6833","nonce":2759836087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:42.224494+0000","modified":"2024-08-17T02:26:45.888060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/1340437033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1340437033},{"type":"v1","addr":"172.21.15.102:6837","nonce":1340437033}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:57.316251+0000","modified":"2024-08-17T02:26:58.534785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4676":{"gid":4676,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6835/2189006578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2189006578},{"type":"v1","addr":"172.21.15.121:6835","nonce":2189006578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000658238","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:00.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.085+0000 7f7a90eb6700 1 -- 172.21.15.102:0/1423512613 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7a78060890 msgr2=0x7f7a78062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.085+0000 7f7a90eb6700 1 --2- 172.21.15.102:0/1423512613 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7a78060890 0x7f7a78062d40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7a84007fd0 tx=0x7f7a84000f40 comp rx=0 tx=0).stop 2024-08-17T02:29:00.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.085+0000 7f7a90eb6700 1 -- 172.21.15.102:0/1423512613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a8c154900 msgr2=0x7f7a8c0c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.085+0000 7f7a90eb6700 1 --2- 172.21.15.102:0/1423512613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a8c154900 0x7f7a8c0c9630 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009f80 tx=0x7f7a7c016000 comp rx=0 tx=0).stop 2024-08-17T02:29:00.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.085+0000 7f7a90eb6700 1 -- 172.21.15.102:0/1423512613 shutdown_connections 2024-08-17T02:29:00.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.085+0000 7f7a90eb6700 1 --2- 172.21.15.102:0/1423512613 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7a78060890 0x7f7a78062d40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.085+0000 7f7a90eb6700 1 --2- 172.21.15.102:0/1423512613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a8c154900 0x7f7a8c0c9630 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.085+0000 7f7a90eb6700 1 --2- 172.21.15.102:0/1423512613 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7a8c0cb560 0x7f7a8c145580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.085+0000 7f7a90eb6700 1 --2- 172.21.15.102:0/1423512613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a8c0b14a0 0x7f7a8c151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.085+0000 7f7a90eb6700 1 -- 172.21.15.102:0/1423512613 >> 172.21.15.102:0/1423512613 conn(0x7f7a8c0678d0 msgr2=0x7f7a8c15d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:00.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.085+0000 7f7a90eb6700 1 -- 172.21.15.102:0/1423512613 shutdown_connections 2024-08-17T02:29:00.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.085+0000 7f7a90eb6700 1 -- 172.21.15.102:0/1423512613 wait complete. 2024-08-17T02:29:00.093 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 17 2024-08-17T02:29:00.104 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:00.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.201+0000 7fc53d6ad700 1 Processor -- start 2024-08-17T02:29:00.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.201+0000 7fc53d6ad700 1 -- start start 2024-08-17T02:29:00.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53d6ad700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc5381613e0 0x7fc5381617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53d6ad700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5380b1a90 0x7fc5380ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53d6ad700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5380adfa0 0x7fc5380ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53d6ad700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5380acf00 con 0x7fc5380b1a90 2024-08-17T02:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53d6ad700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5380ad1e0 con 0x7fc5381613e0 2024-08-17T02:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53d6ad700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5380ad4c0 con 0x7fc5380adfa0 2024-08-17T02:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc5377fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5380b1a90 0x7fc5380ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc5377fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5380b1a90 0x7fc5380ac6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38822/0 (socket says 172.21.15.102:38822) 2024-08-17T02:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc5377fe700 1 -- 172.21.15.102:0/3049172759 learned_addr learned my addr 172.21.15.102:0/3049172759 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc537fff700 1 --2- 172.21.15.102:0/3049172759 >> v2:172.21.15.121:3300/0 conn(0x7fc5381613e0 0x7fc5381617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53ceac700 1 --2- 172.21.15.102:0/3049172759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5380adfa0 0x7fc5380ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc5377fe700 1 -- 172.21.15.102:0/3049172759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5380adfa0 msgr2=0x7fc5380ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc5377fe700 1 --2- 172.21.15.102:0/3049172759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5380adfa0 0x7fc5380ae3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc5377fe700 1 -- 172.21.15.102:0/3049172759 >> v2:172.21.15.121:3300/0 conn(0x7fc5381613e0 msgr2=0x7fc5381617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc5377fe700 1 --2- 172.21.15.102:0/3049172759 >> v2:172.21.15.121:3300/0 conn(0x7fc5381613e0 0x7fc5381617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc5377fe700 1 -- 172.21.15.102:0/3049172759 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5380ad7a0 con 0x7fc5380b1a90 2024-08-17T02:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53ceac700 1 --2- 172.21.15.102:0/3049172759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5380adfa0 0x7fc5380ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc5377fe700 1 --2- 172.21.15.102:0/3049172759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5380b1a90 0x7fc5380ac6d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc538070260 tx=0x7fc528009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509e851a6bf06274 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:00.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc536ffd700 1 -- 172.21.15.102:0/3049172759 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52800b860 con 0x7fc5380b1a90 2024-08-17T02:29:00.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc536ffd700 1 -- 172.21.15.102:0/3049172759 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52800b9c0 con 0x7fc5380b1a90 2024-08-17T02:29:00.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc536ffd700 1 -- 172.21.15.102:0/3049172759 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52800bd60 con 0x7fc5380b1a90 2024-08-17T02:29:00.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53d6ad700 1 -- 172.21.15.102:0/3049172759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5380b1a90 msgr2=0x7fc5380ac6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53d6ad700 1 --2- 172.21.15.102:0/3049172759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5380b1a90 0x7fc5380ac6d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc538070260 tx=0x7fc528009250 comp rx=0 tx=0).stop 2024-08-17T02:29:00.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53d6ad700 1 -- 172.21.15.102:0/3049172759 shutdown_connections 2024-08-17T02:29:00.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53d6ad700 1 --2- 172.21.15.102:0/3049172759 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5380adfa0 0x7fc5380ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53d6ad700 1 --2- 172.21.15.102:0/3049172759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5380b1a90 0x7fc5380ac6d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53d6ad700 1 --2- 172.21.15.102:0/3049172759 >> v2:172.21.15.121:3300/0 conn(0x7fc5381613e0 0x7fc5381617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53d6ad700 1 -- 172.21.15.102:0/3049172759 >> 172.21.15.102:0/3049172759 conn(0x7fc5380c9840 msgr2=0x7fc5380c9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:00.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53d6ad700 1 -- 172.21.15.102:0/3049172759 shutdown_connections 2024-08-17T02:29:00.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.205+0000 7fc53d6ad700 1 -- 172.21.15.102:0/3049172759 wait complete. 2024-08-17T02:29:00.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc53d6ad700 1 Processor -- start 2024-08-17T02:29:00.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc53d6ad700 1 -- start start 2024-08-17T02:29:00.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc53d6ad700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5380adfa0 0x7fc538156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc53d6ad700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5380b1a90 0x7fc538153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc53d6ad700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5381613e0 0x7fc53816dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc53d6ad700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc538154310 con 0x7fc5380b1a90 2024-08-17T02:29:00.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc53d6ad700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc538155150 con 0x7fc5380adfa0 2024-08-17T02:29:00.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc53d6ad700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc538154540 con 0x7fc5381613e0 2024-08-17T02:29:00.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc5377fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5380b1a90 0x7fc538153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc5377fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5380b1a90 0x7fc538153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38838/0 (socket says 172.21.15.102:38838) 2024-08-17T02:29:00.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc537fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5380adfa0 0x7fc538156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc5377fe700 1 -- 172.21.15.102:0/2887146667 learned_addr learned my addr 172.21.15.102:0/2887146667 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:00.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc53ceac700 1 --2- 172.21.15.102:0/2887146667 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5381613e0 0x7fc53816dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc5377fe700 1 -- 172.21.15.102:0/2887146667 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5381613e0 msgr2=0x7fc53816dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc5377fe700 1 --2- 172.21.15.102:0/2887146667 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5381613e0 0x7fc53816dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc5377fe700 1 -- 172.21.15.102:0/2887146667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5380adfa0 msgr2=0x7fc538156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc5377fe700 1 --2- 172.21.15.102:0/2887146667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5380adfa0 0x7fc538156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.209+0000 7fc5377fe700 1 -- 172.21.15.102:0/2887146667 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5280094f0 con 0x7fc5380b1a90 2024-08-17T02:29:00.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.213+0000 7fc5377fe700 1 --2- 172.21.15.102:0/2887146667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5380b1a90 0x7fc538153dd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc53806d390 tx=0x7fc528017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:00.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.213+0000 7fc51ffff700 1 -- 172.21.15.102:0/2887146667 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528011dc0 con 0x7fc5380b1a90 2024-08-17T02:29:00.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.213+0000 7fc51ffff700 1 -- 172.21.15.102:0/2887146667 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc528024440 con 0x7fc5380b1a90 2024-08-17T02:29:00.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.213+0000 7fc53d6ad700 1 -- 172.21.15.102:0/2887146667 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc538154820 con 0x7fc5380b1a90 2024-08-17T02:29:00.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.213+0000 7fc51ffff700 1 -- 172.21.15.102:0/2887146667 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528024800 con 0x7fc5380b1a90 2024-08-17T02:29:00.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.213+0000 7fc53d6ad700 1 -- 172.21.15.102:0/2887146667 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc538154de0 con 0x7fc5380b1a90 2024-08-17T02:29:00.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.213+0000 7fc53d6ad700 1 -- 172.21.15.102:0/2887146667 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5380638f0 con 0x7fc5380b1a90 2024-08-17T02:29:00.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.213+0000 7fc51ffff700 1 -- 172.21.15.102:0/2887146667 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc52801a420 con 0x7fc5380b1a90 2024-08-17T02:29:00.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.213+0000 7fc51ffff700 1 --2- 172.21.15.102:0/2887146667 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc524060890 0x7fc524062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.213+0000 7fc537fff700 1 --2- 172.21.15.102:0/2887146667 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc524060890 0x7fc524062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.213+0000 7fc51ffff700 1 -- 172.21.15.102:0/2887146667 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fc52807ee30 con 0x7fc5380b1a90 2024-08-17T02:29:00.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.213+0000 7fc537fff700 1 --2- 172.21.15.102:0/2887146667 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc524060890 0x7fc524062d40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc53815fab0 tx=0x7fc52c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:00.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.221+0000 7fc51ffff700 1 -- 172.21.15.102:0/2887146667 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc52804ee60 con 0x7fc5380b1a90 2024-08-17T02:29:00.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.385+0000 7fc53d6ad700 1 -- 172.21.15.102:0/2887146667 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5381552c0 con 0x7fc5380b1a90 2024-08-17T02:29:00.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.389+0000 7fc51ffff700 1 -- 172.21.15.102:0/2887146667 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18647 (secure 0 0 0) 0x7fc528052480 con 0x7fc5380b1a90 2024-08-17T02:29:00.395 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:00.395 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":36,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:26:59.293808+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:40.530641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:41.227445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000658238.meta","create_time":"2024-08-17T02:26:55.316074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000658238"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000658238.data","create_time":"2024-08-17T02:26:56.329435+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000658238"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:00.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.389+0000 7fc53d6ad700 1 -- 172.21.15.102:0/2887146667 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc524060890 msgr2=0x7fc524062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.389+0000 7fc53d6ad700 1 --2- 172.21.15.102:0/2887146667 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc524060890 0x7fc524062d40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc53815fab0 tx=0x7fc52c008040 comp rx=0 tx=0).stop 2024-08-17T02:29:00.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.389+0000 7fc53d6ad700 1 -- 172.21.15.102:0/2887146667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5380b1a90 msgr2=0x7fc538153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.389+0000 7fc53d6ad700 1 --2- 172.21.15.102:0/2887146667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5380b1a90 0x7fc538153dd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc53806d390 tx=0x7fc528017000 comp rx=0 tx=0).stop 2024-08-17T02:29:00.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.389+0000 7fc53d6ad700 1 -- 172.21.15.102:0/2887146667 shutdown_connections 2024-08-17T02:29:00.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.389+0000 7fc53d6ad700 1 --2- 172.21.15.102:0/2887146667 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc524060890 0x7fc524062d40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.389+0000 7fc53d6ad700 1 --2- 172.21.15.102:0/2887146667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5380b1a90 0x7fc538153dd0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.389+0000 7fc53d6ad700 1 --2- 172.21.15.102:0/2887146667 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc5381613e0 0x7fc53816dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.389+0000 7fc53d6ad700 1 --2- 172.21.15.102:0/2887146667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5380adfa0 0x7fc538156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.389+0000 7fc53d6ad700 1 -- 172.21.15.102:0/2887146667 >> 172.21.15.102:0/2887146667 conn(0x7fc5380c9840 msgr2=0x7fc53815cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:00.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.389+0000 7fc53d6ad700 1 -- 172.21.15.102:0/2887146667 shutdown_connections 2024-08-17T02:29:00.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.389+0000 7fc53d6ad700 1 -- 172.21.15.102:0/2887146667 wait complete. 2024-08-17T02:29:00.412 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:49.236728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:40.530641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:41.227445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000658238.meta', 'create_time': '2024-08-17T02:26:55.316074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000658238'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000658238.data', 'create_time': '2024-08-17T02:26:56.329435+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000658238'}}}] 2024-08-17T02:29:00.412 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:00.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa3fff700 1 Processor -- start 2024-08-17T02:29:00.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa3fff700 1 -- start start 2024-08-17T02:29:00.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa3fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8fa413f680 0x7f8fa40aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa3fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8fa40ad6c0 0x7f8fa406e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa3fff700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa40b0810 con 0x7f8fa413fa50 2024-08-17T02:29:00.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa3fff700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa40afc70 con 0x7f8fa40ad6c0 2024-08-17T02:29:00.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa3fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa40af060 con 0x7f8fa413f680 2024-08-17T02:29:00.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa37fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8fa40ad6c0 0x7f8fa406e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8f9a7fc700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f8fa413fa50 0x7f8fa40b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:58622/0 (socket says 172.21.15.102:58622) 2024-08-17T02:29:00.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8f9a7fc700 1 -- 172.21.15.102:0/3807288233 learned_addr learned my addr 172.21.15.102:0/3807288233 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:00.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa2ffd700 1 --2- 172.21.15.102:0/3807288233 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8fa413f680 0x7f8fa40aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa37fe700 1 -- 172.21.15.102:0/3807288233 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8fa413f680 msgr2=0x7f8fa40aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:00.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa37fe700 1 --2- 172.21.15.102:0/3807288233 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8fa413f680 0x7f8fa40aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa37fe700 1 -- 172.21.15.102:0/3807288233 >> v1:172.21.15.102:6789/0 conn(0x7f8fa413fa50 legacy=0x7f8fa40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa37fe700 1 -- 172.21.15.102:0/3807288233 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa40af340 con 0x7f8fa40ad6c0 2024-08-17T02:29:00.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa37fe700 1 --2- 172.21.15.102:0/3807288233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fa40ad6c0 0x7f8fa406e010 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009e60 tx=0x7f8f9c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379821d8eb4c900d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:00.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa27fc700 1 -- 172.21.15.102:0/3807288233 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00e070 con 0x7f8fa40ad6c0 2024-08-17T02:29:00.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa27fc700 1 -- 172.21.15.102:0/3807288233 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c00bc30 con 0x7f8fa40ad6c0 2024-08-17T02:29:00.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa27fc700 1 -- 172.21.15.102:0/3807288233 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c012430 con 0x7f8fa40ad6c0 2024-08-17T02:29:00.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa3fff700 1 -- 172.21.15.102:0/3807288233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fa40ad6c0 msgr2=0x7f8fa406e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa3fff700 1 --2- 172.21.15.102:0/3807288233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fa40ad6c0 0x7f8fa406e010 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009e60 tx=0x7f8f9c009780 comp rx=0 tx=0).stop 2024-08-17T02:29:00.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa3fff700 1 -- 172.21.15.102:0/3807288233 shutdown_connections 2024-08-17T02:29:00.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa3fff700 1 --2- 172.21.15.102:0/3807288233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fa40ad6c0 0x7f8fa406e010 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa3fff700 1 --2- 172.21.15.102:0/3807288233 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8fa413f680 0x7f8fa40aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa3fff700 1 -- 172.21.15.102:0/3807288233 >> 172.21.15.102:0/3807288233 conn(0x7f8fa40678a0 msgr2=0x7f8fa4067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:00.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa3fff700 1 -- 172.21.15.102:0/3807288233 shutdown_connections 2024-08-17T02:29:00.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.517+0000 7f8fa3fff700 1 -- 172.21.15.102:0/3807288233 wait complete. 2024-08-17T02:29:00.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.521+0000 7f8fa3fff700 1 Processor -- start 2024-08-17T02:29:00.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.521+0000 7f8fa3fff700 1 -- start start 2024-08-17T02:29:00.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.521+0000 7f8fa3fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8fa40ad6c0 0x7f8fa4131870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.521+0000 7f8fa3fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fa413f680 0x7f8fa41330a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.521+0000 7f8fa3fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8fa413fa50 0x7f8fa41305c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.521+0000 7f8fa3fff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa41339f0 con 0x7f8fa413f680 2024-08-17T02:29:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.521+0000 7f8fa3fff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa406a7f0 con 0x7f8fa413fa50 2024-08-17T02:29:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.521+0000 7f8fa3fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa406a360 con 0x7f8fa40ad6c0 2024-08-17T02:29:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.521+0000 7f8f9a7fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fa413f680 0x7f8fa41330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.521+0000 7f8f9a7fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fa413f680 0x7f8fa41330a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38864/0 (socket says 172.21.15.102:38864) 2024-08-17T02:29:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.521+0000 7f8f9a7fc700 1 -- 172.21.15.102:0/1923369210 learned_addr learned my addr 172.21.15.102:0/1923369210 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:00.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.521+0000 7f8fa2ffd700 1 --2- 172.21.15.102:0/1923369210 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8fa40ad6c0 0x7f8fa4131870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.521+0000 7f8fa37fe700 1 --2- 172.21.15.102:0/1923369210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8fa413fa50 0x7f8fa41305c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.525+0000 7f8f9a7fc700 1 -- 172.21.15.102:0/1923369210 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8fa40ad6c0 msgr2=0x7f8fa4131870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.525+0000 7f8f9a7fc700 1 --2- 172.21.15.102:0/1923369210 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8fa40ad6c0 0x7f8fa4131870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.525+0000 7f8f9a7fc700 1 -- 172.21.15.102:0/1923369210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8fa413fa50 msgr2=0x7f8fa41305c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.525+0000 7f8f9a7fc700 1 --2- 172.21.15.102:0/1923369210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8fa413fa50 0x7f8fa41305c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.525+0000 7f8f9a7fc700 1 -- 172.21.15.102:0/1923369210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c009a20 con 0x7f8fa413f680 2024-08-17T02:29:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.525+0000 7f8f9a7fc700 1 --2- 172.21.15.102:0/1923369210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fa413f680 0x7f8fa41330a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00c5c0 tx=0x7f8f8c001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.525+0000 7f8f9b7fe700 1 -- 172.21.15.102:0/1923369210 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c005b30 con 0x7f8fa413f680 2024-08-17T02:29:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.525+0000 7f8f9b7fe700 1 -- 172.21.15.102:0/1923369210 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c005cb0 con 0x7f8fa413f680 2024-08-17T02:29:00.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.525+0000 7f8f9b7fe700 1 -- 172.21.15.102:0/1923369210 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c007320 con 0x7f8fa413f680 2024-08-17T02:29:00.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.525+0000 7f8fa3fff700 1 -- 172.21.15.102:0/1923369210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa4069a30 con 0x7f8fa413f680 2024-08-17T02:29:00.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.525+0000 7f8fa3fff700 1 -- 172.21.15.102:0/1923369210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa406a070 con 0x7f8fa413f680 2024-08-17T02:29:00.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.525+0000 7f8f9b7fe700 1 -- 172.21.15.102:0/1923369210 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8f8c01b3b0 con 0x7f8fa413f680 2024-08-17T02:29:00.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.525+0000 7f8fa3fff700 1 -- 172.21.15.102:0/1923369210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa4064330 con 0x7f8fa413f680 2024-08-17T02:29:00.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.525+0000 7f8f9b7fe700 1 --2- 172.21.15.102:0/1923369210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8f84060860 0x7f8f84062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.525+0000 7f8fa2ffd700 1 --2- 172.21.15.102:0/1923369210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8f84060860 0x7f8f84062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.525+0000 7f8f9b7fe700 1 -- 172.21.15.102:0/1923369210 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f8f8c07c270 con 0x7f8fa413f680 2024-08-17T02:29:00.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.529+0000 7f8fa2ffd700 1 --2- 172.21.15.102:0/1923369210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8f84060860 0x7f8f84062d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8f94006fd0 tx=0x7f8f94008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:00.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.533+0000 7f8f9b7fe700 1 -- 172.21.15.102:0/1923369210 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8f8c04c340 con 0x7f8fa413f680 2024-08-17T02:29:00.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.681+0000 7f8fa3fff700 1 -- 172.21.15.102:0/1923369210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fa406ed70 con 0x7f8fa413f680 2024-08-17T02:29:00.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.681+0000 7f8f9b7fe700 1 -- 172.21.15.102:0/1923369210 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f8c04f960 con 0x7f8fa413f680 2024-08-17T02:29:00.688 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-08-17T02:29:00.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.685+0000 7f8fa3fff700 1 -- 172.21.15.102:0/1923369210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8f84060860 msgr2=0x7f8f84062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.685+0000 7f8fa3fff700 1 --2- 172.21.15.102:0/1923369210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8f84060860 0x7f8f84062d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8f94006fd0 tx=0x7f8f94008040 comp rx=0 tx=0).stop 2024-08-17T02:29:00.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.685+0000 7f8fa3fff700 1 -- 172.21.15.102:0/1923369210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fa413f680 msgr2=0x7f8fa41330a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.685+0000 7f8fa3fff700 1 --2- 172.21.15.102:0/1923369210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fa413f680 0x7f8fa41330a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00c5c0 tx=0x7f8f8c001020 comp rx=0 tx=0).stop 2024-08-17T02:29:00.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.685+0000 7f8fa3fff700 1 -- 172.21.15.102:0/1923369210 shutdown_connections 2024-08-17T02:29:00.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.685+0000 7f8fa3fff700 1 --2- 172.21.15.102:0/1923369210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8f84060860 0x7f8f84062d10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.685+0000 7f8fa3fff700 1 --2- 172.21.15.102:0/1923369210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fa413f680 0x7f8fa41330a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.685+0000 7f8fa3fff700 1 --2- 172.21.15.102:0/1923369210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8fa413fa50 0x7f8fa41305c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.685+0000 7f8fa3fff700 1 --2- 172.21.15.102:0/1923369210 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8fa40ad6c0 0x7f8fa4131870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.685+0000 7f8fa3fff700 1 -- 172.21.15.102:0/1923369210 >> 172.21.15.102:0/1923369210 conn(0x7f8fa40678a0 msgr2=0x7f8fa4067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:00.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.685+0000 7f8fa3fff700 1 -- 172.21.15.102:0/1923369210 shutdown_connections 2024-08-17T02:29:00.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.685+0000 7f8fa3fff700 1 -- 172.21.15.102:0/1923369210 wait complete. 2024-08-17T02:29:00.707 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:29:00.781 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:00.783 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:00.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.801+0000 7fca05cb4700 1 Processor -- start 2024-08-17T02:29:00.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.801+0000 7fca05cb4700 1 -- start start 2024-08-17T02:29:00.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca05cb4700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fca001590b0 0x7fca00066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca05cb4700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fca000cd2b0 0x7fca00067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca05cb4700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca000ce210 con 0x7fca00159480 2024-08-17T02:29:00.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca05cb4700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca000cba00 con 0x7fca001590b0 2024-08-17T02:29:00.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca05cb4700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca000cdc90 con 0x7fca000cd2b0 2024-08-17T02:29:00.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca04cb2700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fca001590b0 0x7fca00066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca04cb2700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fca001590b0 0x7fca00066e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38868/0 (socket says 172.21.15.102:38868) 2024-08-17T02:29:00.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca04cb2700 1 -- 172.21.15.102:0/3878909931 learned_addr learned my addr 172.21.15.102:0/3878909931 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:00.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca054b3700 1 --2- 172.21.15.102:0/3878909931 >> v2:172.21.15.121:3300/0 conn(0x7fca000cd2b0 0x7fca00067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca04cb2700 1 -- 172.21.15.102:0/3878909931 >> v2:172.21.15.121:3300/0 conn(0x7fca000cd2b0 msgr2=0x7fca00067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:00.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca04cb2700 1 --2- 172.21.15.102:0/3878909931 >> v2:172.21.15.121:3300/0 conn(0x7fca000cd2b0 0x7fca00067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca04cb2700 1 -- 172.21.15.102:0/3878909931 >> v1:172.21.15.102:6789/0 conn(0x7fca00159480 legacy=0x7fca0015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca04cb2700 1 -- 172.21.15.102:0/3878909931 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca000cb440 con 0x7fca001590b0 2024-08-17T02:29:00.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca054b3700 1 --2- 172.21.15.102:0/3878909931 >> v2:172.21.15.121:3300/0 conn(0x7fca000cd2b0 0x7fca00067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:00.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca04cb2700 1 --2- 172.21.15.102:0/3878909931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca001590b0 0x7fca00066e00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fca000ca690 tx=0x7fc9f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c62398037fdba2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:00.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fc9ff7fe700 1 -- 172.21.15.102:0/3878909931 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f800e070 con 0x7fca001590b0 2024-08-17T02:29:00.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fc9ff7fe700 1 -- 172.21.15.102:0/3878909931 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f800ba50 con 0x7fca001590b0 2024-08-17T02:29:00.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fc9ff7fe700 1 -- 172.21.15.102:0/3878909931 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f80092e0 con 0x7fca001590b0 2024-08-17T02:29:00.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca05cb4700 1 -- 172.21.15.102:0/3878909931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca001590b0 msgr2=0x7fca00066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca05cb4700 1 --2- 172.21.15.102:0/3878909931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca001590b0 0x7fca00066e00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fca000ca690 tx=0x7fc9f8009840 comp rx=0 tx=0).stop 2024-08-17T02:29:00.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca05cb4700 1 -- 172.21.15.102:0/3878909931 shutdown_connections 2024-08-17T02:29:00.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca05cb4700 1 --2- 172.21.15.102:0/3878909931 >> v2:172.21.15.121:3300/0 conn(0x7fca000cd2b0 0x7fca00067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca05cb4700 1 --2- 172.21.15.102:0/3878909931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca001590b0 0x7fca00066e00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca05cb4700 1 -- 172.21.15.102:0/3878909931 >> 172.21.15.102:0/3878909931 conn(0x7fca000d0b90 msgr2=0x7fca000ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:00.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca05cb4700 1 -- 172.21.15.102:0/3878909931 shutdown_connections 2024-08-17T02:29:00.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.805+0000 7fca05cb4700 1 -- 172.21.15.102:0/3878909931 wait complete. 2024-08-17T02:29:00.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca05cb4700 1 Processor -- start 2024-08-17T02:29:00.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca05cb4700 1 -- start start 2024-08-17T02:29:00.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca05cb4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca000cd2b0 0x7fca00143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca05cb4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca001590b0 0x7fca00140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca05cb4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca00159480 0x7fca000b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca05cb4700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca00142d00 con 0x7fca00159480 2024-08-17T02:29:00.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca05cb4700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca001420f0 con 0x7fca000cd2b0 2024-08-17T02:29:00.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca05cb4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca001423d0 con 0x7fca001590b0 2024-08-17T02:29:00.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca054b3700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca00159480 0x7fca000b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca054b3700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca00159480 0x7fca000b3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38884/0 (socket says 172.21.15.102:38884) 2024-08-17T02:29:00.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca054b3700 1 -- 172.21.15.102:0/2338789973 learned_addr learned my addr 172.21.15.102:0/2338789973 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:00.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fc9fffff700 1 --2- 172.21.15.102:0/2338789973 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca001590b0 0x7fca00140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca04cb2700 1 --2- 172.21.15.102:0/2338789973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca000cd2b0 0x7fca00143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca054b3700 1 -- 172.21.15.102:0/2338789973 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca001590b0 msgr2=0x7fca00140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca054b3700 1 --2- 172.21.15.102:0/2338789973 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca001590b0 0x7fca00140bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca054b3700 1 -- 172.21.15.102:0/2338789973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca000cd2b0 msgr2=0x7fca00143190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca054b3700 1 --2- 172.21.15.102:0/2338789973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca000cd2b0 0x7fca00143190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca054b3700 1 -- 172.21.15.102:0/2338789973 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f8009ae0 con 0x7fca00159480 2024-08-17T02:29:00.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.809+0000 7fca054b3700 1 --2- 172.21.15.102:0/2338789973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca00159480 0x7fca000b3e30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000c880 tx=0x7fc9f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:00.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.813+0000 7fc9fcff9700 1 -- 172.21.15.102:0/2338789973 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0011600 con 0x7fca00159480 2024-08-17T02:29:00.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.813+0000 7fc9fcff9700 1 -- 172.21.15.102:0/2338789973 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f0011780 con 0x7fca00159480 2024-08-17T02:29:00.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.813+0000 7fca05cb4700 1 -- 172.21.15.102:0/2338789973 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca001426b0 con 0x7fca00159480 2024-08-17T02:29:00.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.813+0000 7fc9fcff9700 1 -- 172.21.15.102:0/2338789973 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0011b40 con 0x7fca00159480 2024-08-17T02:29:00.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.813+0000 7fca05cb4700 1 -- 172.21.15.102:0/2338789973 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca001436d0 con 0x7fca00159480 2024-08-17T02:29:00.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.813+0000 7fca05cb4700 1 -- 172.21.15.102:0/2338789973 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca00142eb0 con 0x7fca00159480 2024-08-17T02:29:00.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.813+0000 7fc9fcff9700 1 -- 172.21.15.102:0/2338789973 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc9f0022350 con 0x7fca00159480 2024-08-17T02:29:00.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.813+0000 7fc9fcff9700 1 --2- 172.21.15.102:0/2338789973 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc9ec060860 0x7fc9ec062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:00.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.813+0000 7fca04cb2700 1 --2- 172.21.15.102:0/2338789973 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc9ec060860 0x7fc9ec062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:00.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.813+0000 7fc9fcff9700 1 -- 172.21.15.102:0/2338789973 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fc9f007cee0 con 0x7fca00159480 2024-08-17T02:29:00.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.817+0000 7fca04cb2700 1 --2- 172.21.15.102:0/2338789973 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc9ec060860 0x7fc9ec062d10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009880 tx=0x7fc9f8018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:00.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.825+0000 7fc9fcff9700 1 -- 172.21.15.102:0/2338789973 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fca00142eb0 con 0x7fca00159480 2024-08-17T02:29:00.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.985+0000 7fca05cb4700 1 -- 172.21.15.102:0/2338789973 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca00064330 con 0x7fca00159480 2024-08-17T02:29:00.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.985+0000 7fc9fcff9700 1 -- 172.21.15.102:0/2338789973 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc9f0050a40 con 0x7fca00159480 2024-08-17T02:29:00.994 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-08-17T02:29:00.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.989+0000 7fca05cb4700 1 -- 172.21.15.102:0/2338789973 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc9ec060860 msgr2=0x7fc9ec062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.989+0000 7fca05cb4700 1 --2- 172.21.15.102:0/2338789973 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc9ec060860 0x7fc9ec062d10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009880 tx=0x7fc9f8018000 comp rx=0 tx=0).stop 2024-08-17T02:29:00.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.989+0000 7fca05cb4700 1 -- 172.21.15.102:0/2338789973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca00159480 msgr2=0x7fca000b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:00.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.989+0000 7fca05cb4700 1 --2- 172.21.15.102:0/2338789973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca00159480 0x7fca000b3e30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000c880 tx=0x7fc9f0008040 comp rx=0 tx=0).stop 2024-08-17T02:29:00.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.989+0000 7fca05cb4700 1 -- 172.21.15.102:0/2338789973 shutdown_connections 2024-08-17T02:29:00.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.989+0000 7fca05cb4700 1 --2- 172.21.15.102:0/2338789973 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc9ec060860 0x7fc9ec062d10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.989+0000 7fca05cb4700 1 --2- 172.21.15.102:0/2338789973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca00159480 0x7fca000b3e30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.989+0000 7fca05cb4700 1 --2- 172.21.15.102:0/2338789973 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fca001590b0 0x7fca00140bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.989+0000 7fca05cb4700 1 --2- 172.21.15.102:0/2338789973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca000cd2b0 0x7fca00143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:00.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.989+0000 7fca05cb4700 1 -- 172.21.15.102:0/2338789973 >> 172.21.15.102:0/2338789973 conn(0x7fca000d0b90 msgr2=0x7fca000afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:00.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.989+0000 7fca05cb4700 1 -- 172.21.15.102:0/2338789973 shutdown_connections 2024-08-17T02:29:00.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:00.989+0000 7fca05cb4700 1 -- 172.21.15.102:0/2338789973 wait complete. 2024-08-17T02:29:01.012 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:29:01.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.117+0000 7f3c3f2e2700 1 Processor -- start 2024-08-17T02:29:01.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.117+0000 7f3c3f2e2700 1 -- start start 2024-08-17T02:29:01.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3c381538e0 0x7f3c380b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:01.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3c38153cb0 0x7f3c3806ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:01.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c380b0ad0 con 0x7f3c3806f180 2024-08-17T02:29:01.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3806f5a0 con 0x7f3c38153cb0 2024-08-17T02:29:01.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3815a940 con 0x7f3c381538e0 2024-08-17T02:29:01.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3c87d700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3c38153cb0 0x7f3c3806ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:01.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3d87f700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f3c3806f180 0x7f3c38159bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:58642/0 (socket says 172.21.15.102:58642) 2024-08-17T02:29:01.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3d87f700 1 -- 172.21.15.102:0/21345171 learned_addr learned my addr 172.21.15.102:0/21345171 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:01.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3d07e700 1 --2- 172.21.15.102:0/21345171 >> v2:172.21.15.121:3300/0 conn(0x7f3c381538e0 0x7f3c380b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:01.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c2ffff700 1 -- 172.21.15.102:0/21345171 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608583700 0 0) 0x7f3c380b0ad0 con 0x7f3c3806f180 2024-08-17T02:29:01.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c2ffff700 1 -- 172.21.15.102:0/21345171 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c24003570 con 0x7f3c3806f180 2024-08-17T02:29:01.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3c87d700 1 -- 172.21.15.102:0/21345171 >> v2:172.21.15.121:3300/0 conn(0x7f3c381538e0 msgr2=0x7f3c380b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:01.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3c87d700 1 --2- 172.21.15.102:0/21345171 >> v2:172.21.15.121:3300/0 conn(0x7f3c381538e0 0x7f3c380b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3c87d700 1 -- 172.21.15.102:0/21345171 >> v1:172.21.15.102:6789/0 conn(0x7f3c3806f180 legacy=0x7f3c38159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3c87d700 1 -- 172.21.15.102:0/21345171 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c380b01a0 con 0x7f3c38153cb0 2024-08-17T02:29:01.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3c87d700 1 --2- 172.21.15.102:0/21345171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c38153cb0 0x7f3c3806ec40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3c38071080 tx=0x7f3c280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5a45f54fe74356 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:01.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c2ffff700 1 -- 172.21.15.102:0/21345171 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28011630 con 0x7f3c38153cb0 2024-08-17T02:29:01.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c2ffff700 1 -- 172.21.15.102:0/21345171 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c280117b0 con 0x7f3c38153cb0 2024-08-17T02:29:01.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c2ffff700 1 -- 172.21.15.102:0/21345171 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28011b70 con 0x7f3c38153cb0 2024-08-17T02:29:01.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 -- 172.21.15.102:0/21345171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c38153cb0 msgr2=0x7f3c3806ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 --2- 172.21.15.102:0/21345171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c38153cb0 0x7f3c3806ec40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3c38071080 tx=0x7f3c280091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 -- 172.21.15.102:0/21345171 shutdown_connections 2024-08-17T02:29:01.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 --2- 172.21.15.102:0/21345171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c38153cb0 0x7f3c3806ec40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 --2- 172.21.15.102:0/21345171 >> v2:172.21.15.121:3300/0 conn(0x7f3c381538e0 0x7f3c380b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 -- 172.21.15.102:0/21345171 >> 172.21.15.102:0/21345171 conn(0x7f3c38066e00 msgr2=0x7f3c38067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:01.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 -- 172.21.15.102:0/21345171 shutdown_connections 2024-08-17T02:29:01.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 -- 172.21.15.102:0/21345171 wait complete. 2024-08-17T02:29:01.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 Processor -- start 2024-08-17T02:29:01.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 -- start start 2024-08-17T02:29:01.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c3806f180 0x7f3c3814dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:01.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c381538e0 0x7f3c38099080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:01.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c38153cb0 0x7f3c381640b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:01.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38098bf0 con 0x7f3c381538e0 2024-08-17T02:29:01.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38097d40 con 0x7f3c38153cb0 2024-08-17T02:29:01.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38097fe0 con 0x7f3c3806f180 2024-08-17T02:29:01.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3c87d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c381538e0 0x7f3c38099080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:01.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3c87d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c381538e0 0x7f3c38099080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38900/0 (socket says 172.21.15.102:38900) 2024-08-17T02:29:01.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3c87d700 1 -- 172.21.15.102:0/1846376943 learned_addr learned my addr 172.21.15.102:0/1846376943 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:01.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3d07e700 1 --2- 172.21.15.102:0/1846376943 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c3806f180 0x7f3c3814dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:01.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3d87f700 1 --2- 172.21.15.102:0/1846376943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c38153cb0 0x7f3c381640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:01.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3c87d700 1 -- 172.21.15.102:0/1846376943 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c3806f180 msgr2=0x7f3c3814dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3c87d700 1 --2- 172.21.15.102:0/1846376943 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c3806f180 0x7f3c3814dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3c87d700 1 -- 172.21.15.102:0/1846376943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c38153cb0 msgr2=0x7f3c381640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3c87d700 1 --2- 172.21.15.102:0/1846376943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c38153cb0 0x7f3c381640b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3c87d700 1 -- 172.21.15.102:0/1846376943 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c28009420 con 0x7f3c381538e0 2024-08-17T02:29:01.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3d87f700 1 --2- 172.21.15.102:0/1846376943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c38153cb0 0x7f3c381640b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:01.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3c87d700 1 --2- 172.21.15.102:0/1846376943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c381538e0 0x7f3c38099080 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3c28013000 tx=0x7f3c28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:01.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c2d7fa700 1 -- 172.21.15.102:0/1846376943 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2801f070 con 0x7f3c381538e0 2024-08-17T02:29:01.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c2d7fa700 1 -- 172.21.15.102:0/1846376943 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c28000bc0 con 0x7f3c381538e0 2024-08-17T02:29:01.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 -- 172.21.15.102:0/1846376943 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c380982c0 con 0x7f3c381538e0 2024-08-17T02:29:01.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c2d7fa700 1 -- 172.21.15.102:0/1846376943 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28011b70 con 0x7f3c381538e0 2024-08-17T02:29:01.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.121+0000 7f3c3f2e2700 1 -- 172.21.15.102:0/1846376943 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c38098880 con 0x7f3c381538e0 2024-08-17T02:29:01.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.125+0000 7f3c2d7fa700 1 -- 172.21.15.102:0/1846376943 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3c28023070 con 0x7f3c381538e0 2024-08-17T02:29:01.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.125+0000 7f3c2d7fa700 1 --2- 172.21.15.102:0/1846376943 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3c1c060890 0x7f3c1c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:01.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.125+0000 7f3c3f2e2700 1 -- 172.21.15.102:0/1846376943 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c380645c0 con 0x7f3c381538e0 2024-08-17T02:29:01.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.125+0000 7f3c3d07e700 1 --2- 172.21.15.102:0/1846376943 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3c1c060890 0x7f3c1c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:01.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.125+0000 7f3c2d7fa700 1 -- 172.21.15.102:0/1846376943 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f3c2807e280 con 0x7f3c381538e0 2024-08-17T02:29:01.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.125+0000 7f3c3d07e700 1 --2- 172.21.15.102:0/1846376943 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3c1c060890 0x7f3c1c062d40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009d40 tx=0x7f3c34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:01.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.137+0000 7f3c2d7fa700 1 -- 172.21.15.102:0/1846376943 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3c2804e350 con 0x7f3c381538e0 2024-08-17T02:29:01.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.293+0000 7f3c3f2e2700 1 -- 172.21.15.102:0/1846376943 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3c3806d7c0 con 0x7f3c381538e0 2024-08-17T02:29:01.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.297+0000 7f3c2d7fa700 1 -- 172.21.15.102:0/1846376943 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3c280150a0 con 0x7f3c381538e0 2024-08-17T02:29:01.303 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-08-17T02:29:01.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.297+0000 7f3c3f2e2700 1 -- 172.21.15.102:0/1846376943 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3c1c060890 msgr2=0x7f3c1c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.297+0000 7f3c3f2e2700 1 --2- 172.21.15.102:0/1846376943 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3c1c060890 0x7f3c1c062d40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009d40 tx=0x7f3c34008040 comp rx=0 tx=0).stop 2024-08-17T02:29:01.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.297+0000 7f3c3f2e2700 1 -- 172.21.15.102:0/1846376943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c381538e0 msgr2=0x7f3c38099080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.297+0000 7f3c3f2e2700 1 --2- 172.21.15.102:0/1846376943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c381538e0 0x7f3c38099080 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3c28013000 tx=0x7f3c28017000 comp rx=0 tx=0).stop 2024-08-17T02:29:01.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.297+0000 7f3c3f2e2700 1 -- 172.21.15.102:0/1846376943 shutdown_connections 2024-08-17T02:29:01.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.297+0000 7f3c3f2e2700 1 --2- 172.21.15.102:0/1846376943 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3c1c060890 0x7f3c1c062d40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.297+0000 7f3c3f2e2700 1 --2- 172.21.15.102:0/1846376943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c381538e0 0x7f3c38099080 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.297+0000 7f3c3f2e2700 1 --2- 172.21.15.102:0/1846376943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c38153cb0 0x7f3c381640b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.297+0000 7f3c3f2e2700 1 --2- 172.21.15.102:0/1846376943 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3c3806f180 0x7f3c3814dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.297+0000 7f3c3f2e2700 1 -- 172.21.15.102:0/1846376943 >> 172.21.15.102:0/1846376943 conn(0x7f3c38066e00 msgr2=0x7f3c380ade40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:01.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.297+0000 7f3c3f2e2700 1 -- 172.21.15.102:0/1846376943 shutdown_connections 2024-08-17T02:29:01.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.297+0000 7f3c3f2e2700 1 -- 172.21.15.102:0/1846376943 wait complete. 2024-08-17T02:29:01.317 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000658238.meta pg_num 2024-08-17T02:29:01.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.425+0000 7efd1e20c700 1 Processor -- start 2024-08-17T02:29:01.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.425+0000 7efd1e20c700 1 -- start start 2024-08-17T02:29:01.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.425+0000 7efd1e20c700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd181590b0 0x7efd18066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:01.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.425+0000 7efd1e20c700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd180ce210 con 0x7efd18159480 2024-08-17T02:29:01.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.425+0000 7efd1e20c700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1815dc20 con 0x7efd180cd2b0 2024-08-17T02:29:01.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.425+0000 7efd1e20c700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd180cba00 con 0x7efd181590b0 2024-08-17T02:29:01.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd1ca09700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7efd18159480 0x7efd1815ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:58658/0 (socket says 172.21.15.102:58658) 2024-08-17T02:29:01.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd1ca09700 1 -- 172.21.15.102:0/703025682 learned_addr learned my addr 172.21.15.102:0/703025682 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:01.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd1d20a700 1 --2- 172.21.15.102:0/703025682 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd181590b0 0x7efd18066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:01.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd0bfff700 1 -- 172.21.15.102:0/703025682 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485610031 0 0) 0x7efd180ce210 con 0x7efd18159480 2024-08-17T02:29:01.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd0bfff700 1 -- 172.21.15.102:0/703025682 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd04003570 con 0x7efd18159480 2024-08-17T02:29:01.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd0bfff700 1 -- 172.21.15.102:0/703025682 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679712807 0 0) 0x7efd1815dc20 con 0x7efd180cd2b0 2024-08-17T02:29:01.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd0bfff700 1 -- 172.21.15.102:0/703025682 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd180ce210 con 0x7efd180cd2b0 2024-08-17T02:29:01.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd1d20a700 1 -- 172.21.15.102:0/703025682 >> v1:172.21.15.121:6789/0 conn(0x7efd180cd2b0 legacy=0x7efd1815d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd0bfff700 1 -- 172.21.15.102:0/703025682 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 157709667 0 0) 0x7efd04003570 con 0x7efd18159480 2024-08-17T02:29:01.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd1d20a700 1 -- 172.21.15.102:0/703025682 >> v1:172.21.15.102:6789/0 conn(0x7efd18159480 legacy=0x7efd1815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd1d20a700 1 -- 172.21.15.102:0/703025682 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd180cb440 con 0x7efd181590b0 2024-08-17T02:29:01.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd1d20a700 1 --2- 172.21.15.102:0/703025682 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd181590b0 0x7efd18066e00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd14009910 tx=0x7efd140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=692ab9aa435d5d42 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:01.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd0bfff700 1 -- 172.21.15.102:0/703025682 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c001470 con 0x7efd181590b0 2024-08-17T02:29:01.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd0bfff700 1 -- 172.21.15.102:0/703025682 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd14011420 con 0x7efd181590b0 2024-08-17T02:29:01.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd0bfff700 1 -- 172.21.15.102:0/703025682 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd140117a0 con 0x7efd181590b0 2024-08-17T02:29:01.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd1e20c700 1 -- 172.21.15.102:0/703025682 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd181590b0 msgr2=0x7efd18066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd1e20c700 1 --2- 172.21.15.102:0/703025682 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd181590b0 0x7efd18066e00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd14009910 tx=0x7efd140091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd1e20c700 1 -- 172.21.15.102:0/703025682 shutdown_connections 2024-08-17T02:29:01.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd1e20c700 1 --2- 172.21.15.102:0/703025682 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd181590b0 0x7efd18066e00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd1e20c700 1 -- 172.21.15.102:0/703025682 >> 172.21.15.102:0/703025682 conn(0x7efd180d0b90 msgr2=0x7efd180ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:01.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd1e20c700 1 -- 172.21.15.102:0/703025682 shutdown_connections 2024-08-17T02:29:01.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd1e20c700 1 -- 172.21.15.102:0/703025682 wait complete. 2024-08-17T02:29:01.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd1e20c700 1 Processor -- start 2024-08-17T02:29:01.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.429+0000 7efd1e20c700 1 -- start start 2024-08-17T02:29:01.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1e20c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd180cd2b0 0x7efd18155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:01.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1e20c700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd181590b0 0x7efd1815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:01.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1e20c700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd18159480 0x7efd180b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:01.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1e20c700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd18155640 con 0x7efd180cd2b0 2024-08-17T02:29:01.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1e20c700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1815d5b0 con 0x7efd18159480 2024-08-17T02:29:01.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1e20c700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1815c700 con 0x7efd181590b0 2024-08-17T02:29:01.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1d20a700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd180cd2b0 0x7efd18155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:01.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1d20a700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd180cd2b0 0x7efd18155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38910/0 (socket says 172.21.15.102:38910) 2024-08-17T02:29:01.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1d20a700 1 -- 172.21.15.102:0/3790544851 learned_addr learned my addr 172.21.15.102:0/3790544851 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:01.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1ca09700 1 --2- 172.21.15.102:0/3790544851 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd181590b0 0x7efd1815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:01.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1da0b700 1 --2- 172.21.15.102:0/3790544851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd18159480 0x7efd180b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:01.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1d20a700 1 -- 172.21.15.102:0/3790544851 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd181590b0 msgr2=0x7efd1815ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1d20a700 1 --2- 172.21.15.102:0/3790544851 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd181590b0 0x7efd1815ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1d20a700 1 -- 172.21.15.102:0/3790544851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd18159480 msgr2=0x7efd180b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1d20a700 1 --2- 172.21.15.102:0/3790544851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd18159480 0x7efd180b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1d20a700 1 -- 172.21.15.102:0/3790544851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd14009420 con 0x7efd180cd2b0 2024-08-17T02:29:01.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1da0b700 1 --2- 172.21.15.102:0/3790544851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd18159480 0x7efd180b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:01.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1d20a700 1 --2- 172.21.15.102:0/3790544851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd180cd2b0 0x7efd18155100 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efd14009860 tx=0x7efd14016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:01.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd097fa700 1 -- 172.21.15.102:0/3790544851 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1401caf0 con 0x7efd180cd2b0 2024-08-17T02:29:01.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd097fa700 1 -- 172.21.15.102:0/3790544851 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1401cc50 con 0x7efd180cd2b0 2024-08-17T02:29:01.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1e20c700 1 -- 172.21.15.102:0/3790544851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd180c8730 con 0x7efd180cd2b0 2024-08-17T02:29:01.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd097fa700 1 -- 172.21.15.102:0/3790544851 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1401a450 con 0x7efd180cd2b0 2024-08-17T02:29:01.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1e20c700 1 -- 172.21.15.102:0/3790544851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1815cc80 con 0x7efd180cd2b0 2024-08-17T02:29:01.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.433+0000 7efd1e20c700 1 -- 172.21.15.102:0/3790544851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd18064330 con 0x7efd180cd2b0 2024-08-17T02:29:01.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.437+0000 7efd097fa700 1 -- 172.21.15.102:0/3790544851 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7efd1401a840 con 0x7efd180cd2b0 2024-08-17T02:29:01.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.437+0000 7efd097fa700 1 --2- 172.21.15.102:0/3790544851 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7efcfc060860 0x7efcfc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:01.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.437+0000 7efd097fa700 1 -- 172.21.15.102:0/3790544851 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7efd1407e7d0 con 0x7efd180cd2b0 2024-08-17T02:29:01.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.437+0000 7efd1ca09700 1 --2- 172.21.15.102:0/3790544851 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7efcfc060860 0x7efcfc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:01.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.437+0000 7efd1ca09700 1 --2- 172.21.15.102:0/3790544851 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7efcfc060860 0x7efcfc062d10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efd180b5510 tx=0x7efd0c000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:01.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.445+0000 7efd097fa700 1 -- 172.21.15.102:0/3790544851 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7efd1404e8a0 con 0x7efd180cd2b0 2024-08-17T02:29:01.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.605+0000 7efd1e20c700 1 -- 172.21.15.102:0/3790544851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000658238.meta", "var": "pg_num"} v 0) v1 -- 0x7efd180d1000 con 0x7efd180cd2b0 2024-08-17T02:29:01.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.605+0000 7efd097fa700 1 -- 172.21.15.102:0/3790544851 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000658238.meta", "var": "pg_num"}]=0 v36) v1 ==== 124+0+11 (secure 0 0 0) 0x7efd14051ec0 con 0x7efd180cd2b0 2024-08-17T02:29:01.613 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-08-17T02:29:01.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.609+0000 7efd1e20c700 1 -- 172.21.15.102:0/3790544851 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7efcfc060860 msgr2=0x7efcfc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.609+0000 7efd1e20c700 1 --2- 172.21.15.102:0/3790544851 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7efcfc060860 0x7efcfc062d10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efd180b5510 tx=0x7efd0c000bc0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.609+0000 7efd1e20c700 1 -- 172.21.15.102:0/3790544851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd180cd2b0 msgr2=0x7efd18155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.609+0000 7efd1e20c700 1 --2- 172.21.15.102:0/3790544851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd180cd2b0 0x7efd18155100 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efd14009860 tx=0x7efd14016000 comp rx=0 tx=0).stop 2024-08-17T02:29:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.609+0000 7efd1e20c700 1 -- 172.21.15.102:0/3790544851 shutdown_connections 2024-08-17T02:29:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.609+0000 7efd1e20c700 1 --2- 172.21.15.102:0/3790544851 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7efcfc060860 0x7efcfc062d10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.609+0000 7efd1e20c700 1 --2- 172.21.15.102:0/3790544851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd18159480 0x7efd180b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.609+0000 7efd1e20c700 1 --2- 172.21.15.102:0/3790544851 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7efd181590b0 0x7efd1815ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.609+0000 7efd1e20c700 1 --2- 172.21.15.102:0/3790544851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd180cd2b0 0x7efd18155100 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.609+0000 7efd1e20c700 1 -- 172.21.15.102:0/3790544851 >> 172.21.15.102:0/3790544851 conn(0x7efd180d0b90 msgr2=0x7efd180b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.609+0000 7efd1e20c700 1 -- 172.21.15.102:0/3790544851 shutdown_connections 2024-08-17T02:29:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.609+0000 7efd1e20c700 1 -- 172.21.15.102:0/3790544851 wait complete. 2024-08-17T02:29:01.627 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000658238.data pg_num 2024-08-17T02:29:01.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.733+0000 7f67b5a79700 1 Processor -- start 2024-08-17T02:29:01.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.733+0000 7f67b5a79700 1 -- start start 2024-08-17T02:29:01.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.733+0000 7f67b5a79700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f67b00aab10 0x7f67b0068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:01.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.733+0000 7f67b5a79700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b00ab0f0 con 0x7f67b00688d0 2024-08-17T02:29:01.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.733+0000 7f67b5a79700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b00ab3d0 con 0x7f67b0158b70 2024-08-17T02:29:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.733+0000 7f67b5a79700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b00ab6b0 con 0x7f67b00aab10 2024-08-17T02:29:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67a7fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f67b00aab10 0x7f67b0068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67b4a77700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f67b00688d0 0x7f67b0066ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:54892/0 (socket says 172.21.15.102:54892) 2024-08-17T02:29:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67b4a77700 1 -- 172.21.15.102:0/2780884215 learned_addr learned my addr 172.21.15.102:0/2780884215 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67a7fff700 1 -- 172.21.15.102:0/2780884215 >> v1:172.21.15.121:6789/0 conn(0x7f67b0158b70 legacy=0x7f67b0158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67a7fff700 1 -- 172.21.15.102:0/2780884215 >> v1:172.21.15.102:6789/0 conn(0x7f67b00688d0 legacy=0x7f67b0066ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67a7fff700 1 -- 172.21.15.102:0/2780884215 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b00ab990 con 0x7f67b00aab10 2024-08-17T02:29:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67a77fe700 1 -- 172.21.15.102:0/2780884215 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829225190 0 0) 0x7f67b00ab0f0 con 0x7f67b00688d0 2024-08-17T02:29:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67a7fff700 1 --2- 172.21.15.102:0/2780884215 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67b00aab10 0x7f67b0068ca0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f67a00098e0 tx=0x7f67a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3427d34b74dc9ec server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67a77fe700 1 -- 172.21.15.102:0/2780884215 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a0009e80 con 0x7f67b00aab10 2024-08-17T02:29:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67a77fe700 1 -- 172.21.15.102:0/2780884215 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a000b860 con 0x7f67b00aab10 2024-08-17T02:29:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67a77fe700 1 -- 172.21.15.102:0/2780884215 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a000bbe0 con 0x7f67b00aab10 2024-08-17T02:29:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67b5a79700 1 -- 172.21.15.102:0/2780884215 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67b00aab10 msgr2=0x7f67b0068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67b5a79700 1 --2- 172.21.15.102:0/2780884215 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67b00aab10 0x7f67b0068ca0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f67a00098e0 tx=0x7f67a00091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67b5a79700 1 -- 172.21.15.102:0/2780884215 shutdown_connections 2024-08-17T02:29:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67b5a79700 1 --2- 172.21.15.102:0/2780884215 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67b00aab10 0x7f67b0068ca0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67b5a79700 1 -- 172.21.15.102:0/2780884215 >> 172.21.15.102:0/2780884215 conn(0x7f67b006e310 msgr2=0x7f67b006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67b5a79700 1 -- 172.21.15.102:0/2780884215 shutdown_connections 2024-08-17T02:29:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.737+0000 7f67b5a79700 1 -- 172.21.15.102:0/2780884215 wait complete. 2024-08-17T02:29:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67b5a79700 1 Processor -- start 2024-08-17T02:29:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67b5a79700 1 -- start start 2024-08-17T02:29:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67b5a79700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b00688d0 0x7f67b014fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67b5a79700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67b00aab10 0x7f67b016d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67b5a79700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67b0158b70 0x7f67b013e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:01.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67b5a79700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b016d7b0 con 0x7f67b00aab10 2024-08-17T02:29:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67b5a79700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b0151640 con 0x7f67b00688d0 2024-08-17T02:29:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67b5a79700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b0150140 con 0x7f67b0158b70 2024-08-17T02:29:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67a7fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67b00aab10 0x7f67b016d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67a7fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67b00aab10 0x7f67b016d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33200/0 (socket says 172.21.15.102:33200) 2024-08-17T02:29:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67a7fff700 1 -- 172.21.15.102:0/2089329358 learned_addr learned my addr 172.21.15.102:0/2089329358 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67b4a77700 1 --2- 172.21.15.102:0/2089329358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b00688d0 0x7f67b014fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67b5278700 1 --2- 172.21.15.102:0/2089329358 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67b0158b70 0x7f67b013e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67a7fff700 1 -- 172.21.15.102:0/2089329358 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67b0158b70 msgr2=0x7f67b013e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67a7fff700 1 --2- 172.21.15.102:0/2089329358 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67b0158b70 0x7f67b013e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67a7fff700 1 -- 172.21.15.102:0/2089329358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b00688d0 msgr2=0x7f67b014fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67a7fff700 1 --2- 172.21.15.102:0/2089329358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b00688d0 0x7f67b014fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67a7fff700 1 -- 172.21.15.102:0/2089329358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a0009420 con 0x7f67b00aab10 2024-08-17T02:29:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67a7fff700 1 --2- 172.21.15.102:0/2089329358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67b00aab10 0x7f67b016d270 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f67a00097b0 tx=0x7f67a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67a4ff9700 1 -- 172.21.15.102:0/2089329358 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a000bbe0 con 0x7f67b00aab10 2024-08-17T02:29:01.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67a4ff9700 1 -- 172.21.15.102:0/2089329358 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a0000cc0 con 0x7f67b00aab10 2024-08-17T02:29:01.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67a4ff9700 1 -- 172.21.15.102:0/2089329358 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a0011650 con 0x7f67b00aab10 2024-08-17T02:29:01.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67b5a79700 1 -- 172.21.15.102:0/2089329358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b01521a0 con 0x7f67b00aab10 2024-08-17T02:29:01.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.741+0000 7f67b5a79700 1 -- 172.21.15.102:0/2089329358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b0151b50 con 0x7f67b00aab10 2024-08-17T02:29:01.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.745+0000 7f67b5a79700 1 -- 172.21.15.102:0/2089329358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b0152330 con 0x7f67b00aab10 2024-08-17T02:29:01.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.745+0000 7f67a4ff9700 1 -- 172.21.15.102:0/2089329358 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f67a00119c0 con 0x7f67b00aab10 2024-08-17T02:29:01.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.745+0000 7f67a4ff9700 1 --2- 172.21.15.102:0/2089329358 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f679c060860 0x7f679c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:01.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.745+0000 7f67a4ff9700 1 -- 172.21.15.102:0/2089329358 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f67a007e800 con 0x7f67b00aab10 2024-08-17T02:29:01.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.745+0000 7f67b4a77700 1 --2- 172.21.15.102:0/2089329358 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f679c060860 0x7f679c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:01.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.745+0000 7f67b4a77700 1 --2- 172.21.15.102:0/2089329358 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f679c060860 0x7f679c062d10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f67ac007fd0 tx=0x7f67ac007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:01.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.753+0000 7f67a4ff9700 1 -- 172.21.15.102:0/2089329358 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f67a004e950 con 0x7f67b00aab10 2024-08-17T02:29:01.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.917+0000 7f67b5a79700 1 -- 172.21.15.102:0/2089329358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000658238.data", "var": "pg_num"} v 0) v1 -- 0x7f67b00638f0 con 0x7f67b00aab10 2024-08-17T02:29:01.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.917+0000 7f67a4ff9700 1 -- 172.21.15.102:0/2089329358 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000658238.data", "var": "pg_num"}]=0 v36) v1 ==== 124+0+11 (secure 0 0 0) 0x7f67a0051f70 con 0x7f67b00aab10 2024-08-17T02:29:01.920 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-08-17T02:29:01.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.921+0000 7f67b5a79700 1 -- 172.21.15.102:0/2089329358 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f679c060860 msgr2=0x7f679c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.921+0000 7f67b5a79700 1 --2- 172.21.15.102:0/2089329358 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f679c060860 0x7f679c062d10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f67ac007fd0 tx=0x7f67ac007d10 comp rx=0 tx=0).stop 2024-08-17T02:29:01.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.921+0000 7f67b5a79700 1 -- 172.21.15.102:0/2089329358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67b00aab10 msgr2=0x7f67b016d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:01.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.921+0000 7f67b5a79700 1 --2- 172.21.15.102:0/2089329358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67b00aab10 0x7f67b016d270 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f67a00097b0 tx=0x7f67a0017000 comp rx=0 tx=0).stop 2024-08-17T02:29:01.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.921+0000 7f67b5a79700 1 -- 172.21.15.102:0/2089329358 shutdown_connections 2024-08-17T02:29:01.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.921+0000 7f67b5a79700 1 --2- 172.21.15.102:0/2089329358 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f679c060860 0x7f679c062d10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.921+0000 7f67b5a79700 1 --2- 172.21.15.102:0/2089329358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67b00aab10 0x7f67b016d270 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.921+0000 7f67b5a79700 1 --2- 172.21.15.102:0/2089329358 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f67b0158b70 0x7f67b013e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.921+0000 7f67b5a79700 1 --2- 172.21.15.102:0/2089329358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b00688d0 0x7f67b014fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:01.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.921+0000 7f67b5a79700 1 -- 172.21.15.102:0/2089329358 >> 172.21.15.102:0/2089329358 conn(0x7f67b006e310 msgr2=0x7f67b00ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:01.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.921+0000 7f67b5a79700 1 -- 172.21.15.102:0/2089329358 shutdown_connections 2024-08-17T02:29:01.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:01.921+0000 7f67b5a79700 1 -- 172.21.15.102:0/2089329358 wait complete. 2024-08-17T02:29:01.934 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:02.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.033+0000 7f3493aed700 1 Processor -- start 2024-08-17T02:29:02.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.033+0000 7f3493aed700 1 -- start start 2024-08-17T02:29:02.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3493aed700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f348c15d540 0x7f348c0af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3493aed700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f348c0a9430 0x7f348c0b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3493aed700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348c0b0270 con 0x7f348c06e830 2024-08-17T02:29:02.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3493aed700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348c0af660 con 0x7f348c0a9430 2024-08-17T02:29:02.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3493aed700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0af940 con 0x7f348c15d540 2024-08-17T02:29:02.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3491088700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f348c06e830 0x7f348c0a8d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:54898/0 (socket says 172.21.15.102:54898) 2024-08-17T02:29:02.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3491088700 1 -- 172.21.15.102:0/797452012 learned_addr learned my addr 172.21.15.102:0/797452012 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:02.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3491889700 1 --2- 172.21.15.102:0/797452012 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f348c15d540 0x7f348c0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f349208a700 1 --2- 172.21.15.102:0/797452012 >> v2:172.21.15.121:3300/0 conn(0x7f348c0a9430 0x7f348c0b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3490887700 1 -- 172.21.15.102:0/797452012 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604686301 0 0) 0x7f348c0b0270 con 0x7f348c06e830 2024-08-17T02:29:02.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3490887700 1 -- 172.21.15.102:0/797452012 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3478003570 con 0x7f348c06e830 2024-08-17T02:29:02.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3490887700 1 -- 172.21.15.102:0/797452012 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2077924902 0 0) 0x7f3478003570 con 0x7f348c06e830 2024-08-17T02:29:02.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f349208a700 1 -- 172.21.15.102:0/797452012 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f348c15d540 msgr2=0x7f348c0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:02.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f349208a700 1 --2- 172.21.15.102:0/797452012 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f348c15d540 0x7f348c0af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f349208a700 1 -- 172.21.15.102:0/797452012 >> v1:172.21.15.102:6789/0 conn(0x7f348c06e830 legacy=0x7f348c0a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f349208a700 1 -- 172.21.15.102:0/797452012 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c0afc20 con 0x7f348c0a9430 2024-08-17T02:29:02.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f349208a700 1 --2- 172.21.15.102:0/797452012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f348c0a9430 0x7f348c0b0700 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3484009e60 tx=0x7f3484009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=191abebd715676ae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3490887700 1 -- 172.21.15.102:0/797452012 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348400e070 con 0x7f348c0a9430 2024-08-17T02:29:02.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3490887700 1 -- 172.21.15.102:0/797452012 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348400b7a0 con 0x7f348c0a9430 2024-08-17T02:29:02.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3490887700 1 -- 172.21.15.102:0/797452012 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480001470 con 0x7f348c0a9430 2024-08-17T02:29:02.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3493aed700 1 -- 172.21.15.102:0/797452012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f348c0a9430 msgr2=0x7f348c0b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3493aed700 1 --2- 172.21.15.102:0/797452012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f348c0a9430 0x7f348c0b0700 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3484009e60 tx=0x7f3484009780 comp rx=0 tx=0).stop 2024-08-17T02:29:02.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3493aed700 1 -- 172.21.15.102:0/797452012 shutdown_connections 2024-08-17T02:29:02.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3493aed700 1 --2- 172.21.15.102:0/797452012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f348c0a9430 0x7f348c0b0700 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3493aed700 1 --2- 172.21.15.102:0/797452012 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f348c15d540 0x7f348c0af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3493aed700 1 -- 172.21.15.102:0/797452012 >> 172.21.15.102:0/797452012 conn(0x7f348c066e00 msgr2=0x7f348c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:02.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3493aed700 1 -- 172.21.15.102:0/797452012 shutdown_connections 2024-08-17T02:29:02.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.037+0000 7f3493aed700 1 -- 172.21.15.102:0/797452012 wait complete. 2024-08-17T02:29:02.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3493aed700 1 Processor -- start 2024-08-17T02:29:02.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3493aed700 1 -- start start 2024-08-17T02:29:02.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3493aed700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f348c06e830 0x7f348c0ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3493aed700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f348c0a9430 0x7f348c099850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3493aed700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f348c15d540 0x7f348c0c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3493aed700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0c8950 con 0x7f348c06e830 2024-08-17T02:29:02.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3493aed700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c099d90 con 0x7f348c0a9430 2024-08-17T02:29:02.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3493aed700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0c9440 con 0x7f348c15d540 2024-08-17T02:29:02.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3491889700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f348c06e830 0x7f348c0ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3491889700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f348c06e830 0x7f348c0ade30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33216/0 (socket says 172.21.15.102:33216) 2024-08-17T02:29:02.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3491889700 1 -- 172.21.15.102:0/419879309 learned_addr learned my addr 172.21.15.102:0/419879309 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:02.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f349208a700 1 --2- 172.21.15.102:0/419879309 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f348c15d540 0x7f348c0c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3491088700 1 --2- 172.21.15.102:0/419879309 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f348c0a9430 0x7f348c099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3491889700 1 -- 172.21.15.102:0/419879309 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f348c15d540 msgr2=0x7f348c0c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3491889700 1 --2- 172.21.15.102:0/419879309 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f348c15d540 0x7f348c0c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3491889700 1 -- 172.21.15.102:0/419879309 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f348c0a9430 msgr2=0x7f348c099850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3491889700 1 --2- 172.21.15.102:0/419879309 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f348c0a9430 0x7f348c099850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.041+0000 7f3491889700 1 -- 172.21.15.102:0/419879309 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3484009a20 con 0x7f348c06e830 2024-08-17T02:29:02.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.045+0000 7f3491889700 1 --2- 172.21.15.102:0/419879309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f348c06e830 0x7f348c0ade30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f348800e930 tx=0x7f34880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.045+0000 7f347dffb700 1 -- 172.21.15.102:0/419879309 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3488013680 con 0x7f348c06e830 2024-08-17T02:29:02.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.045+0000 7f347dffb700 1 -- 172.21.15.102:0/419879309 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34880137e0 con 0x7f348c06e830 2024-08-17T02:29:02.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.045+0000 7f3493aed700 1 -- 172.21.15.102:0/419879309 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348c0c8ba0 con 0x7f348c06e830 2024-08-17T02:29:02.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.045+0000 7f347dffb700 1 -- 172.21.15.102:0/419879309 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3488013b80 con 0x7f348c06e830 2024-08-17T02:29:02.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.045+0000 7f3493aed700 1 -- 172.21.15.102:0/419879309 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c0c9160 con 0x7f348c06e830 2024-08-17T02:29:02.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.045+0000 7f3493aed700 1 -- 172.21.15.102:0/419879309 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348c0645c0 con 0x7f348c06e830 2024-08-17T02:29:02.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.045+0000 7f347dffb700 1 -- 172.21.15.102:0/419879309 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f348800c3e0 con 0x7f348c06e830 2024-08-17T02:29:02.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.045+0000 7f347dffb700 1 --2- 172.21.15.102:0/419879309 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3470060860 0x7f3470062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.049+0000 7f3491088700 1 --2- 172.21.15.102:0/419879309 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3470060860 0x7f3470062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.049+0000 7f347dffb700 1 -- 172.21.15.102:0/419879309 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f348807cfe0 con 0x7f348c06e830 2024-08-17T02:29:02.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.049+0000 7f3491088700 1 --2- 172.21.15.102:0/419879309 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3470060860 0x7f3470062d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f348c15c4c0 tx=0x7f3480000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.053+0000 7f347dffb700 1 -- 172.21.15.102:0/419879309 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f348804d070 con 0x7f348c06e830 2024-08-17T02:29:02.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.253+0000 7f3493aed700 1 -- 172.21.15.102:0/419879309 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f348c06f360 con 0x7f348c06e830 2024-08-17T02:29:02.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.253+0000 7f347dffb700 1 -- 172.21.15.102:0/419879309 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5695 (secure 0 0 0) 0x7f3488050690 con 0x7f348c06e830 2024-08-17T02:29:02.255 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:02.255 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3728405798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3728405798},{"type":"v1","addr":"172.21.15.102:6835","nonce":3728405798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2759836087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2759836087},{"type":"v1","addr":"172.21.15.121:6833","nonce":2759836087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:42.224494+0000","modified":"2024-08-17T02:26:45.888060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/1340437033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1340437033},{"type":"v1","addr":"172.21.15.102:6837","nonce":1340437033}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:57.316251+0000","modified":"2024-08-17T02:26:58.534785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4676":{"gid":4676,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6835/2189006578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2189006578},{"type":"v1","addr":"172.21.15.121:6835","nonce":2189006578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000658238","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:02.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.253+0000 7f3493aed700 1 -- 172.21.15.102:0/419879309 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3470060860 msgr2=0x7f3470062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.253+0000 7f3493aed700 1 --2- 172.21.15.102:0/419879309 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3470060860 0x7f3470062d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f348c15c4c0 tx=0x7f3480000bc0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.253+0000 7f3493aed700 1 -- 172.21.15.102:0/419879309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f348c06e830 msgr2=0x7f348c0ade30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.253+0000 7f3493aed700 1 --2- 172.21.15.102:0/419879309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f348c06e830 0x7f348c0ade30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f348800e930 tx=0x7f34880091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.253+0000 7f3493aed700 1 -- 172.21.15.102:0/419879309 shutdown_connections 2024-08-17T02:29:02.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.253+0000 7f3493aed700 1 --2- 172.21.15.102:0/419879309 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3470060860 0x7f3470062d10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.253+0000 7f3493aed700 1 --2- 172.21.15.102:0/419879309 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f348c15d540 0x7f348c0c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.253+0000 7f3493aed700 1 --2- 172.21.15.102:0/419879309 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f348c0a9430 0x7f348c099850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.253+0000 7f3493aed700 1 --2- 172.21.15.102:0/419879309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f348c06e830 0x7f348c0ade30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.253+0000 7f3493aed700 1 -- 172.21.15.102:0/419879309 >> 172.21.15.102:0/419879309 conn(0x7f348c066e00 msgr2=0x7f348c15a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.257+0000 7f3493aed700 1 -- 172.21.15.102:0/419879309 shutdown_connections 2024-08-17T02:29:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.257+0000 7f3493aed700 1 -- 172.21.15.102:0/419879309 wait complete. 2024-08-17T02:29:02.259 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 17 2024-08-17T02:29:02.269 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:02.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.373+0000 7f58cb365700 1 Processor -- start 2024-08-17T02:29:02.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.373+0000 7f58cb365700 1 -- start start 2024-08-17T02:29:02.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.373+0000 7f58cb365700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f58c40b0350 0x7f58c40ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.373+0000 7f58cb365700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c40af2b0 con 0x7f58c406df10 2024-08-17T02:29:02.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.373+0000 7f58cb365700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c40af590 con 0x7f58c4155d20 2024-08-17T02:29:02.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.373+0000 7f58cb365700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c40b07a0 con 0x7f58c40b0350 2024-08-17T02:29:02.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.373+0000 7f58cab64700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f58c406df10 0x7f58c406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:54910/0 (socket says 172.21.15.102:54910) 2024-08-17T02:29:02.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.373+0000 7f58cab64700 1 -- 172.21.15.102:0/2904176117 learned_addr learned my addr 172.21.15.102:0/2904176117 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:02.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.373+0000 7f58c9b62700 1 --2- 172.21.15.102:0/2904176117 >> v2:172.21.15.121:3300/0 conn(0x7f58c40b0350 0x7f58c40ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58c9361700 1 -- 172.21.15.102:0/2904176117 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254570514 0 0) 0x7f58c40af2b0 con 0x7f58c406df10 2024-08-17T02:29:02.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58c9361700 1 -- 172.21.15.102:0/2904176117 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58b0003570 con 0x7f58c406df10 2024-08-17T02:29:02.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58c9b62700 1 -- 172.21.15.102:0/2904176117 >> v1:172.21.15.121:6789/0 conn(0x7f58c4155d20 legacy=0x7f58c40aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58c9b62700 1 -- 172.21.15.102:0/2904176117 >> v1:172.21.15.102:6789/0 conn(0x7f58c406df10 legacy=0x7f58c406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58c9361700 1 -- 172.21.15.102:0/2904176117 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 942972060 0 0) 0x7f58b0003570 con 0x7f58c406df10 2024-08-17T02:29:02.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58c9b62700 1 -- 172.21.15.102:0/2904176117 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c40af870 con 0x7f58c40b0350 2024-08-17T02:29:02.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58c9b62700 1 --2- 172.21.15.102:0/2904176117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c40b0350 0x7f58c40ad7c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009e60 tx=0x7f58c0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2c69f71b103df77 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58c9361700 1 -- 172.21.15.102:0/2904176117 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c000e070 con 0x7f58c40b0350 2024-08-17T02:29:02.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58c9361700 1 -- 172.21.15.102:0/2904176117 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c000b850 con 0x7f58c40b0350 2024-08-17T02:29:02.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58c9361700 1 -- 172.21.15.102:0/2904176117 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc001470 con 0x7f58c40b0350 2024-08-17T02:29:02.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58cb365700 1 -- 172.21.15.102:0/2904176117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c40b0350 msgr2=0x7f58c40ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58cb365700 1 --2- 172.21.15.102:0/2904176117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c40b0350 0x7f58c40ad7c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009e60 tx=0x7f58c0009780 comp rx=0 tx=0).stop 2024-08-17T02:29:02.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58cb365700 1 -- 172.21.15.102:0/2904176117 shutdown_connections 2024-08-17T02:29:02.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58cb365700 1 --2- 172.21.15.102:0/2904176117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c40b0350 0x7f58c40ad7c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58cb365700 1 -- 172.21.15.102:0/2904176117 >> 172.21.15.102:0/2904176117 conn(0x7f58c40678d0 msgr2=0x7f58c4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:02.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58cb365700 1 -- 172.21.15.102:0/2904176117 shutdown_connections 2024-08-17T02:29:02.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58cb365700 1 -- 172.21.15.102:0/2904176117 wait complete. 2024-08-17T02:29:02.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58cb365700 1 Processor -- start 2024-08-17T02:29:02.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.377+0000 7f58cb365700 1 -- start start 2024-08-17T02:29:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58cb365700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58c406df10 0x7f58c414baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58cb365700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58c40b0350 0x7f58c414f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58cb365700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c4155d20 0x7f58c40acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58cb365700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c4158140 con 0x7f58c406df10 2024-08-17T02:29:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58cb365700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c4157e60 con 0x7f58c4155d20 2024-08-17T02:29:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58cb365700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c414afc0 con 0x7f58c40b0350 2024-08-17T02:29:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58ca363700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58c406df10 0x7f58c414baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58ca363700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58c406df10 0x7f58c414baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33218/0 (socket says 172.21.15.102:33218) 2024-08-17T02:29:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58ca363700 1 -- 172.21.15.102:0/612563214 learned_addr learned my addr 172.21.15.102:0/612563214 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:02.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58c9b62700 1 --2- 172.21.15.102:0/612563214 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58c40b0350 0x7f58c414f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58cab64700 1 --2- 172.21.15.102:0/612563214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c4155d20 0x7f58c40acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58ca363700 1 -- 172.21.15.102:0/612563214 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58c40b0350 msgr2=0x7f58c414f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58ca363700 1 --2- 172.21.15.102:0/612563214 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58c40b0350 0x7f58c414f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58ca363700 1 -- 172.21.15.102:0/612563214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c4155d20 msgr2=0x7f58c40acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58ca363700 1 --2- 172.21.15.102:0/612563214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c4155d20 0x7f58c40acd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58ca363700 1 -- 172.21.15.102:0/612563214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c0009a20 con 0x7f58c406df10 2024-08-17T02:29:02.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58ca363700 1 --2- 172.21.15.102:0/612563214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58c406df10 0x7f58c414baa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f58b800c590 tx=0x7f58b800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58b67fc700 1 -- 172.21.15.102:0/612563214 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8011590 con 0x7f58c406df10 2024-08-17T02:29:02.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58b67fc700 1 -- 172.21.15.102:0/612563214 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b8011710 con 0x7f58c406df10 2024-08-17T02:29:02.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58cb365700 1 -- 172.21.15.102:0/612563214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c414b2a0 con 0x7f58c406df10 2024-08-17T02:29:02.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58b67fc700 1 -- 172.21.15.102:0/612563214 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8011ad0 con 0x7f58c406df10 2024-08-17T02:29:02.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58cb365700 1 -- 172.21.15.102:0/612563214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c414bfe0 con 0x7f58c406df10 2024-08-17T02:29:02.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.381+0000 7f58cb365700 1 -- 172.21.15.102:0/612563214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c40643a0 con 0x7f58c406df10 2024-08-17T02:29:02.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.385+0000 7f58b67fc700 1 -- 172.21.15.102:0/612563214 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f58b801b3b0 con 0x7f58c406df10 2024-08-17T02:29:02.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.385+0000 7f58b67fc700 1 --2- 172.21.15.102:0/612563214 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f58a8060860 0x7f58a8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.385+0000 7f58b67fc700 1 -- 172.21.15.102:0/612563214 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f58b807c450 con 0x7f58c406df10 2024-08-17T02:29:02.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.385+0000 7f58c9b62700 1 --2- 172.21.15.102:0/612563214 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f58a8060860 0x7f58a8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.385+0000 7f58c9b62700 1 --2- 172.21.15.102:0/612563214 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f58a8060860 0x7f58a8062d10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58c00097c0 tx=0x7f58c0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.393+0000 7f58b67fc700 1 -- 172.21.15.102:0/612563214 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f58b804c520 con 0x7f58c406df10 2024-08-17T02:29:02.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.557+0000 7f58cb365700 1 -- 172.21.15.102:0/612563214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58c406f5f0 con 0x7f58c406df10 2024-08-17T02:29:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.561+0000 7f58b67fc700 1 -- 172.21.15.102:0/612563214 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f58b804fb40 con 0x7f58c406df10 2024-08-17T02:29:02.564 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:02.564 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":36,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:26:59.293808+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:40.530641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:41.227445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000658238.meta","create_time":"2024-08-17T02:26:55.316074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000658238"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000658238.data","create_time":"2024-08-17T02:26:56.329435+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000658238"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.561+0000 7f58cb365700 1 -- 172.21.15.102:0/612563214 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f58a8060860 msgr2=0x7f58a8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.561+0000 7f58cb365700 1 --2- 172.21.15.102:0/612563214 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f58a8060860 0x7f58a8062d10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58c00097c0 tx=0x7f58c0017000 comp rx=0 tx=0).stop 2024-08-17T02:29:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.561+0000 7f58cb365700 1 -- 172.21.15.102:0/612563214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58c406df10 msgr2=0x7f58c414baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.561+0000 7f58cb365700 1 --2- 172.21.15.102:0/612563214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58c406df10 0x7f58c414baa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f58b800c590 tx=0x7f58b800c8a0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.565+0000 7f58cb365700 1 -- 172.21.15.102:0/612563214 shutdown_connections 2024-08-17T02:29:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.565+0000 7f58cb365700 1 --2- 172.21.15.102:0/612563214 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f58a8060860 0x7f58a8062d10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.565+0000 7f58cb365700 1 --2- 172.21.15.102:0/612563214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58c4155d20 0x7f58c40acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.565+0000 7f58cb365700 1 --2- 172.21.15.102:0/612563214 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f58c40b0350 0x7f58c414f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.565+0000 7f58cb365700 1 --2- 172.21.15.102:0/612563214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58c406df10 0x7f58c414baa0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.565+0000 7f58cb365700 1 -- 172.21.15.102:0/612563214 >> 172.21.15.102:0/612563214 conn(0x7f58c40678d0 msgr2=0x7f58c41488e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:02.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.565+0000 7f58cb365700 1 -- 172.21.15.102:0/612563214 shutdown_connections 2024-08-17T02:29:02.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.565+0000 7f58cb365700 1 -- 172.21.15.102:0/612563214 wait complete. 2024-08-17T02:29:02.578 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:29:02.579 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:02.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.677+0000 7f88cd655700 1 Processor -- start 2024-08-17T02:29:02.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.677+0000 7f88cd655700 1 -- start start 2024-08-17T02:29:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.677+0000 7f88cd655700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f88c8068ca0 0x7f88c80cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.677+0000 7f88cd655700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f88c806a470 0x7f88c806a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.677+0000 7f88cd655700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c80c7750 con 0x7f88c80688d0 2024-08-17T02:29:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88cd655700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c80cb220 con 0x7f88c806a470 2024-08-17T02:29:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88cd655700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80c6e20 con 0x7f88c8068ca0 2024-08-17T02:29:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88c67fc700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f88c8068ca0 0x7f88c80cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88c6ffd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f88c80688d0 0x7f88c80caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:52126/0 (socket says 172.21.15.102:52126) 2024-08-17T02:29:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88c6ffd700 1 -- 172.21.15.102:0/189077584 learned_addr learned my addr 172.21.15.102:0/189077584 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88c77fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f88c806a470 0x7f88c806a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88c5ffb700 1 -- 172.21.15.102:0/189077584 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286254921 0 0) 0x7f88c80c7750 con 0x7f88c80688d0 2024-08-17T02:29:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88c5ffb700 1 -- 172.21.15.102:0/189077584 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88ac003570 con 0x7f88c80688d0 2024-08-17T02:29:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88c77fe700 1 -- 172.21.15.102:0/189077584 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f88c8068ca0 msgr2=0x7f88c80cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88c77fe700 1 --2- 172.21.15.102:0/189077584 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f88c8068ca0 0x7f88c80cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88c77fe700 1 -- 172.21.15.102:0/189077584 >> v1:172.21.15.121:6789/0 conn(0x7f88c80688d0 legacy=0x7f88c80caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88c77fe700 1 -- 172.21.15.102:0/189077584 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c80c7100 con 0x7f88c806a470 2024-08-17T02:29:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88c77fe700 1 --2- 172.21.15.102:0/189077584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88c806a470 0x7f88c806a8b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f88c000ae00 tx=0x7f88c000a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92b9299929d1b345 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88c5ffb700 1 -- 172.21.15.102:0/189077584 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c000ce20 con 0x7f88c806a470 2024-08-17T02:29:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88c5ffb700 1 -- 172.21.15.102:0/189077584 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c0015440 con 0x7f88c806a470 2024-08-17T02:29:02.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88c5ffb700 1 -- 172.21.15.102:0/189077584 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0015800 con 0x7f88c806a470 2024-08-17T02:29:02.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88cd655700 1 -- 172.21.15.102:0/189077584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88c806a470 msgr2=0x7f88c806a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88cd655700 1 --2- 172.21.15.102:0/189077584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88c806a470 0x7f88c806a8b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f88c000ae00 tx=0x7f88c000a6a0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88cd655700 1 -- 172.21.15.102:0/189077584 shutdown_connections 2024-08-17T02:29:02.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88cd655700 1 --2- 172.21.15.102:0/189077584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88c806a470 0x7f88c806a8b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88cd655700 1 --2- 172.21.15.102:0/189077584 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f88c8068ca0 0x7f88c80cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88cd655700 1 -- 172.21.15.102:0/189077584 >> 172.21.15.102:0/189077584 conn(0x7f88c80c9c20 msgr2=0x7f88c806d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88cd655700 1 -- 172.21.15.102:0/189077584 shutdown_connections 2024-08-17T02:29:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.681+0000 7f88cd655700 1 -- 172.21.15.102:0/189077584 wait complete. 2024-08-17T02:29:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88cd655700 1 Processor -- start 2024-08-17T02:29:02.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88cd655700 1 -- start start 2024-08-17T02:29:02.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88cd655700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88c80688d0 0x7f88c80ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88cd655700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c8068ca0 0x7f88c8154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88cd655700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f88c806a470 0x7f88c81677c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88cd655700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c8158870 con 0x7f88c8068ca0 2024-08-17T02:29:02.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88cd655700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c8166e90 con 0x7f88c80688d0 2024-08-17T02:29:02.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88cd655700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c81554e0 con 0x7f88c806a470 2024-08-17T02:29:02.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88c67fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c8068ca0 0x7f88c8154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88c67fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c8068ca0 0x7f88c8154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33228/0 (socket says 172.21.15.102:33228) 2024-08-17T02:29:02.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88c67fc700 1 -- 172.21.15.102:0/40185646 learned_addr learned my addr 172.21.15.102:0/40185646 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:02.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88c77fe700 1 --2- 172.21.15.102:0/40185646 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f88c806a470 0x7f88c81677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88c6ffd700 1 --2- 172.21.15.102:0/40185646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88c80688d0 0x7f88c80ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88c67fc700 1 -- 172.21.15.102:0/40185646 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f88c806a470 msgr2=0x7f88c81677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88c67fc700 1 --2- 172.21.15.102:0/40185646 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f88c806a470 0x7f88c81677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88c67fc700 1 -- 172.21.15.102:0/40185646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88c80688d0 msgr2=0x7f88c80ad4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88c67fc700 1 --2- 172.21.15.102:0/40185646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88c80688d0 0x7f88c80ad4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88c67fc700 1 -- 172.21.15.102:0/40185646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c000a940 con 0x7f88c8068ca0 2024-08-17T02:29:02.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88c67fc700 1 --2- 172.21.15.102:0/40185646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c8068ca0 0x7f88c8154fa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f88b400ec80 tx=0x7f88b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88beffd700 1 -- 172.21.15.102:0/40185646 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b400c850 con 0x7f88c8068ca0 2024-08-17T02:29:02.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88cd655700 1 -- 172.21.15.102:0/40185646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c80ada90 con 0x7f88c8068ca0 2024-08-17T02:29:02.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88beffd700 1 -- 172.21.15.102:0/40185646 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b400c9b0 con 0x7f88c8068ca0 2024-08-17T02:29:02.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88beffd700 1 -- 172.21.15.102:0/40185646 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b400cd50 con 0x7f88c8068ca0 2024-08-17T02:29:02.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.685+0000 7f88cd655700 1 -- 172.21.15.102:0/40185646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c8158070 con 0x7f88c8068ca0 2024-08-17T02:29:02.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.689+0000 7f88cd655700 1 -- 172.21.15.102:0/40185646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c80645c0 con 0x7f88c8068ca0 2024-08-17T02:29:02.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.689+0000 7f88beffd700 1 -- 172.21.15.102:0/40185646 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f88b4013680 con 0x7f88c8068ca0 2024-08-17T02:29:02.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.689+0000 7f88beffd700 1 --2- 172.21.15.102:0/40185646 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f88b0060860 0x7f88b0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.689+0000 7f88c6ffd700 1 --2- 172.21.15.102:0/40185646 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f88b0060860 0x7f88b0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.689+0000 7f88beffd700 1 -- 172.21.15.102:0/40185646 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f88b407d1f0 con 0x7f88c8068ca0 2024-08-17T02:29:02.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.689+0000 7f88c6ffd700 1 --2- 172.21.15.102:0/40185646 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f88b0060860 0x7f88b0062d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f88b8007fd0 tx=0x7f88b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.697+0000 7f88beffd700 1 -- 172.21.15.102:0/40185646 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f88b404d2c0 con 0x7f88c8068ca0 2024-08-17T02:29:02.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.893+0000 7f88cd655700 1 -- 172.21.15.102:0/40185646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88c806ea90 con 0x7f88c8068ca0 2024-08-17T02:29:02.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.897+0000 7f88beffd700 1 -- 172.21.15.102:0/40185646 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5695 (secure 0 0 0) 0x7f88b40508e0 con 0x7f88c8068ca0 2024-08-17T02:29:02.899 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:02.899 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3728405798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3728405798},{"type":"v1","addr":"172.21.15.102:6835","nonce":3728405798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2759836087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2759836087},{"type":"v1","addr":"172.21.15.121:6833","nonce":2759836087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:42.224494+0000","modified":"2024-08-17T02:26:45.888060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/1340437033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1340437033},{"type":"v1","addr":"172.21.15.102:6837","nonce":1340437033}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:57.316251+0000","modified":"2024-08-17T02:26:58.534785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4676":{"gid":4676,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6835/2189006578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2189006578},{"type":"v1","addr":"172.21.15.121:6835","nonce":2189006578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000658238","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:02.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.897+0000 7f88cd655700 1 -- 172.21.15.102:0/40185646 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f88b0060860 msgr2=0x7f88b0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.897+0000 7f88cd655700 1 --2- 172.21.15.102:0/40185646 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f88b0060860 0x7f88b0062d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f88b8007fd0 tx=0x7f88b8009040 comp rx=0 tx=0).stop 2024-08-17T02:29:02.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.897+0000 7f88cd655700 1 -- 172.21.15.102:0/40185646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c8068ca0 msgr2=0x7f88c8154fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.897+0000 7f88cd655700 1 --2- 172.21.15.102:0/40185646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c8068ca0 0x7f88c8154fa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f88b400ec80 tx=0x7f88b40091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.897+0000 7f88cd655700 1 -- 172.21.15.102:0/40185646 shutdown_connections 2024-08-17T02:29:02.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.897+0000 7f88cd655700 1 --2- 172.21.15.102:0/40185646 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f88b0060860 0x7f88b0062d10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.897+0000 7f88cd655700 1 --2- 172.21.15.102:0/40185646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c8068ca0 0x7f88c8154fa0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.897+0000 7f88cd655700 1 --2- 172.21.15.102:0/40185646 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f88c806a470 0x7f88c81677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.897+0000 7f88cd655700 1 --2- 172.21.15.102:0/40185646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88c80688d0 0x7f88c80ad4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.897+0000 7f88cd655700 1 -- 172.21.15.102:0/40185646 >> 172.21.15.102:0/40185646 conn(0x7f88c80c9c20 msgr2=0x7f88c806ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:02.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.897+0000 7f88cd655700 1 -- 172.21.15.102:0/40185646 shutdown_connections 2024-08-17T02:29:02.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:02.897+0000 7f88cd655700 1 -- 172.21.15.102:0/40185646 wait complete. 2024-08-17T02:29:02.903 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 17 2024-08-17T02:29:02.912 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:03.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7b5e18700 1 Processor -- start 2024-08-17T02:29:03.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7b5e18700 1 -- start start 2024-08-17T02:29:03.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7b5e18700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe7b0159470 0x7fe7b00b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7b5e18700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b00b0cd0 con 0x7fe7b00b07d0 2024-08-17T02:29:03.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7b5e18700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b00b0fb0 con 0x7fe7b01590a0 2024-08-17T02:29:03.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7b5e18700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b00b1290 con 0x7fe7b0159470 2024-08-17T02:29:03.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7affff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe7b0159470 0x7fe7b00b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7affff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe7b0159470 0x7fe7b00b1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33244/0 (socket says 172.21.15.102:33244) 2024-08-17T02:29:03.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7affff700 1 -- 172.21.15.102:0/965270230 learned_addr learned my addr 172.21.15.102:0/965270230 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:03.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7b5617700 1 --1- 172.21.15.102:0/965270230 >> v1:172.21.15.102:6789/0 conn(0x7fe7b00b07d0 0x7fe7b0162df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:54920/0 (socket says 172.21.15.102:54920) 2024-08-17T02:29:03.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7affff700 1 -- 172.21.15.102:0/965270230 >> v1:172.21.15.121:6789/0 conn(0x7fe7b01590a0 legacy=0x7fe7b00adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:03.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7affff700 1 -- 172.21.15.102:0/965270230 >> v1:172.21.15.102:6789/0 conn(0x7fe7b00b07d0 legacy=0x7fe7b0162df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7affff700 1 -- 172.21.15.102:0/965270230 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b00b1570 con 0x7fe7b0159470 2024-08-17T02:29:03.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7affff700 1 --2- 172.21.15.102:0/965270230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b0159470 0x7fe7b00b1cc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80099b0 tx=0x7fe7a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77bf9e23ab8907f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:03.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7af7fe700 1 -- 172.21.15.102:0/965270230 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a800b820 con 0x7fe7b0159470 2024-08-17T02:29:03.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7af7fe700 1 -- 172.21.15.102:0/965270230 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a800b980 con 0x7fe7b0159470 2024-08-17T02:29:03.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7af7fe700 1 -- 172.21.15.102:0/965270230 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a800bd20 con 0x7fe7b0159470 2024-08-17T02:29:03.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7b5e18700 1 -- 172.21.15.102:0/965270230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b0159470 msgr2=0x7fe7b00b1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7b5e18700 1 --2- 172.21.15.102:0/965270230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b0159470 0x7fe7b00b1cc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80099b0 tx=0x7fe7a8009250 comp rx=0 tx=0).stop 2024-08-17T02:29:03.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7b5e18700 1 -- 172.21.15.102:0/965270230 shutdown_connections 2024-08-17T02:29:03.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7b5e18700 1 --2- 172.21.15.102:0/965270230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b0159470 0x7fe7b00b1cc0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7b5e18700 1 -- 172.21.15.102:0/965270230 >> 172.21.15.102:0/965270230 conn(0x7fe7b00c9840 msgr2=0x7fe7b00c9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:03.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7b5e18700 1 -- 172.21.15.102:0/965270230 shutdown_connections 2024-08-17T02:29:03.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.021+0000 7fe7b5e18700 1 -- 172.21.15.102:0/965270230 wait complete. 2024-08-17T02:29:03.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.025+0000 7fe7b5e18700 1 Processor -- start 2024-08-17T02:29:03.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.025+0000 7fe7b5e18700 1 -- start start 2024-08-17T02:29:03.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.025+0000 7fe7b5e18700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7b00b07d0 0x7fe7b00c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.025+0000 7fe7b5e18700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b01590a0 0x7fe7b016cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.025+0000 7fe7b5e18700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7b0159470 0x7fe7b016d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.025+0000 7fe7b5e18700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00aba60 con 0x7fe7b01590a0 2024-08-17T02:29:03.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.025+0000 7fe7b5e18700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00c3f30 con 0x7fe7b00b07d0 2024-08-17T02:29:03.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.025+0000 7fe7b5e18700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00c3560 con 0x7fe7b0159470 2024-08-17T02:29:03.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.025+0000 7fe7affff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b01590a0 0x7fe7b016cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.025+0000 7fe7affff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b01590a0 0x7fe7b016cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33252/0 (socket says 172.21.15.102:33252) 2024-08-17T02:29:03.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.025+0000 7fe7affff700 1 -- 172.21.15.102:0/3935833483 learned_addr learned my addr 172.21.15.102:0/3935833483 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:03.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.025+0000 7fe7b4e16700 1 --2- 172.21.15.102:0/3935833483 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7b00b07d0 0x7fe7b00c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.025+0000 7fe7b5617700 1 --2- 172.21.15.102:0/3935833483 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7b0159470 0x7fe7b016d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.025+0000 7fe7affff700 1 -- 172.21.15.102:0/3935833483 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7b0159470 msgr2=0x7fe7b016d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.029+0000 7fe7affff700 1 --2- 172.21.15.102:0/3935833483 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7b0159470 0x7fe7b016d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.029+0000 7fe7affff700 1 -- 172.21.15.102:0/3935833483 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7b00b07d0 msgr2=0x7fe7b00c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.029+0000 7fe7affff700 1 --2- 172.21.15.102:0/3935833483 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7b00b07d0 0x7fe7b00c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.029+0000 7fe7affff700 1 -- 172.21.15.102:0/3935833483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a80094f0 con 0x7fe7b01590a0 2024-08-17T02:29:03.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.029+0000 7fe7b4e16700 1 --2- 172.21.15.102:0/3935833483 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7b00b07d0 0x7fe7b00c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:03.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.029+0000 7fe7affff700 1 --2- 172.21.15.102:0/3935833483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b01590a0 0x7fe7b016cb60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe7b006d390 tx=0x7fe7a8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:03.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.029+0000 7fe7acff9700 1 -- 172.21.15.102:0/3935833483 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8011dd0 con 0x7fe7b01590a0 2024-08-17T02:29:03.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.029+0000 7fe7acff9700 1 -- 172.21.15.102:0/3935833483 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a8020070 con 0x7fe7b01590a0 2024-08-17T02:29:03.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.029+0000 7fe7b5e18700 1 -- 172.21.15.102:0/3935833483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b00c2950 con 0x7fe7b01590a0 2024-08-17T02:29:03.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.029+0000 7fe7acff9700 1 -- 172.21.15.102:0/3935833483 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a801b6a0 con 0x7fe7b01590a0 2024-08-17T02:29:03.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.029+0000 7fe7b5e18700 1 -- 172.21.15.102:0/3935833483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b00c2f10 con 0x7fe7b01590a0 2024-08-17T02:29:03.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.029+0000 7fe7b5e18700 1 -- 172.21.15.102:0/3935833483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b00638f0 con 0x7fe7b01590a0 2024-08-17T02:29:03.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.029+0000 7fe7acff9700 1 -- 172.21.15.102:0/3935833483 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe7a8022030 con 0x7fe7b01590a0 2024-08-17T02:29:03.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.033+0000 7fe7acff9700 1 --2- 172.21.15.102:0/3935833483 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe794060860 0x7fe794062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.033+0000 7fe7b4e16700 1 --2- 172.21.15.102:0/3935833483 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe794060860 0x7fe794062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.033+0000 7fe7acff9700 1 -- 172.21.15.102:0/3935833483 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fe7a807ee70 con 0x7fe7b01590a0 2024-08-17T02:29:03.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.033+0000 7fe7b4e16700 1 --2- 172.21.15.102:0/3935833483 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe794060860 0x7fe794062d10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe798007fd0 tx=0x7fe798009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:03.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.037+0000 7fe7acff9700 1 -- 172.21.15.102:0/3935833483 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe7a804ef40 con 0x7fe7b01590a0 2024-08-17T02:29:03.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.241+0000 7fe7b5e18700 1 -- 172.21.15.102:0/3935833483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7b00638f0 con 0x7fe7b01590a0 2024-08-17T02:29:03.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.241+0000 7fe7acff9700 1 -- 172.21.15.102:0/3935833483 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5695 (secure 0 0 0) 0x7fe7a8052560 con 0x7fe7b01590a0 2024-08-17T02:29:03.244 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:03.244 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3728405798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3728405798},{"type":"v1","addr":"172.21.15.102:6835","nonce":3728405798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2759836087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2759836087},{"type":"v1","addr":"172.21.15.121:6833","nonce":2759836087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:42.224494+0000","modified":"2024-08-17T02:26:45.888060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/1340437033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1340437033},{"type":"v1","addr":"172.21.15.102:6837","nonce":1340437033}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:57.316251+0000","modified":"2024-08-17T02:26:58.534785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4676":{"gid":4676,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6835/2189006578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2189006578},{"type":"v1","addr":"172.21.15.121:6835","nonce":2189006578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000658238","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:03.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.245+0000 7fe7b5e18700 1 -- 172.21.15.102:0/3935833483 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe794060860 msgr2=0x7fe794062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.245+0000 7fe7b5e18700 1 --2- 172.21.15.102:0/3935833483 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe794060860 0x7fe794062d10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe798007fd0 tx=0x7fe798009040 comp rx=0 tx=0).stop 2024-08-17T02:29:03.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.245+0000 7fe7b5e18700 1 -- 172.21.15.102:0/3935833483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b01590a0 msgr2=0x7fe7b016cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.245+0000 7fe7b5e18700 1 --2- 172.21.15.102:0/3935833483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b01590a0 0x7fe7b016cb60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe7b006d390 tx=0x7fe7a8016000 comp rx=0 tx=0).stop 2024-08-17T02:29:03.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.245+0000 7fe7b5e18700 1 -- 172.21.15.102:0/3935833483 shutdown_connections 2024-08-17T02:29:03.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.245+0000 7fe7b5e18700 1 --2- 172.21.15.102:0/3935833483 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe794060860 0x7fe794062d10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.245+0000 7fe7b5e18700 1 --2- 172.21.15.102:0/3935833483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7b01590a0 0x7fe7b016cb60 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.245+0000 7fe7b5e18700 1 --2- 172.21.15.102:0/3935833483 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe7b0159470 0x7fe7b016d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.245+0000 7fe7b5e18700 1 --2- 172.21.15.102:0/3935833483 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7b00b07d0 0x7fe7b00c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.245+0000 7fe7b5e18700 1 -- 172.21.15.102:0/3935833483 >> 172.21.15.102:0/3935833483 conn(0x7fe7b00c9840 msgr2=0x7fe7b0158620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:03.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.245+0000 7fe7b5e18700 1 -- 172.21.15.102:0/3935833483 shutdown_connections 2024-08-17T02:29:03.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.245+0000 7fe7b5e18700 1 -- 172.21.15.102:0/3935833483 wait complete. 2024-08-17T02:29:03.248 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 17 2024-08-17T02:29:03.258 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:03.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899881a700 1 Processor -- start 2024-08-17T02:29:03.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899881a700 1 -- start start 2024-08-17T02:29:03.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899881a700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f89940a9730 0x7f899406d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899881a700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8994159300 0x7f8994159730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899881a700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89940a9f60 con 0x7f8994159c70 2024-08-17T02:29:03.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899881a700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899406e4b0 con 0x7f89940a9730 2024-08-17T02:29:03.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899881a700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899415a0f0 con 0x7f8994159300 2024-08-17T02:29:03.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899259c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f89940a9730 0x7f899406d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f8991d9b700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8994159300 0x7f8994159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899259c700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f89940a9730 0x7f899406d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:60676/0 (socket says 172.21.15.102:60676) 2024-08-17T02:29:03.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899259c700 1 -- 172.21.15.102:0/2856388846 learned_addr learned my addr 172.21.15.102:0/2856388846 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:03.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899259c700 1 -- 172.21.15.102:0/2856388846 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8994159300 msgr2=0x7f8994159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:03.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899259c700 1 --2- 172.21.15.102:0/2856388846 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8994159300 0x7f8994159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899259c700 1 -- 172.21.15.102:0/2856388846 >> v1:172.21.15.121:6789/0 conn(0x7f8994159c70 legacy=0x7f8994155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899259c700 1 -- 172.21.15.102:0/2856388846 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899406e6a0 con 0x7f89940a9730 2024-08-17T02:29:03.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899259c700 1 --2- 172.21.15.102:0/2856388846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89940a9730 0x7f899406d240 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f898c009f20 tx=0x7f898c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bcb961a16ab0c74 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899159a700 1 -- 172.21.15.102:0/2856388846 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c00e070 con 0x7f89940a9730 2024-08-17T02:29:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899159a700 1 -- 172.21.15.102:0/2856388846 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c00b9d0 con 0x7f89940a9730 2024-08-17T02:29:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.361+0000 7f899159a700 1 -- 172.21.15.102:0/2856388846 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c0092e0 con 0x7f89940a9730 2024-08-17T02:29:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899881a700 1 -- 172.21.15.102:0/2856388846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89940a9730 msgr2=0x7f899406d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899881a700 1 --2- 172.21.15.102:0/2856388846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89940a9730 0x7f899406d240 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f898c009f20 tx=0x7f898c009840 comp rx=0 tx=0).stop 2024-08-17T02:29:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899881a700 1 -- 172.21.15.102:0/2856388846 shutdown_connections 2024-08-17T02:29:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899881a700 1 --2- 172.21.15.102:0/2856388846 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8994159300 0x7f8994159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899881a700 1 --2- 172.21.15.102:0/2856388846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89940a9730 0x7f899406d240 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899881a700 1 -- 172.21.15.102:0/2856388846 >> 172.21.15.102:0/2856388846 conn(0x7f8994066e00 msgr2=0x7f8994067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899881a700 1 -- 172.21.15.102:0/2856388846 shutdown_connections 2024-08-17T02:29:03.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899881a700 1 -- 172.21.15.102:0/2856388846 wait complete. 2024-08-17T02:29:03.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899881a700 1 Processor -- start 2024-08-17T02:29:03.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899881a700 1 -- start start 2024-08-17T02:29:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899881a700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89940a9730 0x7f89940969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899881a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8994159300 0x7f899414fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899881a700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8994159c70 0x7f899414d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899881a700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8994155c90 con 0x7f89940a9730 2024-08-17T02:29:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899881a700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8994097dc0 con 0x7f8994159300 2024-08-17T02:29:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899881a700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8994097240 con 0x7f8994159c70 2024-08-17T02:29:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899259c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89940a9730 0x7f89940969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899259c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89940a9730 0x7f89940969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33264/0 (socket says 172.21.15.102:33264) 2024-08-17T02:29:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f899259c700 1 -- 172.21.15.102:0/3833083299 learned_addr learned my addr 172.21.15.102:0/3833083299 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f8991d9b700 1 --2- 172.21.15.102:0/3833083299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8994159300 0x7f899414fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.365+0000 7f8992d9d700 1 --2- 172.21.15.102:0/3833083299 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8994159c70 0x7f899414d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f899259c700 1 -- 172.21.15.102:0/3833083299 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8994159c70 msgr2=0x7f899414d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f899259c700 1 --2- 172.21.15.102:0/3833083299 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8994159c70 0x7f899414d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f899259c700 1 -- 172.21.15.102:0/3833083299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8994159300 msgr2=0x7f899414fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f899259c700 1 --2- 172.21.15.102:0/3833083299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8994159300 0x7f899414fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f899259c700 1 -- 172.21.15.102:0/3833083299 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c009ae0 con 0x7f89940a9730 2024-08-17T02:29:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f899259c700 1 --2- 172.21.15.102:0/3833083299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89940a9730 0x7f89940969f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f898c00b610 tx=0x7f898c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f89827fc700 1 -- 172.21.15.102:0/3833083299 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c0088f0 con 0x7f89940a9730 2024-08-17T02:29:03.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f89827fc700 1 -- 172.21.15.102:0/3833083299 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c008a50 con 0x7f89940a9730 2024-08-17T02:29:03.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f899881a700 1 -- 172.21.15.102:0/3833083299 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8994097580 con 0x7f89940a9730 2024-08-17T02:29:03.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f89827fc700 1 -- 172.21.15.102:0/3833083299 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c008e10 con 0x7f89940a9730 2024-08-17T02:29:03.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f899881a700 1 -- 172.21.15.102:0/3833083299 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8994096f30 con 0x7f89940a9730 2024-08-17T02:29:03.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f89827fc700 1 -- 172.21.15.102:0/3833083299 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f898c003040 con 0x7f89940a9730 2024-08-17T02:29:03.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f899881a700 1 -- 172.21.15.102:0/3833083299 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8994155e00 con 0x7f89940a9730 2024-08-17T02:29:03.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f89827fc700 1 --2- 172.21.15.102:0/3833083299 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8974060860 0x7f8974062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f89827fc700 1 -- 172.21.15.102:0/3833083299 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f898c07e8c0 con 0x7f89940a9730 2024-08-17T02:29:03.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f8991d9b700 1 --2- 172.21.15.102:0/3833083299 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8974060860 0x7f8974062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.369+0000 7f8991d9b700 1 --2- 172.21.15.102:0/3833083299 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8974060860 0x7f8974062d10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f89940ab090 tx=0x7f89880091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:03.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.377+0000 7f89827fc700 1 -- 172.21.15.102:0/3833083299 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f898c04ea40 con 0x7f89940a9730 2024-08-17T02:29:03.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.541+0000 7f899881a700 1 -- 172.21.15.102:0/3833083299 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89940645c0 con 0x7f89940a9730 2024-08-17T02:29:03.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.541+0000 7f89827fc700 1 -- 172.21.15.102:0/3833083299 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f898c052060 con 0x7f89940a9730 2024-08-17T02:29:03.544 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:03.545 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":36,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:26:59.293808+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:40.530641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:41.227445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000658238.meta","create_time":"2024-08-17T02:26:55.316074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000658238"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000658238.data","create_time":"2024-08-17T02:26:56.329435+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000658238"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:03.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.545+0000 7f899881a700 1 -- 172.21.15.102:0/3833083299 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8974060860 msgr2=0x7f8974062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.545+0000 7f899881a700 1 --2- 172.21.15.102:0/3833083299 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8974060860 0x7f8974062d10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f89940ab090 tx=0x7f89880091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.545+0000 7f899881a700 1 -- 172.21.15.102:0/3833083299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89940a9730 msgr2=0x7f89940969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.545+0000 7f899881a700 1 --2- 172.21.15.102:0/3833083299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89940a9730 0x7f89940969f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f898c00b610 tx=0x7f898c018000 comp rx=0 tx=0).stop 2024-08-17T02:29:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.545+0000 7f899881a700 1 -- 172.21.15.102:0/3833083299 shutdown_connections 2024-08-17T02:29:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.545+0000 7f899881a700 1 --2- 172.21.15.102:0/3833083299 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8974060860 0x7f8974062d10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.545+0000 7f899881a700 1 --2- 172.21.15.102:0/3833083299 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8994159c70 0x7f899414d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.545+0000 7f899881a700 1 --2- 172.21.15.102:0/3833083299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8994159300 0x7f899414fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.545+0000 7f899881a700 1 --2- 172.21.15.102:0/3833083299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89940a9730 0x7f89940969f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.545+0000 7f899881a700 1 -- 172.21.15.102:0/3833083299 >> 172.21.15.102:0/3833083299 conn(0x7f8994066e00 msgr2=0x7f89940ab8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.545+0000 7f899881a700 1 -- 172.21.15.102:0/3833083299 shutdown_connections 2024-08-17T02:29:03.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.545+0000 7f899881a700 1 -- 172.21.15.102:0/3833083299 wait complete. 2024-08-17T02:29:03.559 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:29:03.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.669+0000 7f33c5ca2700 1 Processor -- start 2024-08-17T02:29:03.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33c5ca2700 1 -- start start 2024-08-17T02:29:03.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33c5ca2700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f33c0159340 0x7f33c0159710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33c5ca2700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33c0159c50 0x7f33c00b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33c5ca2700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c00b1cf0 con 0x7f33c00b4160 2024-08-17T02:29:03.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33c5ca2700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c00b45e0 con 0x7f33c0159340 2024-08-17T02:29:03.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33c5ca2700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c00b60d0 con 0x7f33c0159c50 2024-08-17T02:29:03.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33bf7fe700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f33c0159340 0x7f33c0159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33b7fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33c0159c50 0x7f33c00b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33bffff700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f33c00b4160 0x7f33c00b04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:52148/0 (socket says 172.21.15.102:52148) 2024-08-17T02:29:03.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33bffff700 1 -- 172.21.15.102:0/2538691333 learned_addr learned my addr 172.21.15.102:0/2538691333 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:03.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33bf7fe700 1 -- 172.21.15.102:0/2538691333 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33c0159c50 msgr2=0x7f33c00b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:03.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33bf7fe700 1 --2- 172.21.15.102:0/2538691333 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33c0159c50 0x7f33c00b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33bf7fe700 1 -- 172.21.15.102:0/2538691333 >> v1:172.21.15.121:6789/0 conn(0x7f33c00b4160 legacy=0x7f33c00b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33bf7fe700 1 -- 172.21.15.102:0/2538691333 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c00b10e0 con 0x7f33c0159340 2024-08-17T02:29:03.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33bf7fe700 1 --2- 172.21.15.102:0/2538691333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c0159340 0x7f33c0159710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f33b00098e0 tx=0x7f33b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=869d599a6e584bc9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:03.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33beffd700 1 -- 172.21.15.102:0/2538691333 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b000b640 con 0x7f33c0159340 2024-08-17T02:29:03.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33beffd700 1 -- 172.21.15.102:0/2538691333 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b000b7a0 con 0x7f33c0159340 2024-08-17T02:29:03.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33beffd700 1 -- 172.21.15.102:0/2538691333 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b000bb40 con 0x7f33c0159340 2024-08-17T02:29:03.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33c5ca2700 1 -- 172.21.15.102:0/2538691333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c0159340 msgr2=0x7f33c0159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.673+0000 7f33c5ca2700 1 --2- 172.21.15.102:0/2538691333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c0159340 0x7f33c0159710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f33b00098e0 tx=0x7f33b00091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33c5ca2700 1 -- 172.21.15.102:0/2538691333 shutdown_connections 2024-08-17T02:29:03.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33c5ca2700 1 --2- 172.21.15.102:0/2538691333 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33c0159c50 0x7f33c00b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33c5ca2700 1 --2- 172.21.15.102:0/2538691333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c0159340 0x7f33c0159710 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f33b00098e0 tx=0x7f33b00091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33c5ca2700 1 -- 172.21.15.102:0/2538691333 >> 172.21.15.102:0/2538691333 conn(0x7f33c00994f0 msgr2=0x7f33c00675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:03.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33c5ca2700 1 -- 172.21.15.102:0/2538691333 shutdown_connections 2024-08-17T02:29:03.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33c5ca2700 1 -- 172.21.15.102:0/2538691333 wait complete. 2024-08-17T02:29:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33c5ca2700 1 Processor -- start 2024-08-17T02:29:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33c5ca2700 1 -- start start 2024-08-17T02:29:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33c5ca2700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33c00b4160 0x7f33c01570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33c5ca2700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33c0159c50 0x7f33c0068e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33c5ca2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c00693b0 0x7f33c00c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33c5ca2700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c00d0fd0 con 0x7f33c0159c50 2024-08-17T02:29:03.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33c5ca2700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c01697d0 con 0x7f33c00693b0 2024-08-17T02:29:03.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33c5ca2700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c0069800 con 0x7f33c00b4160 2024-08-17T02:29:03.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33b7fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33c0159c50 0x7f33c0068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33b7fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33c0159c50 0x7f33c0068e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33268/0 (socket says 172.21.15.102:33268) 2024-08-17T02:29:03.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33b7fff700 1 -- 172.21.15.102:0/148498860 learned_addr learned my addr 172.21.15.102:0/148498860 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:03.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33bffff700 1 --2- 172.21.15.102:0/148498860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c00693b0 0x7f33c00c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33bf7fe700 1 --2- 172.21.15.102:0/148498860 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33c00b4160 0x7f33c01570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33b7fff700 1 -- 172.21.15.102:0/148498860 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33c00b4160 msgr2=0x7f33c01570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33b7fff700 1 --2- 172.21.15.102:0/148498860 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33c00b4160 0x7f33c01570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33b7fff700 1 -- 172.21.15.102:0/148498860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c00693b0 msgr2=0x7f33c00c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33b7fff700 1 --2- 172.21.15.102:0/148498860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c00693b0 0x7f33c00c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33b7fff700 1 -- 172.21.15.102:0/148498860 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b0009420 con 0x7f33c0159c50 2024-08-17T02:29:03.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33b7fff700 1 --2- 172.21.15.102:0/148498860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33c0159c50 0x7f33c0068e70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f33a800e930 tx=0x7f33a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:03.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33b77fe700 1 -- 172.21.15.102:0/148498860 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a8013680 con 0x7f33c0159c50 2024-08-17T02:29:03.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33b77fe700 1 -- 172.21.15.102:0/148498860 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a80137e0 con 0x7f33c0159c50 2024-08-17T02:29:03.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33c5ca2700 1 -- 172.21.15.102:0/148498860 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c00ad610 con 0x7f33c0159c50 2024-08-17T02:29:03.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33b77fe700 1 -- 172.21.15.102:0/148498860 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a8013b80 con 0x7f33c0159c50 2024-08-17T02:29:03.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.677+0000 7f33c5ca2700 1 -- 172.21.15.102:0/148498860 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c00adbd0 con 0x7f33c0159c50 2024-08-17T02:29:03.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.681+0000 7f33c5ca2700 1 -- 172.21.15.102:0/148498860 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c0169970 con 0x7f33c0159c50 2024-08-17T02:29:03.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.681+0000 7f33b77fe700 1 -- 172.21.15.102:0/148498860 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f33a80123d0 con 0x7f33c0159c50 2024-08-17T02:29:03.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.681+0000 7f33b77fe700 1 --2- 172.21.15.102:0/148498860 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f33a0060860 0x7f33a0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:03.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.681+0000 7f33b77fe700 1 -- 172.21.15.102:0/148498860 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f33a807d0a0 con 0x7f33c0159c50 2024-08-17T02:29:03.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.681+0000 7f33bf7fe700 1 --2- 172.21.15.102:0/148498860 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f33a0060860 0x7f33a0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:03.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.685+0000 7f33bf7fe700 1 --2- 172.21.15.102:0/148498860 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f33a0060860 0x7f33a0062d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f33c0070e50 tx=0x7f33b0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:03.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.693+0000 7f33b77fe700 1 -- 172.21.15.102:0/148498860 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f33c0169970 con 0x7f33c0159c50 2024-08-17T02:29:03.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.877+0000 7f33c5ca2700 1 -- 172.21.15.102:0/148498860 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f33c0169910 con 0x7f33c0159c50 2024-08-17T02:29:03.880 INFO:tasks.ceph.mon.a.smithi102.stderr:2024-08-17T02:29:03.877+0000 7fd2c6a69700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:29:03.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.881+0000 7f33b77fe700 1 -- 172.21.15.102:0/148498860 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f33a8050b60 con 0x7f33c0159c50 2024-08-17T02:29:03.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.885+0000 7f33c5ca2700 1 -- 172.21.15.102:0/148498860 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f33a0060860 msgr2=0x7f33a0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.889+0000 7f33c5ca2700 1 --2- 172.21.15.102:0/148498860 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f33a0060860 0x7f33a0062d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f33c0070e50 tx=0x7f33b0017000 comp rx=0 tx=0).stop 2024-08-17T02:29:03.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.889+0000 7f33c5ca2700 1 -- 172.21.15.102:0/148498860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33c0159c50 msgr2=0x7f33c0068e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.889+0000 7f33c5ca2700 1 --2- 172.21.15.102:0/148498860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33c0159c50 0x7f33c0068e70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f33a800e930 tx=0x7f33a80091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.889+0000 7f33c5ca2700 1 -- 172.21.15.102:0/148498860 shutdown_connections 2024-08-17T02:29:03.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.889+0000 7f33c5ca2700 1 --2- 172.21.15.102:0/148498860 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f33a0060860 0x7f33a0062d10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.889+0000 7f33c5ca2700 1 --2- 172.21.15.102:0/148498860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33c0159c50 0x7f33c0068e70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.889+0000 7f33c5ca2700 1 --2- 172.21.15.102:0/148498860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33c00693b0 0x7f33c00c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.889+0000 7f33c5ca2700 1 --2- 172.21.15.102:0/148498860 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f33c00b4160 0x7f33c01570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.889+0000 7f33c5ca2700 1 -- 172.21.15.102:0/148498860 >> 172.21.15.102:0/148498860 conn(0x7f33c00994f0 msgr2=0x7f33c00b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:03.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.889+0000 7f33c5ca2700 1 -- 172.21.15.102:0/148498860 shutdown_connections 2024-08-17T02:29:03.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:03.889+0000 7f33c5ca2700 1 -- 172.21.15.102:0/148498860 wait complete. 2024-08-17T02:29:03.892 INFO:teuthology.orchestra.run.smithi102.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:29:03.898 INFO:tasks.ceph.mds.a.smithi102.stderr: -7260> 2024-08-17T02:26:47.568+0000 7eff645a0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:29:03.903 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:29:03.927 INFO:tasks.ceph.mds.a.smithi102.stdout:starting mds.a at 2024-08-17T02:29:04.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd507fff700 1 Processor -- start 2024-08-17T02:29:04.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd507fff700 1 -- start start 2024-08-17T02:29:04.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd507fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd5080afc50 0x7fd5080ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:04.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd507fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd508068c10 0x7fd50815cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:04.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd507fff700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5080ae020 con 0x7fd508068840 2024-08-17T02:29:04.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd507fff700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd508069090 con 0x7fd5080afc50 2024-08-17T02:29:04.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd507fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080b0200 con 0x7fd508068c10 2024-08-17T02:29:04.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd506ffd700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd508068840 0x7fd5080af540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:54936/0 (socket says 172.21.15.102:54936) 2024-08-17T02:29:04.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd506ffd700 1 -- 172.21.15.102:0/1375579937 learned_addr learned my addr 172.21.15.102:0/1375579937 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:04.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd5077fe700 1 --2- 172.21.15.102:0/1375579937 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd508068c10 0x7fd50815cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:04.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd5067fc700 1 --2- 172.21.15.102:0/1375579937 >> v2:172.21.15.121:3300/0 conn(0x7fd5080afc50 0x7fd5080ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:04.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd505ffb700 1 -- 172.21.15.102:0/1375579937 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101573055 0 0) 0x7fd5080ae020 con 0x7fd508068840 2024-08-17T02:29:04.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd505ffb700 1 -- 172.21.15.102:0/1375579937 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4f0003570 con 0x7fd508068840 2024-08-17T02:29:04.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd5077fe700 1 -- 172.21.15.102:0/1375579937 >> v2:172.21.15.121:3300/0 conn(0x7fd5080afc50 msgr2=0x7fd5080ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:04.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd5077fe700 1 --2- 172.21.15.102:0/1375579937 >> v2:172.21.15.121:3300/0 conn(0x7fd5080afc50 0x7fd5080ae4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:04.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd5077fe700 1 -- 172.21.15.102:0/1375579937 >> v1:172.21.15.102:6789/0 conn(0x7fd508068840 legacy=0x7fd5080af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:04.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd5077fe700 1 -- 172.21.15.102:0/1375579937 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5080ad6f0 con 0x7fd508068c10 2024-08-17T02:29:04.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd5077fe700 1 --2- 172.21.15.102:0/1375579937 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd508068c10 0x7fd50815cf60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd500009e60 tx=0x7fd500009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b681ad851d4fa42 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:04.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd505ffb700 1 -- 172.21.15.102:0/1375579937 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50000e070 con 0x7fd508068c10 2024-08-17T02:29:04.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd505ffb700 1 -- 172.21.15.102:0/1375579937 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50000bab0 con 0x7fd508068c10 2024-08-17T02:29:04.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.005+0000 7fd505ffb700 1 -- 172.21.15.102:0/1375579937 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50000be30 con 0x7fd508068c10 2024-08-17T02:29:04.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.009+0000 7fd507fff700 1 -- 172.21.15.102:0/1375579937 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd508068c10 msgr2=0x7fd50815cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:04.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.009+0000 7fd507fff700 1 --2- 172.21.15.102:0/1375579937 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd508068c10 0x7fd50815cf60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd500009e60 tx=0x7fd500009780 comp rx=0 tx=0).stop 2024-08-17T02:29:04.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.009+0000 7fd507fff700 1 -- 172.21.15.102:0/1375579937 shutdown_connections 2024-08-17T02:29:04.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.009+0000 7fd507fff700 1 --2- 172.21.15.102:0/1375579937 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd508068c10 0x7fd50815cf60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:04.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.009+0000 7fd507fff700 1 --2- 172.21.15.102:0/1375579937 >> v2:172.21.15.121:3300/0 conn(0x7fd5080afc50 0x7fd5080ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:04.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.009+0000 7fd507fff700 1 -- 172.21.15.102:0/1375579937 >> 172.21.15.102:0/1375579937 conn(0x7fd50806e350 msgr2=0x7fd50806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:04.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.009+0000 7fd507fff700 1 -- 172.21.15.102:0/1375579937 shutdown_connections 2024-08-17T02:29:04.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.009+0000 7fd507fff700 1 -- 172.21.15.102:0/1375579937 wait complete. 2024-08-17T02:29:04.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.009+0000 7fd507fff700 1 Processor -- start 2024-08-17T02:29:04.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.009+0000 7fd507fff700 1 -- start start 2024-08-17T02:29:04.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd507fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd508068840 0x7fd5080a7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:04.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd507fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508068c10 0x7fd50815e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:04.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd507fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5080afc50 0x7fd50806a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:04.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd507fff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50815d9a0 con 0x7fd508068c10 2024-08-17T02:29:04.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd507fff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080a7550 con 0x7fd5080afc50 2024-08-17T02:29:04.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd507fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50815cdd0 con 0x7fd508068840 2024-08-17T02:29:04.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd5067fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508068c10 0x7fd50815e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:04.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd5067fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508068c10 0x7fd50815e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33292/0 (socket says 172.21.15.102:33292) 2024-08-17T02:29:04.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd5067fc700 1 -- 172.21.15.102:0/3653858843 learned_addr learned my addr 172.21.15.102:0/3653858843 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:04.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd506ffd700 1 --2- 172.21.15.102:0/3653858843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd508068840 0x7fd5080a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:04.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd5077fe700 1 --2- 172.21.15.102:0/3653858843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5080afc50 0x7fd50806a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:04.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd5067fc700 1 -- 172.21.15.102:0/3653858843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd508068840 msgr2=0x7fd5080a7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:04.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd5067fc700 1 --2- 172.21.15.102:0/3653858843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd508068840 0x7fd5080a7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:04.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd5067fc700 1 -- 172.21.15.102:0/3653858843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5080afc50 msgr2=0x7fd50806a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:04.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd5067fc700 1 --2- 172.21.15.102:0/3653858843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5080afc50 0x7fd50806a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:04.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd5067fc700 1 -- 172.21.15.102:0/3653858843 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd500009a20 con 0x7fd508068c10 2024-08-17T02:29:04.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd5067fc700 1 --2- 172.21.15.102:0/3653858843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508068c10 0x7fd50815e860 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd4f800e930 tx=0x7fd4f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:04.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd4eeffd700 1 -- 172.21.15.102:0/3653858843 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8013680 con 0x7fd508068c10 2024-08-17T02:29:04.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd4eeffd700 1 -- 172.21.15.102:0/3653858843 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f80137e0 con 0x7fd508068c10 2024-08-17T02:29:04.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd507fff700 1 -- 172.21.15.102:0/3653858843 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50815d070 con 0x7fd508068c10 2024-08-17T02:29:04.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd4eeffd700 1 -- 172.21.15.102:0/3653858843 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8013b80 con 0x7fd508068c10 2024-08-17T02:29:04.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd507fff700 1 -- 172.21.15.102:0/3653858843 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50815d630 con 0x7fd508068c10 2024-08-17T02:29:04.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.013+0000 7fd507fff700 1 -- 172.21.15.102:0/3653858843 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50815db50 con 0x7fd508068c10 2024-08-17T02:29:04.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.017+0000 7fd4eeffd700 1 -- 172.21.15.102:0/3653858843 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd4f800c3e0 con 0x7fd508068c10 2024-08-17T02:29:04.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.017+0000 7fd4eeffd700 1 --2- 172.21.15.102:0/3653858843 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd4f4060860 0x7fd4f4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:04.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.017+0000 7fd506ffd700 1 --2- 172.21.15.102:0/3653858843 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd4f4060860 0x7fd4f4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:04.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.017+0000 7fd4eeffd700 1 -- 172.21.15.102:0/3653858843 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6689+0+0 (secure 0 0 0) 0x7fd4f807d070 con 0x7fd508068c10 2024-08-17T02:29:04.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.017+0000 7fd506ffd700 1 --2- 172.21.15.102:0/3653858843 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd4f4060860 0x7fd4f4062d10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc007fd0 tx=0x7fd4fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:04.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.021+0000 7fd4eeffd700 1 -- 172.21.15.102:0/3653858843 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd4f80ad480 con 0x7fd508068c10 2024-08-17T02:29:04.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.221+0000 7fd507fff700 1 -- 172.21.15.102:0/3653858843 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd5080638f0 con 0x7fd508068c10 2024-08-17T02:29:04.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.885+0000 7fd4eeffd700 1 -- 172.21.15.102:0/3653858843 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd50815db50 con 0x7fd508068c10 2024-08-17T02:29:04.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.893+0000 7fd507fff700 1 -- 172.21.15.102:0/3653858843 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd4f4060860 msgr2=0x7fd4f4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:04.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.893+0000 7fd507fff700 1 --2- 172.21.15.102:0/3653858843 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd4f4060860 0x7fd4f4062d10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc007fd0 tx=0x7fd4fc009040 comp rx=0 tx=0).stop 2024-08-17T02:29:04.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.893+0000 7fd507fff700 1 -- 172.21.15.102:0/3653858843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508068c10 msgr2=0x7fd50815e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:04.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.893+0000 7fd507fff700 1 --2- 172.21.15.102:0/3653858843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508068c10 0x7fd50815e860 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd4f800e930 tx=0x7fd4f80091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:04.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.893+0000 7fd507fff700 1 -- 172.21.15.102:0/3653858843 shutdown_connections 2024-08-17T02:29:04.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.893+0000 7fd507fff700 1 --2- 172.21.15.102:0/3653858843 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd4f4060860 0x7fd4f4062d10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:04.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.893+0000 7fd507fff700 1 --2- 172.21.15.102:0/3653858843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508068c10 0x7fd50815e860 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:04.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.893+0000 7fd507fff700 1 --2- 172.21.15.102:0/3653858843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5080afc50 0x7fd50806a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:04.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.893+0000 7fd507fff700 1 --2- 172.21.15.102:0/3653858843 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd508068840 0x7fd5080a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:04.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.893+0000 7fd507fff700 1 -- 172.21.15.102:0/3653858843 >> 172.21.15.102:0/3653858843 conn(0x7fd50806e350 msgr2=0x7fd50815b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:04.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.893+0000 7fd507fff700 1 -- 172.21.15.102:0/3653858843 shutdown_connections 2024-08-17T02:29:04.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:04.893+0000 7fd507fff700 1 -- 172.21.15.102:0/3653858843 wait complete. 2024-08-17T02:29:04.909 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:29:05.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.021+0000 7f07feb8f700 1 Processor -- start 2024-08-17T02:29:05.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.021+0000 7f07feb8f700 1 -- start start 2024-08-17T02:29:05.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07feb8f700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07f80c9db0 0x7f07f8156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07feb8f700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f80ca370 con 0x7f07f8155fa0 2024-08-17T02:29:05.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07feb8f700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f80a9980 con 0x7f07f80a94b0 2024-08-17T02:29:05.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07feb8f700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80a9c60 con 0x7f07f80c9db0 2024-08-17T02:29:05.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07fc92b700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f07f8155fa0 0x7f07f80a8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:54952/0 (socket says 172.21.15.102:54952) 2024-08-17T02:29:05.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07fc92b700 1 -- 172.21.15.102:0/1754316762 learned_addr learned my addr 172.21.15.102:0/1754316762 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:05.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07fd12c700 1 --2- 172.21.15.102:0/1754316762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07f80c9db0 0x7f07f8156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07f77fe700 1 -- 172.21.15.102:0/1754316762 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46916166 0 0) 0x7f07f80ca370 con 0x7f07f8155fa0 2024-08-17T02:29:05.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07f77fe700 1 -- 172.21.15.102:0/1754316762 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e0003570 con 0x7f07f8155fa0 2024-08-17T02:29:05.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07f77fe700 1 -- 172.21.15.102:0/1754316762 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855634713 0 0) 0x7f07f80a9980 con 0x7f07f80a94b0 2024-08-17T02:29:05.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07f77fe700 1 -- 172.21.15.102:0/1754316762 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07f80ca370 con 0x7f07f80a94b0 2024-08-17T02:29:05.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07fd12c700 1 -- 172.21.15.102:0/1754316762 >> v1:172.21.15.121:6789/0 conn(0x7f07f80a94b0 legacy=0x7f07f80abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07fd12c700 1 -- 172.21.15.102:0/1754316762 >> v1:172.21.15.102:6789/0 conn(0x7f07f8155fa0 legacy=0x7f07f80a8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07f77fe700 1 -- 172.21.15.102:0/1754316762 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 746987862 0 0) 0x7f07e0003570 con 0x7f07f8155fa0 2024-08-17T02:29:05.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07fd12c700 1 -- 172.21.15.102:0/1754316762 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f80a9f40 con 0x7f07f80c9db0 2024-08-17T02:29:05.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07fd12c700 1 --2- 172.21.15.102:0/1754316762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07f80c9db0 0x7f07f8156370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009910 tx=0x7f07f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cc3369fb5631000 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:05.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07f77fe700 1 -- 172.21.15.102:0/1754316762 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec001470 con 0x7f07f80c9db0 2024-08-17T02:29:05.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07f77fe700 1 -- 172.21.15.102:0/1754316762 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f0011420 con 0x7f07f80c9db0 2024-08-17T02:29:05.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07f77fe700 1 -- 172.21.15.102:0/1754316762 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f00117a0 con 0x7f07f80c9db0 2024-08-17T02:29:05.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07feb8f700 1 -- 172.21.15.102:0/1754316762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07f80c9db0 msgr2=0x7f07f8156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07feb8f700 1 --2- 172.21.15.102:0/1754316762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07f80c9db0 0x7f07f8156370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009910 tx=0x7f07f00091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07feb8f700 1 -- 172.21.15.102:0/1754316762 shutdown_connections 2024-08-17T02:29:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07feb8f700 1 --2- 172.21.15.102:0/1754316762 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07f80c9db0 0x7f07f8156370 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07feb8f700 1 -- 172.21.15.102:0/1754316762 >> 172.21.15.102:0/1754316762 conn(0x7f07f80c93a0 msgr2=0x7f07f8066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07feb8f700 1 -- 172.21.15.102:0/1754316762 shutdown_connections 2024-08-17T02:29:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.025+0000 7f07feb8f700 1 -- 172.21.15.102:0/1754316762 wait complete. 2024-08-17T02:29:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07feb8f700 1 Processor -- start 2024-08-17T02:29:05.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07feb8f700 1 -- start start 2024-08-17T02:29:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07feb8f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07f80a94b0 0x7f07f8150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07feb8f700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07f80c9db0 0x7f07f81582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07feb8f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07f8155fa0 0x7f07f8158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07feb8f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80aefa0 con 0x7f07f8155fa0 2024-08-17T02:29:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07feb8f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80970e0 con 0x7f07f80a94b0 2024-08-17T02:29:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07feb8f700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f8069f80 con 0x7f07f80c9db0 2024-08-17T02:29:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07fd12c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07f8155fa0 0x7f07f8158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07fd12c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07f8155fa0 0x7f07f8158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33304/0 (socket says 172.21.15.102:33304) 2024-08-17T02:29:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07fd12c700 1 -- 172.21.15.102:0/3494179668 learned_addr learned my addr 172.21.15.102:0/3494179668 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07f7fff700 1 --2- 172.21.15.102:0/3494179668 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07f80c9db0 0x7f07f81582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07fc92b700 1 --2- 172.21.15.102:0/3494179668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07f80a94b0 0x7f07f8150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07fd12c700 1 -- 172.21.15.102:0/3494179668 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07f80c9db0 msgr2=0x7f07f81582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07fd12c700 1 --2- 172.21.15.102:0/3494179668 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07f80c9db0 0x7f07f81582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07fd12c700 1 -- 172.21.15.102:0/3494179668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07f80a94b0 msgr2=0x7f07f8150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07fd12c700 1 --2- 172.21.15.102:0/3494179668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07f80a94b0 0x7f07f8150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07fd12c700 1 -- 172.21.15.102:0/3494179668 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f0009420 con 0x7f07f8155fa0 2024-08-17T02:29:05.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07fc92b700 1 --2- 172.21.15.102:0/3494179668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07f80a94b0 0x7f07f8150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:05.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.029+0000 7f07fd12c700 1 --2- 172.21.15.102:0/3494179668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07f8155fa0 0x7f07f8158810 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009f00 tx=0x7f07f0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:05.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.033+0000 7f07f4ff9700 1 -- 172.21.15.102:0/3494179668 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f001cce0 con 0x7f07f8155fa0 2024-08-17T02:29:05.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.033+0000 7f07f4ff9700 1 -- 172.21.15.102:0/3494179668 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f001ce40 con 0x7f07f8155fa0 2024-08-17T02:29:05.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.033+0000 7f07feb8f700 1 -- 172.21.15.102:0/3494179668 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f8158e70 con 0x7f07f8155fa0 2024-08-17T02:29:05.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.033+0000 7f07f4ff9700 1 -- 172.21.15.102:0/3494179668 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f001a680 con 0x7f07f8155fa0 2024-08-17T02:29:05.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.033+0000 7f07feb8f700 1 -- 172.21.15.102:0/3494179668 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f8096a90 con 0x7f07f8155fa0 2024-08-17T02:29:05.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.033+0000 7f07feb8f700 1 -- 172.21.15.102:0/3494179668 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f8097270 con 0x7f07f8155fa0 2024-08-17T02:29:05.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.033+0000 7f07f4ff9700 1 -- 172.21.15.102:0/3494179668 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f07f001aa30 con 0x7f07f8155fa0 2024-08-17T02:29:05.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.033+0000 7f07f4ff9700 1 --2- 172.21.15.102:0/3494179668 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f07e4060860 0x7f07e4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.033+0000 7f07f4ff9700 1 -- 172.21.15.102:0/3494179668 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f07f007eb60 con 0x7f07f8155fa0 2024-08-17T02:29:05.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.033+0000 7f07fc92b700 1 --2- 172.21.15.102:0/3494179668 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f07e4060860 0x7f07e4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.037+0000 7f07fc92b700 1 --2- 172.21.15.102:0/3494179668 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f07e4060860 0x7f07e4062d10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0015a0 tx=0x7f07ec000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:05.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.041+0000 7f07f4ff9700 1 -- 172.21.15.102:0/3494179668 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f07f004ebd0 con 0x7f07f8155fa0 2024-08-17T02:29:05.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.205+0000 7f07feb8f700 1 -- 172.21.15.102:0/3494179668 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f07f80638f0 con 0x7f07f8155fa0 2024-08-17T02:29:05.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.893+0000 7f07f4ff9700 1 -- 172.21.15.102:0/3494179668 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7f07f00521f0 con 0x7f07f8155fa0 2024-08-17T02:29:05.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.901+0000 7f07feb8f700 1 -- 172.21.15.102:0/3494179668 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f07e4060860 msgr2=0x7f07e4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.901+0000 7f07feb8f700 1 --2- 172.21.15.102:0/3494179668 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f07e4060860 0x7f07e4062d10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0015a0 tx=0x7f07ec000bc0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.901+0000 7f07feb8f700 1 -- 172.21.15.102:0/3494179668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07f8155fa0 msgr2=0x7f07f8158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.901+0000 7f07feb8f700 1 --2- 172.21.15.102:0/3494179668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07f8155fa0 0x7f07f8158810 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009f00 tx=0x7f07f0016000 comp rx=0 tx=0).stop 2024-08-17T02:29:05.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.901+0000 7f07feb8f700 1 -- 172.21.15.102:0/3494179668 shutdown_connections 2024-08-17T02:29:05.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.901+0000 7f07feb8f700 1 --2- 172.21.15.102:0/3494179668 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f07e4060860 0x7f07e4062d10 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0015a0 tx=0x7f07ec000bc0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.901+0000 7f07feb8f700 1 --2- 172.21.15.102:0/3494179668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07f8155fa0 0x7f07f8158810 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.901+0000 7f07feb8f700 1 --2- 172.21.15.102:0/3494179668 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f07f80c9db0 0x7f07f81582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.901+0000 7f07feb8f700 1 --2- 172.21.15.102:0/3494179668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07f80a94b0 0x7f07f8150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.901+0000 7f07feb8f700 1 -- 172.21.15.102:0/3494179668 >> 172.21.15.102:0/3494179668 conn(0x7f07f80c93a0 msgr2=0x7f07f80ade30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:05.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.901+0000 7f07feb8f700 1 -- 172.21.15.102:0/3494179668 shutdown_connections 2024-08-17T02:29:05.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:05.901+0000 7f07feb8f700 1 -- 172.21.15.102:0/3494179668 wait complete. 2024-08-17T02:29:05.904 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:29:05.918 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:29:06.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.025+0000 7fcae3495700 1 Processor -- start 2024-08-17T02:29:06.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.025+0000 7fcae3495700 1 -- start start 2024-08-17T02:29:06.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae3495700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcadc0cf2e0 0x7fcadc0cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae3495700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcadc0ca850 0x7fcadc0cac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae3495700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcadc0d09c0 con 0x7fcadc159500 2024-08-17T02:29:06.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae3495700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcadc15aab0 con 0x7fcadc0ca850 2024-08-17T02:29:06.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae3495700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0d0c10 con 0x7fcadc0cf2e0 2024-08-17T02:29:06.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae1231700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fcadc159500 0x7fcadc0cebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:54958/0 (socket says 172.21.15.102:54958) 2024-08-17T02:29:06.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae1231700 1 -- 172.21.15.102:0/1328171422 learned_addr learned my addr 172.21.15.102:0/1328171422 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:06.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae0a30700 1 --2- 172.21.15.102:0/1328171422 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcadc0cf2e0 0x7fcadc0cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae1a32700 1 --2- 172.21.15.102:0/1328171422 >> v2:172.21.15.121:3300/0 conn(0x7fcadc0ca850 0x7fcadc0cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 -- 172.21.15.102:0/1328171422 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233789363 0 0) 0x7fcadc0d09c0 con 0x7fcadc159500 2024-08-17T02:29:06.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 -- 172.21.15.102:0/1328171422 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac8003570 con 0x7fcadc159500 2024-08-17T02:29:06.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 -- 172.21.15.102:0/1328171422 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 476675223 0 0) 0x7fcac8003570 con 0x7fcadc159500 2024-08-17T02:29:06.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 -- 172.21.15.102:0/1328171422 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcadc0cf2e0 msgr2=0x7fcadc0cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:06.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 --2- 172.21.15.102:0/1328171422 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcadc0cf2e0 0x7fcadc0cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 -- 172.21.15.102:0/1328171422 >> v2:172.21.15.121:3300/0 conn(0x7fcadc0ca850 msgr2=0x7fcadc0cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:06.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 --2- 172.21.15.102:0/1328171422 >> v2:172.21.15.121:3300/0 conn(0x7fcadc0ca850 0x7fcadc0cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 -- 172.21.15.102:0/1328171422 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc0d0ef0 con 0x7fcadc159500 2024-08-17T02:29:06.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 -- 172.21.15.102:0/1328171422 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7fcad8001470 con 0x7fcadc159500 2024-08-17T02:29:06.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 -- 172.21.15.102:0/1328171422 >> v1:172.21.15.102:6789/0 conn(0x7fcadc159500 legacy=0x7fcadc0cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 --2- 172.21.15.102:0/1328171422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcac8003a60 0x7fcac8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 --2- 172.21.15.102:0/1328171422 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcadc0cf2e0 0x7fcac8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 --2- 172.21.15.102:0/1328171422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcac8004d50 0x7fcac80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 -- 172.21.15.102:0/1328171422 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc15aab0 con 0x7fcac8003a60 2024-08-17T02:29:06.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 -- 172.21.15.102:0/1328171422 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0d0c10 con 0x7fcac8004d50 2024-08-17T02:29:06.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 -- 172.21.15.102:0/1328171422 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac800bb10 con 0x7fcadc0cf2e0 2024-08-17T02:29:06.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae1231700 1 --2- 172.21.15.102:0/1328171422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcac8003a60 0x7fcac8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae0a30700 1 --2- 172.21.15.102:0/1328171422 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcadc0cf2e0 0x7fcac8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae1a32700 1 --2- 172.21.15.102:0/1328171422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcac8004d50 0x7fcac80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae1231700 1 -- 172.21.15.102:0/1328171422 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcadc0cf2e0 msgr2=0x7fcac8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:06.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae1231700 1 --2- 172.21.15.102:0/1328171422 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcadc0cf2e0 0x7fcac8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae1231700 1 -- 172.21.15.102:0/1328171422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcac8004d50 msgr2=0x7fcac80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:06.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae1231700 1 --2- 172.21.15.102:0/1328171422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcac8004d50 0x7fcac80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae1231700 1 -- 172.21.15.102:0/1328171422 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac8003570 con 0x7fcac8003a60 2024-08-17T02:29:06.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae1231700 1 --2- 172.21.15.102:0/1328171422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcac8003a60 0x7fcac8003e70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcad800c3c0 tx=0x7fcad8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93262a1c90972438 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:06.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 -- 172.21.15.102:0/1328171422 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad800cc90 con 0x7fcac8003a60 2024-08-17T02:29:06.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 -- 172.21.15.102:0/1328171422 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad800ce10 con 0x7fcac8003a60 2024-08-17T02:29:06.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcad3fff700 1 -- 172.21.15.102:0/1328171422 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8005b70 con 0x7fcac8003a60 2024-08-17T02:29:06.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae3495700 1 -- 172.21.15.102:0/1328171422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcac8003a60 msgr2=0x7fcac8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae3495700 1 --2- 172.21.15.102:0/1328171422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcac8003a60 0x7fcac8003e70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcad800c3c0 tx=0x7fcad8001e90 comp rx=0 tx=0).stop 2024-08-17T02:29:06.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae1a32700 1 -- 172.21.15.102:0/1328171422 reap_dead start 2024-08-17T02:29:06.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae3495700 1 -- 172.21.15.102:0/1328171422 shutdown_connections 2024-08-17T02:29:06.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae3495700 1 -- 172.21.15.102:0/1328171422 >> 172.21.15.102:0/1328171422 conn(0x7fcadc067590 msgr2=0x7fcadc0d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:06.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae3495700 1 -- 172.21.15.102:0/1328171422 shutdown_connections 2024-08-17T02:29:06.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.029+0000 7fcae3495700 1 -- 172.21.15.102:0/1328171422 wait complete. 2024-08-17T02:29:06.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae3495700 1 Processor -- start 2024-08-17T02:29:06.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae3495700 1 -- start start 2024-08-17T02:29:06.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae3495700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcac8003a60 0x7fcadc0c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae3495700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcadc0c72c0 0x7fcadc1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae3495700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcadc0c6210 0x7fcadc0c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae3495700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0c8640 con 0x7fcadc0c72c0 2024-08-17T02:29:06.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae3495700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0c7a30 con 0x7fcadc0c6210 2024-08-17T02:29:06.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae3495700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0c7d10 con 0x7fcac8003a60 2024-08-17T02:29:06.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae0a30700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcadc0c72c0 0x7fcadc1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae0a30700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcadc0c72c0 0x7fcadc1579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33332/0 (socket says 172.21.15.102:33332) 2024-08-17T02:29:06.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae0a30700 1 -- 172.21.15.102:0/4163727915 learned_addr learned my addr 172.21.15.102:0/4163727915 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:06.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae1231700 1 --2- 172.21.15.102:0/4163727915 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcac8003a60 0x7fcadc0c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae1a32700 1 --2- 172.21.15.102:0/4163727915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcadc0c6210 0x7fcadc0c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae0a30700 1 -- 172.21.15.102:0/4163727915 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcac8003a60 msgr2=0x7fcadc0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae0a30700 1 --2- 172.21.15.102:0/4163727915 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcac8003a60 0x7fcadc0c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae0a30700 1 -- 172.21.15.102:0/4163727915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcadc0c6210 msgr2=0x7fcadc0c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae0a30700 1 --2- 172.21.15.102:0/4163727915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcadc0c6210 0x7fcadc0c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae0a30700 1 -- 172.21.15.102:0/4163727915 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc0c7ff0 con 0x7fcadc0c72c0 2024-08-17T02:29:06.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae1a32700 1 --2- 172.21.15.102:0/4163727915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcadc0c6210 0x7fcadc0c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:06.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcae0a30700 1 --2- 172.21.15.102:0/4163727915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcadc0c72c0 0x7fcadc1579c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcacc011990 tx=0x7fcacc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:06.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.033+0000 7fcad17fa700 1 -- 172.21.15.102:0/4163727915 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00f6d0 con 0x7fcadc0c72c0 2024-08-17T02:29:06.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.037+0000 7fcad17fa700 1 -- 172.21.15.102:0/4163727915 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc00f830 con 0x7fcadc0c72c0 2024-08-17T02:29:06.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.037+0000 7fcae3495700 1 -- 172.21.15.102:0/4163727915 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcadc0c82d0 con 0x7fcadc0c72c0 2024-08-17T02:29:06.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.037+0000 7fcad17fa700 1 -- 172.21.15.102:0/4163727915 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00fbf0 con 0x7fcadc0c72c0 2024-08-17T02:29:06.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.037+0000 7fcae3495700 1 -- 172.21.15.102:0/4163727915 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcadc157f00 con 0x7fcadc0c72c0 2024-08-17T02:29:06.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.037+0000 7fcae3495700 1 -- 172.21.15.102:0/4163727915 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcadc0638f0 con 0x7fcadc0c72c0 2024-08-17T02:29:06.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.037+0000 7fcad17fa700 1 -- 172.21.15.102:0/4163727915 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcacc015460 con 0x7fcadc0c72c0 2024-08-17T02:29:06.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.037+0000 7fcad17fa700 1 --2- 172.21.15.102:0/4163727915 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcac0060860 0x7fcac0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.037+0000 7fcad17fa700 1 -- 172.21.15.102:0/4163727915 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6251+0+0 (secure 0 0 0) 0x7fcacc07d590 con 0x7fcadc0c72c0 2024-08-17T02:29:06.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.037+0000 7fcae1231700 1 --2- 172.21.15.102:0/4163727915 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcac0060860 0x7fcac0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.041+0000 7fcae1231700 1 --2- 172.21.15.102:0/4163727915 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcac0060860 0x7fcac0062d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcad8001ed0 tx=0x7fcad8015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:06.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.045+0000 7fcad17fa700 1 -- 172.21.15.102:0/4163727915 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcacc04d7c0 con 0x7fcadc0c72c0 2024-08-17T02:29:06.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.205+0000 7fcae3495700 1 -- 172.21.15.102:0/4163727915 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcadc0ca5c0 con 0x7fcadc0c72c0 2024-08-17T02:29:06.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.897+0000 7fcad17fa700 1 -- 172.21.15.102:0/4163727915 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcacc050de0 con 0x7fcadc0c72c0 2024-08-17T02:29:06.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.909+0000 7fcae3495700 1 -- 172.21.15.102:0/4163727915 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcac0060860 msgr2=0x7fcac0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.909+0000 7fcae3495700 1 --2- 172.21.15.102:0/4163727915 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcac0060860 0x7fcac0062d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcad8001ed0 tx=0x7fcad8015000 comp rx=0 tx=0).stop 2024-08-17T02:29:06.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.909+0000 7fcae3495700 1 -- 172.21.15.102:0/4163727915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcadc0c72c0 msgr2=0x7fcadc1579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.909+0000 7fcae3495700 1 --2- 172.21.15.102:0/4163727915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcadc0c72c0 0x7fcadc1579c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcacc011990 tx=0x7fcacc008040 comp rx=0 tx=0).stop 2024-08-17T02:29:06.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.909+0000 7fcae3495700 1 -- 172.21.15.102:0/4163727915 shutdown_connections 2024-08-17T02:29:06.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.909+0000 7fcae3495700 1 --2- 172.21.15.102:0/4163727915 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fcac0060860 0x7fcac0062d10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.909+0000 7fcae3495700 1 --2- 172.21.15.102:0/4163727915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcadc0c72c0 0x7fcadc1579c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.909+0000 7fcae3495700 1 --2- 172.21.15.102:0/4163727915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcadc0c6210 0x7fcadc0c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.909+0000 7fcae3495700 1 --2- 172.21.15.102:0/4163727915 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fcac8003a60 0x7fcadc0c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.909+0000 7fcae3495700 1 -- 172.21.15.102:0/4163727915 >> 172.21.15.102:0/4163727915 conn(0x7fcadc067590 msgr2=0x7fcadc1582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:06.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.909+0000 7fcae3495700 1 -- 172.21.15.102:0/4163727915 shutdown_connections 2024-08-17T02:29:06.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:06.909+0000 7fcae3495700 1 -- 172.21.15.102:0/4163727915 wait complete. 2024-08-17T02:29:06.913 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data' removed 2024-08-17T02:29:06.924 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:07.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.029+0000 7fc238824700 1 Processor -- start 2024-08-17T02:29:07.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.029+0000 7fc238824700 1 -- start start 2024-08-17T02:29:07.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.029+0000 7fc238824700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc22c0d9380 0x7fc22c0dff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.029+0000 7fc238824700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc22c0513f0 0x7fc22c054560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.029+0000 7fc238824700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22c009560 con 0x7fc22c0085e0 2024-08-17T02:29:07.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.029+0000 7fc238824700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22c038720 con 0x7fc22c0513f0 2024-08-17T02:29:07.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.029+0000 7fc238824700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c008a50 con 0x7fc22c0d9380 2024-08-17T02:29:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.029+0000 7fc2337fe700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc22c0d9380 0x7fc22c0dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.029+0000 7fc232ffd700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fc22c0085e0 0x7fc22c050ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:52164/0 (socket says 172.21.15.102:52164) 2024-08-17T02:29:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.029+0000 7fc232ffd700 1 -- 172.21.15.102:0/2244100363 learned_addr learned my addr 172.21.15.102:0/2244100363 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.029+0000 7fc233fff700 1 --2- 172.21.15.102:0/2244100363 >> v2:172.21.15.121:3300/0 conn(0x7fc22c0513f0 0x7fc22c054560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc2327fc700 1 -- 172.21.15.102:0/2244100363 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831069836 0 0) 0x7fc22c009560 con 0x7fc22c0085e0 2024-08-17T02:29:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc2327fc700 1 -- 172.21.15.102:0/2244100363 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc224003570 con 0x7fc22c0085e0 2024-08-17T02:29:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc2337fe700 1 -- 172.21.15.102:0/2244100363 >> v2:172.21.15.121:3300/0 conn(0x7fc22c0513f0 msgr2=0x7fc22c054560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc2337fe700 1 --2- 172.21.15.102:0/2244100363 >> v2:172.21.15.121:3300/0 conn(0x7fc22c0513f0 0x7fc22c054560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc2337fe700 1 -- 172.21.15.102:0/2244100363 >> v1:172.21.15.121:6789/0 conn(0x7fc22c0085e0 legacy=0x7fc22c050ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc2337fe700 1 -- 172.21.15.102:0/2244100363 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c008cc0 con 0x7fc22c0d9380 2024-08-17T02:29:07.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc2337fe700 1 --2- 172.21.15.102:0/2244100363 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc22c0d9380 0x7fc22c0dff60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc22800bb70 tx=0x7fc22800b3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbed151c645921d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc2327fc700 1 -- 172.21.15.102:0/2244100363 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228005c10 con 0x7fc22c0d9380 2024-08-17T02:29:07.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc2327fc700 1 -- 172.21.15.102:0/2244100363 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc228005d70 con 0x7fc22c0d9380 2024-08-17T02:29:07.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc2327fc700 1 -- 172.21.15.102:0/2244100363 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22800da70 con 0x7fc22c0d9380 2024-08-17T02:29:07.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc238824700 1 -- 172.21.15.102:0/2244100363 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc22c0d9380 msgr2=0x7fc22c0dff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc238824700 1 --2- 172.21.15.102:0/2244100363 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc22c0d9380 0x7fc22c0dff60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc22800bb70 tx=0x7fc22800b3e0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc238824700 1 -- 172.21.15.102:0/2244100363 shutdown_connections 2024-08-17T02:29:07.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc238824700 1 --2- 172.21.15.102:0/2244100363 >> v2:172.21.15.121:3300/0 conn(0x7fc22c0513f0 0x7fc22c054560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc238824700 1 --2- 172.21.15.102:0/2244100363 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc22c0d9380 0x7fc22c0dff60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc238824700 1 -- 172.21.15.102:0/2244100363 >> 172.21.15.102:0/2244100363 conn(0x7fc22c0527a0 msgr2=0x7fc22c052ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:07.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc238824700 1 -- 172.21.15.102:0/2244100363 shutdown_connections 2024-08-17T02:29:07.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc238824700 1 -- 172.21.15.102:0/2244100363 wait complete. 2024-08-17T02:29:07.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc238824700 1 Processor -- start 2024-08-17T02:29:07.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.033+0000 7fc238824700 1 -- start start 2024-08-17T02:29:07.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc238824700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc22c0085e0 0x7fc22c0edb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc238824700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc22c0513f0 0x7fc22c0de330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc238824700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc22c0d9380 0x7fc22c04baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc238824700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0db200 con 0x7fc22c0085e0 2024-08-17T02:29:07.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc238824700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0da5f0 con 0x7fc22c0513f0 2024-08-17T02:29:07.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc238824700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0da8d0 con 0x7fc22c0d9380 2024-08-17T02:29:07.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc2337fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc22c0085e0 0x7fc22c0edb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc2337fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc22c0085e0 0x7fc22c0edb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33342/0 (socket says 172.21.15.102:33342) 2024-08-17T02:29:07.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc2337fe700 1 -- 172.21.15.102:0/1899766014 learned_addr learned my addr 172.21.15.102:0/1899766014 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:07.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc233fff700 1 --2- 172.21.15.102:0/1899766014 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc22c0d9380 0x7fc22c04baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc232ffd700 1 --2- 172.21.15.102:0/1899766014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc22c0513f0 0x7fc22c0de330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc2337fe700 1 -- 172.21.15.102:0/1899766014 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc22c0d9380 msgr2=0x7fc22c04baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc2337fe700 1 --2- 172.21.15.102:0/1899766014 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc22c0d9380 0x7fc22c04baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc2337fe700 1 -- 172.21.15.102:0/1899766014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc22c0513f0 msgr2=0x7fc22c0de330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc2337fe700 1 --2- 172.21.15.102:0/1899766014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc22c0513f0 0x7fc22c0de330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc2337fe700 1 -- 172.21.15.102:0/1899766014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22800b660 con 0x7fc22c0085e0 2024-08-17T02:29:07.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc232ffd700 1 --2- 172.21.15.102:0/1899766014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc22c0513f0 0x7fc22c0de330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:07.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc2337fe700 1 --2- 172.21.15.102:0/1899766014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc22c0085e0 0x7fc22c0edb10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc22c008b90 tx=0x7fc22801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc21f7fe700 1 -- 172.21.15.102:0/1899766014 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228005c10 con 0x7fc22c0085e0 2024-08-17T02:29:07.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc21f7fe700 1 -- 172.21.15.102:0/1899766014 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22801d070 con 0x7fc22c0085e0 2024-08-17T02:29:07.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc21f7fe700 1 -- 172.21.15.102:0/1899766014 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228010470 con 0x7fc22c0085e0 2024-08-17T02:29:07.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc238824700 1 -- 172.21.15.102:0/1899766014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22c0dabb0 con 0x7fc22c0085e0 2024-08-17T02:29:07.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc238824700 1 -- 172.21.15.102:0/1899766014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22c0ee050 con 0x7fc22c0085e0 2024-08-17T02:29:07.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc238824700 1 -- 172.21.15.102:0/1899766014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22c0db030 con 0x7fc22c0085e0 2024-08-17T02:29:07.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc21f7fe700 1 -- 172.21.15.102:0/1899766014 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc228024440 con 0x7fc22c0085e0 2024-08-17T02:29:07.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.037+0000 7fc21f7fe700 1 --2- 172.21.15.102:0/1899766014 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc218060860 0x7fc218062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.041+0000 7fc21f7fe700 1 -- 172.21.15.102:0/1899766014 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fc228014030 con 0x7fc22c0085e0 2024-08-17T02:29:07.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.041+0000 7fc232ffd700 1 --2- 172.21.15.102:0/1899766014 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc218060860 0x7fc218062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.041+0000 7fc232ffd700 1 --2- 172.21.15.102:0/1899766014 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc218060860 0x7fc218062d10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc22c053200 tx=0x7fc220009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.045+0000 7fc21f7fe700 1 -- 172.21.15.102:0/1899766014 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc228050fe0 con 0x7fc22c0085e0 2024-08-17T02:29:07.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.213+0000 7fc238824700 1 -- 172.21.15.102:0/1899766014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc22c005800 con 0x7fc22c0085e0 2024-08-17T02:29:07.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.213+0000 7fc21f7fe700 1 -- 172.21.15.102:0/1899766014 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15562 (secure 0 0 0) 0x7fc22801f090 con 0x7fc22c0085e0 2024-08-17T02:29:07.217 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:07.217 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":39,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:29:06.893617+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000658238.meta","create_time":"2024-08-17T02:26:55.316074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000658238"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000658238.data","create_time":"2024-08-17T02:26:56.329435+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000658238"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:6837/1340437033":"2024-08-18T02:29:03.879648+0000","172.21.15.102:6836/1340437033":"2024-08-18T02:29:03.879648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.217+0000 7fc238824700 1 -- 172.21.15.102:0/1899766014 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc218060860 msgr2=0x7fc218062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.217+0000 7fc238824700 1 --2- 172.21.15.102:0/1899766014 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc218060860 0x7fc218062d10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc22c053200 tx=0x7fc220009040 comp rx=0 tx=0).stop 2024-08-17T02:29:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.217+0000 7fc238824700 1 -- 172.21.15.102:0/1899766014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc22c0085e0 msgr2=0x7fc22c0edb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.217+0000 7fc238824700 1 --2- 172.21.15.102:0/1899766014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc22c0085e0 0x7fc22c0edb10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc22c008b90 tx=0x7fc22801a000 comp rx=0 tx=0).stop 2024-08-17T02:29:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.217+0000 7fc238824700 1 -- 172.21.15.102:0/1899766014 shutdown_connections 2024-08-17T02:29:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.217+0000 7fc238824700 1 --2- 172.21.15.102:0/1899766014 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fc218060860 0x7fc218062d10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.217+0000 7fc238824700 1 --2- 172.21.15.102:0/1899766014 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fc22c0d9380 0x7fc22c04baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.217+0000 7fc238824700 1 --2- 172.21.15.102:0/1899766014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc22c0513f0 0x7fc22c0de330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.217+0000 7fc238824700 1 --2- 172.21.15.102:0/1899766014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc22c0085e0 0x7fc22c0edb10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.217+0000 7fc238824700 1 -- 172.21.15.102:0/1899766014 >> 172.21.15.102:0/1899766014 conn(0x7fc22c0527a0 msgr2=0x7fc22c0d6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:07.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.217+0000 7fc238824700 1 -- 172.21.15.102:0/1899766014 shutdown_connections 2024-08-17T02:29:07.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.217+0000 7fc238824700 1 -- 172.21.15.102:0/1899766014 wait complete. 2024-08-17T02:29:07.231 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:49.236728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000658238.meta', 'create_time': '2024-08-17T02:26:55.316074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000658238'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000658238.data', 'create_time': '2024-08-17T02:26:56.329435+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000658238'}}}] 2024-08-17T02:29:07.231 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:07.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.341+0000 7f5b2f1b1700 1 Processor -- start 2024-08-17T02:29:07.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.341+0000 7f5b2f1b1700 1 -- start start 2024-08-17T02:29:07.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.341+0000 7f5b2f1b1700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5b28142d40 0x7f5b280b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.341+0000 7f5b2f1b1700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b28140f70 con 0x7f5b280af190 2024-08-17T02:29:07.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.341+0000 7f5b2f1b1700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b28141250 con 0x7f5b2806e470 2024-08-17T02:29:07.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.341+0000 7f5b2f1b1700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b28141530 con 0x7f5b28142d40 2024-08-17T02:29:07.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2e9b0700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5b28142d40 0x7f5b280b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2d9ae700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f5b280af190 0x7f5b280b0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:54964/0 (socket says 172.21.15.102:54964) 2024-08-17T02:29:07.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2d9ae700 1 -- 172.21.15.102:0/2934180067 learned_addr learned my addr 172.21.15.102:0/2934180067 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:07.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2d1ad700 1 -- 172.21.15.102:0/2934180067 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964596911 0 0) 0x7f5b28141250 con 0x7f5b2806e470 2024-08-17T02:29:07.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2d1ad700 1 -- 172.21.15.102:0/2934180067 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b10003570 con 0x7f5b2806e470 2024-08-17T02:29:07.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2e9b0700 1 -- 172.21.15.102:0/2934180067 >> v1:172.21.15.121:6789/0 conn(0x7f5b2806e470 legacy=0x7f5b280aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2e9b0700 1 -- 172.21.15.102:0/2934180067 >> v1:172.21.15.102:6789/0 conn(0x7f5b280af190 legacy=0x7f5b280b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2d1ad700 1 -- 172.21.15.102:0/2934180067 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321250945 0 0) 0x7f5b28140f70 con 0x7f5b280af190 2024-08-17T02:29:07.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2e9b0700 1 -- 172.21.15.102:0/2934180067 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b28141810 con 0x7f5b28142d40 2024-08-17T02:29:07.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2e9b0700 1 --2- 172.21.15.102:0/2934180067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b28142d40 0x7f5b280b1600 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5b180098e0 tx=0x7f5b180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861dee7995b170bc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2d1ad700 1 -- 172.21.15.102:0/2934180067 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1800b640 con 0x7f5b28142d40 2024-08-17T02:29:07.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2d1ad700 1 -- 172.21.15.102:0/2934180067 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1800b7a0 con 0x7f5b28142d40 2024-08-17T02:29:07.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2d1ad700 1 -- 172.21.15.102:0/2934180067 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1800bb20 con 0x7f5b28142d40 2024-08-17T02:29:07.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2f1b1700 1 -- 172.21.15.102:0/2934180067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b28142d40 msgr2=0x7f5b280b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2f1b1700 1 --2- 172.21.15.102:0/2934180067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b28142d40 0x7f5b280b1600 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5b180098e0 tx=0x7f5b180091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2f1b1700 1 -- 172.21.15.102:0/2934180067 shutdown_connections 2024-08-17T02:29:07.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2f1b1700 1 --2- 172.21.15.102:0/2934180067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b28142d40 0x7f5b280b1600 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2f1b1700 1 -- 172.21.15.102:0/2934180067 >> 172.21.15.102:0/2934180067 conn(0x7f5b280678a0 msgr2=0x7f5b28067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:07.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2f1b1700 1 -- 172.21.15.102:0/2934180067 shutdown_connections 2024-08-17T02:29:07.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.345+0000 7f5b2f1b1700 1 -- 172.21.15.102:0/2934180067 wait complete. 2024-08-17T02:29:07.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2f1b1700 1 Processor -- start 2024-08-17T02:29:07.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2f1b1700 1 -- start start 2024-08-17T02:29:07.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2f1b1700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2806e470 0x7f5b2813f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2f1b1700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b280af190 0x7f5b280c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2f1b1700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b28142d40 0x7f5b280caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2f1b1700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b280c4ef0 con 0x7f5b28142d40 2024-08-17T02:29:07.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2f1b1700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2814f4a0 con 0x7f5b2806e470 2024-08-17T02:29:07.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2f1b1700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b280c4930 con 0x7f5b280af190 2024-08-17T02:29:07.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2e9b0700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b28142d40 0x7f5b280caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2e9b0700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b28142d40 0x7f5b280caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33368/0 (socket says 172.21.15.102:33368) 2024-08-17T02:29:07.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2e1af700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2806e470 0x7f5b2813f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2e9b0700 1 -- 172.21.15.102:0/3419053044 learned_addr learned my addr 172.21.15.102:0/3419053044 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:07.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2d9ae700 1 --2- 172.21.15.102:0/3419053044 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b280af190 0x7f5b280c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2e9b0700 1 -- 172.21.15.102:0/3419053044 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b280af190 msgr2=0x7f5b280c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2e9b0700 1 --2- 172.21.15.102:0/3419053044 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b280af190 0x7f5b280c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2e9b0700 1 -- 172.21.15.102:0/3419053044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2806e470 msgr2=0x7f5b2813f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2e9b0700 1 --2- 172.21.15.102:0/3419053044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2806e470 0x7f5b2813f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2e9b0700 1 -- 172.21.15.102:0/3419053044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b18009420 con 0x7f5b28142d40 2024-08-17T02:29:07.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2d9ae700 1 --2- 172.21.15.102:0/3419053044 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b280af190 0x7f5b280c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:07.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2e9b0700 1 --2- 172.21.15.102:0/3419053044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b28142d40 0x7f5b280caf90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5b180093f0 tx=0x7f5b18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b1e7fc700 1 -- 172.21.15.102:0/3419053044 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1801a450 con 0x7f5b28142d40 2024-08-17T02:29:07.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b1e7fc700 1 -- 172.21.15.102:0/3419053044 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1801a5d0 con 0x7f5b28142d40 2024-08-17T02:29:07.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2f1b1700 1 -- 172.21.15.102:0/3419053044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b280c4c10 con 0x7f5b28142d40 2024-08-17T02:29:07.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b1e7fc700 1 -- 172.21.15.102:0/3419053044 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1801a990 con 0x7f5b28142d40 2024-08-17T02:29:07.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.349+0000 7f5b2f1b1700 1 -- 172.21.15.102:0/3419053044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2813fee0 con 0x7f5b28142d40 2024-08-17T02:29:07.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.353+0000 7f5b2f1b1700 1 -- 172.21.15.102:0/3419053044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2814f610 con 0x7f5b28142d40 2024-08-17T02:29:07.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.353+0000 7f5b1e7fc700 1 -- 172.21.15.102:0/3419053044 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5b1801ad00 con 0x7f5b28142d40 2024-08-17T02:29:07.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.353+0000 7f5b1e7fc700 1 --2- 172.21.15.102:0/3419053044 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5b14060860 0x7f5b14062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.353+0000 7f5b1e7fc700 1 -- 172.21.15.102:0/3419053044 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f5b1807e680 con 0x7f5b28142d40 2024-08-17T02:29:07.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.353+0000 7f5b2e1af700 1 --2- 172.21.15.102:0/3419053044 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5b14060860 0x7f5b14062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.353+0000 7f5b2e1af700 1 --2- 172.21.15.102:0/3419053044 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5b14060860 0x7f5b14062d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5b200040a0 tx=0x7f5b20007f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.361+0000 7f5b1e7fc700 1 -- 172.21.15.102:0/3419053044 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5b1804ea50 con 0x7f5b28142d40 2024-08-17T02:29:07.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.521+0000 7f5b2f1b1700 1 -- 172.21.15.102:0/3419053044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b28064330 con 0x7f5b28142d40 2024-08-17T02:29:07.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.521+0000 7f5b1e7fc700 1 -- 172.21.15.102:0/3419053044 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b18052070 con 0x7f5b28142d40 2024-08-17T02:29:07.525 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-08-17T02:29:07.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.525+0000 7f5b2f1b1700 1 -- 172.21.15.102:0/3419053044 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5b14060860 msgr2=0x7f5b14062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.525+0000 7f5b2f1b1700 1 --2- 172.21.15.102:0/3419053044 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5b14060860 0x7f5b14062d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5b200040a0 tx=0x7f5b20007f90 comp rx=0 tx=0).stop 2024-08-17T02:29:07.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.525+0000 7f5b2f1b1700 1 -- 172.21.15.102:0/3419053044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b28142d40 msgr2=0x7f5b280caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.525+0000 7f5b2f1b1700 1 --2- 172.21.15.102:0/3419053044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b28142d40 0x7f5b280caf90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5b180093f0 tx=0x7f5b18017000 comp rx=0 tx=0).stop 2024-08-17T02:29:07.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.525+0000 7f5b2f1b1700 1 -- 172.21.15.102:0/3419053044 shutdown_connections 2024-08-17T02:29:07.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.525+0000 7f5b2f1b1700 1 --2- 172.21.15.102:0/3419053044 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5b14060860 0x7f5b14062d10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.525+0000 7f5b2f1b1700 1 --2- 172.21.15.102:0/3419053044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b28142d40 0x7f5b280caf90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.525+0000 7f5b2f1b1700 1 --2- 172.21.15.102:0/3419053044 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5b280af190 0x7f5b280c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.525+0000 7f5b2f1b1700 1 --2- 172.21.15.102:0/3419053044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b2806e470 0x7f5b2813f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.525+0000 7f5b2f1b1700 1 -- 172.21.15.102:0/3419053044 >> 172.21.15.102:0/3419053044 conn(0x7f5b280678a0 msgr2=0x7f5b28067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:07.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.525+0000 7f5b2f1b1700 1 -- 172.21.15.102:0/3419053044 shutdown_connections 2024-08-17T02:29:07.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.525+0000 7f5b2f1b1700 1 -- 172.21.15.102:0/3419053044 wait complete. 2024-08-17T02:29:07.540 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000658238.meta pg_num 2024-08-17T02:29:07.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.653+0000 7f8c5a1eb700 1 Processor -- start 2024-08-17T02:29:07.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.653+0000 7f8c5a1eb700 1 -- start start 2024-08-17T02:29:07.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.653+0000 7f8c5a1eb700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c5415d5b0 0x7f8c54164040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.653+0000 7f8c5a1eb700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c540c9df0 con 0x7f8c54153a30 2024-08-17T02:29:07.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.653+0000 7f8c5a1eb700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c540cdca0 con 0x7f8c54153660 2024-08-17T02:29:07.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.653+0000 7f8c5a1eb700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c540c91e0 con 0x7f8c5415d5b0 2024-08-17T02:29:07.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c52ffd700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f8c54153a30 0x7f8c5415cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:54974/0 (socket says 172.21.15.102:54974) 2024-08-17T02:29:07.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c52ffd700 1 -- 172.21.15.102:0/3466950406 learned_addr learned my addr 172.21.15.102:0/3466950406 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:07.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c53fff700 1 --2- 172.21.15.102:0/3466950406 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c5415d5b0 0x7f8c54164040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c527fc700 1 -- 172.21.15.102:0/3466950406 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815600552 0 0) 0x7f8c540c9df0 con 0x7f8c54153a30 2024-08-17T02:29:07.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c527fc700 1 -- 172.21.15.102:0/3466950406 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c3c003570 con 0x7f8c54153a30 2024-08-17T02:29:07.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c527fc700 1 -- 172.21.15.102:0/3466950406 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693800110 0 0) 0x7f8c540cdca0 con 0x7f8c54153660 2024-08-17T02:29:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c527fc700 1 -- 172.21.15.102:0/3466950406 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c540c9df0 con 0x7f8c54153660 2024-08-17T02:29:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c53fff700 1 -- 172.21.15.102:0/3466950406 >> v1:172.21.15.121:6789/0 conn(0x7f8c54153660 legacy=0x7f8c540cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c53fff700 1 -- 172.21.15.102:0/3466950406 >> v1:172.21.15.102:6789/0 conn(0x7f8c54153a30 legacy=0x7f8c5415cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c53fff700 1 -- 172.21.15.102:0/3466950406 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c540c94c0 con 0x7f8c5415d5b0 2024-08-17T02:29:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c53fff700 1 --2- 172.21.15.102:0/3466950406 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c5415d5b0 0x7f8c54164040 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009e90 tx=0x7f8c4c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aee9aff424997923 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c527fc700 1 -- 172.21.15.102:0/3466950406 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c00e070 con 0x7f8c5415d5b0 2024-08-17T02:29:07.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c527fc700 1 -- 172.21.15.102:0/3466950406 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4c00bb80 con 0x7f8c5415d5b0 2024-08-17T02:29:07.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c527fc700 1 -- 172.21.15.102:0/3466950406 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c012430 con 0x7f8c5415d5b0 2024-08-17T02:29:07.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c5a1eb700 1 -- 172.21.15.102:0/3466950406 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c5415d5b0 msgr2=0x7f8c54164040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c5a1eb700 1 --2- 172.21.15.102:0/3466950406 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c5415d5b0 0x7f8c54164040 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009e90 tx=0x7f8c4c009780 comp rx=0 tx=0).stop 2024-08-17T02:29:07.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c5a1eb700 1 -- 172.21.15.102:0/3466950406 shutdown_connections 2024-08-17T02:29:07.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c5a1eb700 1 --2- 172.21.15.102:0/3466950406 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c5415d5b0 0x7f8c54164040 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c5a1eb700 1 -- 172.21.15.102:0/3466950406 >> 172.21.15.102:0/3466950406 conn(0x7f8c540caad0 msgr2=0x7f8c540caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:07.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c5a1eb700 1 -- 172.21.15.102:0/3466950406 shutdown_connections 2024-08-17T02:29:07.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.657+0000 7f8c5a1eb700 1 -- 172.21.15.102:0/3466950406 wait complete. 2024-08-17T02:29:07.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c5a1eb700 1 Processor -- start 2024-08-17T02:29:07.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c5a1eb700 1 -- start start 2024-08-17T02:29:07.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c5a1eb700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c54153660 0x7f8c540b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c5a1eb700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c54153a30 0x7f8c5413a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c5a1eb700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c5415d5b0 0x7f8c540c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c5a1eb700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5413b2e0 con 0x7f8c54153660 2024-08-17T02:29:07.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c5a1eb700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c540b1b10 con 0x7f8c5415d5b0 2024-08-17T02:29:07.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c5a1eb700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5413a850 con 0x7f8c54153a30 2024-08-17T02:29:07.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c537fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c54153660 0x7f8c540b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c537fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c54153660 0x7f8c540b1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33378/0 (socket says 172.21.15.102:33378) 2024-08-17T02:29:07.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c537fe700 1 -- 172.21.15.102:0/56262623 learned_addr learned my addr 172.21.15.102:0/56262623 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:07.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c52ffd700 1 --2- 172.21.15.102:0/56262623 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c54153a30 0x7f8c5413a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c53fff700 1 --2- 172.21.15.102:0/56262623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c5415d5b0 0x7f8c540c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c537fe700 1 -- 172.21.15.102:0/56262623 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c54153a30 msgr2=0x7f8c5413a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c537fe700 1 --2- 172.21.15.102:0/56262623 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c54153a30 0x7f8c5413a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c537fe700 1 -- 172.21.15.102:0/56262623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c5415d5b0 msgr2=0x7f8c540c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c537fe700 1 --2- 172.21.15.102:0/56262623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c5415d5b0 0x7f8c540c42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c537fe700 1 -- 172.21.15.102:0/56262623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c009a20 con 0x7f8c54153660 2024-08-17T02:29:07.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c537fe700 1 --2- 172.21.15.102:0/56262623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c54153660 0x7f8c540b1fa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800c7c0 tx=0x7f8c48007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c3b7fe700 1 -- 172.21.15.102:0/56262623 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48002ea0 con 0x7f8c54153660 2024-08-17T02:29:07.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c3b7fe700 1 -- 172.21.15.102:0/56262623 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c48010510 con 0x7f8c54153660 2024-08-17T02:29:07.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c3b7fe700 1 -- 172.21.15.102:0/56262623 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c480108b0 con 0x7f8c54153660 2024-08-17T02:29:07.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c5a1eb700 1 -- 172.21.15.102:0/56262623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c540b0f00 con 0x7f8c54153660 2024-08-17T02:29:07.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.661+0000 7f8c5a1eb700 1 -- 172.21.15.102:0/56262623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c540b14c0 con 0x7f8c54153660 2024-08-17T02:29:07.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.665+0000 7f8c5a1eb700 1 -- 172.21.15.102:0/56262623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c540645c0 con 0x7f8c54153660 2024-08-17T02:29:07.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.665+0000 7f8c3b7fe700 1 -- 172.21.15.102:0/56262623 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8c48010ca0 con 0x7f8c54153660 2024-08-17T02:29:07.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.665+0000 7f8c3b7fe700 1 --2- 172.21.15.102:0/56262623 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8c40060860 0x7f8c40062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.665+0000 7f8c3b7fe700 1 -- 172.21.15.102:0/56262623 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f8c4807c1f0 con 0x7f8c54153660 2024-08-17T02:29:07.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.665+0000 7f8c52ffd700 1 --2- 172.21.15.102:0/56262623 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8c40060860 0x7f8c40062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.665+0000 7f8c52ffd700 1 --2- 172.21.15.102:0/56262623 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8c40060860 0x7f8c40062d10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8c44007fd0 tx=0x7f8c44009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.673+0000 7f8c3b7fe700 1 -- 172.21.15.102:0/56262623 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8c4804c5c0 con 0x7f8c54153660 2024-08-17T02:29:07.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.833+0000 7f8c5a1eb700 1 -- 172.21.15.102:0/56262623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000658238.meta", "var": "pg_num"} v 0) v1 -- 0x7f8c54153440 con 0x7f8c54153660 2024-08-17T02:29:07.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.837+0000 7f8c3b7fe700 1 -- 172.21.15.102:0/56262623 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000658238.meta", "var": "pg_num"}]=0 v39) v1 ==== 124+0+11 (secure 0 0 0) 0x7f8c48017020 con 0x7f8c54153660 2024-08-17T02:29:07.838 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-08-17T02:29:07.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.837+0000 7f8c5a1eb700 1 -- 172.21.15.102:0/56262623 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8c40060860 msgr2=0x7f8c40062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.837+0000 7f8c5a1eb700 1 --2- 172.21.15.102:0/56262623 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8c40060860 0x7f8c40062d10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8c44007fd0 tx=0x7f8c44009040 comp rx=0 tx=0).stop 2024-08-17T02:29:07.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.837+0000 7f8c5a1eb700 1 -- 172.21.15.102:0/56262623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c54153660 msgr2=0x7f8c540b1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.837+0000 7f8c5a1eb700 1 --2- 172.21.15.102:0/56262623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c54153660 0x7f8c540b1fa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800c7c0 tx=0x7f8c48007dc0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.837+0000 7f8c5a1eb700 1 -- 172.21.15.102:0/56262623 shutdown_connections 2024-08-17T02:29:07.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.837+0000 7f8c5a1eb700 1 --2- 172.21.15.102:0/56262623 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8c40060860 0x7f8c40062d10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.837+0000 7f8c5a1eb700 1 --2- 172.21.15.102:0/56262623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c5415d5b0 0x7f8c540c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.837+0000 7f8c5a1eb700 1 --2- 172.21.15.102:0/56262623 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c54153a30 0x7f8c5413a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.837+0000 7f8c5a1eb700 1 --2- 172.21.15.102:0/56262623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c54153660 0x7f8c540b1fa0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.837+0000 7f8c5a1eb700 1 -- 172.21.15.102:0/56262623 >> 172.21.15.102:0/56262623 conn(0x7f8c540caad0 msgr2=0x7f8c540c3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:07.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.837+0000 7f8c5a1eb700 1 -- 172.21.15.102:0/56262623 shutdown_connections 2024-08-17T02:29:07.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.837+0000 7f8c5a1eb700 1 -- 172.21.15.102:0/56262623 wait complete. 2024-08-17T02:29:07.856 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000658238.data pg_num 2024-08-17T02:29:07.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.965+0000 7f7184be4700 1 Processor -- start 2024-08-17T02:29:07.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.969+0000 7f7184be4700 1 -- start start 2024-08-17T02:29:07.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.969+0000 7f7184be4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f71800b2770 0x7f7180161ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.969+0000 7f7184be4700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71800cba90 con 0x7f7180157140 2024-08-17T02:29:07.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.969+0000 7f7184be4700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71800cae80 con 0x7f7180156d70 2024-08-17T02:29:07.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.969+0000 7f7184be4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71800cb160 con 0x7f71800b2770 2024-08-17T02:29:07.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.969+0000 7f7176ffd700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f7180157140 0x7f71800b2060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:54984/0 (socket says 172.21.15.102:54984) 2024-08-17T02:29:07.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.969+0000 7f7176ffd700 1 -- 172.21.15.102:0/1359360204 learned_addr learned my addr 172.21.15.102:0/1359360204 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:07.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.969+0000 7f717ffff700 1 --2- 172.21.15.102:0/1359360204 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f71800b2770 0x7f7180161ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.969+0000 7f717effd700 1 -- 172.21.15.102:0/1359360204 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790324749 0 0) 0x7f71800cba90 con 0x7f7180157140 2024-08-17T02:29:07.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.969+0000 7f717effd700 1 -- 172.21.15.102:0/1359360204 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f716c003570 con 0x7f7180157140 2024-08-17T02:29:07.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.969+0000 7f717effd700 1 -- 172.21.15.102:0/1359360204 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902778459 0 0) 0x7f71800cae80 con 0x7f7180156d70 2024-08-17T02:29:07.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.969+0000 7f717effd700 1 -- 172.21.15.102:0/1359360204 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71800cba90 con 0x7f7180156d70 2024-08-17T02:29:07.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.969+0000 7f717ffff700 1 -- 172.21.15.102:0/1359360204 >> v1:172.21.15.121:6789/0 conn(0x7f7180156d70 legacy=0x7f71800678c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.969+0000 7f717ffff700 1 -- 172.21.15.102:0/1359360204 >> v1:172.21.15.102:6789/0 conn(0x7f7180157140 legacy=0x7f71800b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.969+0000 7f717ffff700 1 -- 172.21.15.102:0/1359360204 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71800cb440 con 0x7f71800b2770 2024-08-17T02:29:07.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.969+0000 7f717ffff700 1 --2- 172.21.15.102:0/1359360204 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f71800b2770 0x7f7180161ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7178009e90 tx=0x7f7178009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c7c59ae3dd74b59 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f717effd700 1 -- 172.21.15.102:0/1359360204 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717800e070 con 0x7f71800b2770 2024-08-17T02:29:07.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f717effd700 1 -- 172.21.15.102:0/1359360204 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717800bb80 con 0x7f71800b2770 2024-08-17T02:29:07.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f717effd700 1 -- 172.21.15.102:0/1359360204 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7178012430 con 0x7f71800b2770 2024-08-17T02:29:07.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f7184be4700 1 -- 172.21.15.102:0/1359360204 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f71800b2770 msgr2=0x7f7180161ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f7184be4700 1 --2- 172.21.15.102:0/1359360204 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f71800b2770 0x7f7180161ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7178009e90 tx=0x7f7178009780 comp rx=0 tx=0).stop 2024-08-17T02:29:07.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f7184be4700 1 -- 172.21.15.102:0/1359360204 shutdown_connections 2024-08-17T02:29:07.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f7184be4700 1 --2- 172.21.15.102:0/1359360204 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f71800b2770 0x7f7180161ae0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f7184be4700 1 -- 172.21.15.102:0/1359360204 >> 172.21.15.102:0/1359360204 conn(0x7f718006e170 msgr2=0x7f718006e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:07.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f7184be4700 1 -- 172.21.15.102:0/1359360204 shutdown_connections 2024-08-17T02:29:07.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f7184be4700 1 -- 172.21.15.102:0/1359360204 wait complete. 2024-08-17T02:29:07.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f7184be4700 1 Processor -- start 2024-08-17T02:29:07.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f7184be4700 1 -- start start 2024-08-17T02:29:07.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f7184be4700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71800b2770 0x7f71800a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f7184be4700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7180156d70 0x7f7180151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f7184be4700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7180157140 0x7f7180158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f7184be4700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71800ac2f0 con 0x7f71800b2770 2024-08-17T02:29:07.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f7184be4700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71800abe60 con 0x7f7180156d70 2024-08-17T02:29:07.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f7184be4700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71800aafd0 con 0x7f7180157140 2024-08-17T02:29:07.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f717f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71800b2770 0x7f71800a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f717f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71800b2770 0x7f71800a5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33380/0 (socket says 172.21.15.102:33380) 2024-08-17T02:29:07.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f717f7fe700 1 -- 172.21.15.102:0/835143857 learned_addr learned my addr 172.21.15.102:0/835143857 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:07.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f7176ffd700 1 --2- 172.21.15.102:0/835143857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7180156d70 0x7f7180151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.973+0000 7f717ffff700 1 --2- 172.21.15.102:0/835143857 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7180157140 0x7f7180158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.977+0000 7f717f7fe700 1 -- 172.21.15.102:0/835143857 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7180157140 msgr2=0x7f7180158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.977+0000 7f717f7fe700 1 --2- 172.21.15.102:0/835143857 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7180157140 0x7f7180158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.977+0000 7f717f7fe700 1 -- 172.21.15.102:0/835143857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7180156d70 msgr2=0x7f7180151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.977+0000 7f717f7fe700 1 --2- 172.21.15.102:0/835143857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7180156d70 0x7f7180151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.977+0000 7f717f7fe700 1 -- 172.21.15.102:0/835143857 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7178009a20 con 0x7f71800b2770 2024-08-17T02:29:07.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.977+0000 7f717f7fe700 1 --2- 172.21.15.102:0/835143857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71800b2770 0x7f71800a5e10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f717000c790 tx=0x7f7170007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.977+0000 7f7177fff700 1 -- 172.21.15.102:0/835143857 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170010510 con 0x7f71800b2770 2024-08-17T02:29:07.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.977+0000 7f7177fff700 1 -- 172.21.15.102:0/835143857 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7170010670 con 0x7f71800b2770 2024-08-17T02:29:07.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.977+0000 7f7184be4700 1 -- 172.21.15.102:0/835143857 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71800ab250 con 0x7f71800b2770 2024-08-17T02:29:07.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.977+0000 7f7177fff700 1 -- 172.21.15.102:0/835143857 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170010a10 con 0x7f71800b2770 2024-08-17T02:29:07.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.977+0000 7f7184be4700 1 -- 172.21.15.102:0/835143857 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71800abaf0 con 0x7f71800b2770 2024-08-17T02:29:07.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.977+0000 7f7184be4700 1 -- 172.21.15.102:0/835143857 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71800638f0 con 0x7f71800b2770 2024-08-17T02:29:07.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.977+0000 7f7177fff700 1 -- 172.21.15.102:0/835143857 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f717001b3b0 con 0x7f71800b2770 2024-08-17T02:29:07.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.981+0000 7f7177fff700 1 --2- 172.21.15.102:0/835143857 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7160060860 0x7f7160062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.981+0000 7f7177fff700 1 -- 172.21.15.102:0/835143857 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f717007c4a0 con 0x7f71800b2770 2024-08-17T02:29:07.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.981+0000 7f7176ffd700 1 --2- 172.21.15.102:0/835143857 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7160060860 0x7f7160062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.981+0000 7f7176ffd700 1 --2- 172.21.15.102:0/835143857 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7160060860 0x7f7160062d10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f71800cac10 tx=0x7f7168009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:07.985+0000 7f7177fff700 1 -- 172.21.15.102:0/835143857 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f717004c870 con 0x7f71800b2770 2024-08-17T02:29:08.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.145+0000 7f7184be4700 1 -- 172.21.15.102:0/835143857 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000658238.data", "var": "pg_num"} v 0) v1 -- 0x7f718006a600 con 0x7f71800b2770 2024-08-17T02:29:08.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.145+0000 7f7177fff700 1 -- 172.21.15.102:0/835143857 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000658238.data", "var": "pg_num"}]=0 v39) v1 ==== 124+0+11 (secure 0 0 0) 0x7f717004fe90 con 0x7f71800b2770 2024-08-17T02:29:08.148 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-08-17T02:29:08.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.149+0000 7f7184be4700 1 -- 172.21.15.102:0/835143857 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7160060860 msgr2=0x7f7160062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.149+0000 7f7184be4700 1 --2- 172.21.15.102:0/835143857 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7160060860 0x7f7160062d10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f71800cac10 tx=0x7f7168009040 comp rx=0 tx=0).stop 2024-08-17T02:29:08.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.149+0000 7f7184be4700 1 -- 172.21.15.102:0/835143857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71800b2770 msgr2=0x7f71800a5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.149+0000 7f7184be4700 1 --2- 172.21.15.102:0/835143857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71800b2770 0x7f71800a5e10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f717000c790 tx=0x7f7170007e10 comp rx=0 tx=0).stop 2024-08-17T02:29:08.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.149+0000 7f7184be4700 1 -- 172.21.15.102:0/835143857 shutdown_connections 2024-08-17T02:29:08.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.149+0000 7f7184be4700 1 --2- 172.21.15.102:0/835143857 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7160060860 0x7f7160062d10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.149+0000 7f7184be4700 1 --2- 172.21.15.102:0/835143857 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7180157140 0x7f7180158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.149+0000 7f7184be4700 1 --2- 172.21.15.102:0/835143857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7180156d70 0x7f7180151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.149+0000 7f7184be4700 1 --2- 172.21.15.102:0/835143857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71800b2770 0x7f71800a5e10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.149+0000 7f7184be4700 1 -- 172.21.15.102:0/835143857 >> 172.21.15.102:0/835143857 conn(0x7f718006e170 msgr2=0x7f7180153750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.149+0000 7f7184be4700 1 -- 172.21.15.102:0/835143857 shutdown_connections 2024-08-17T02:29:08.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.149+0000 7f7184be4700 1 -- 172.21.15.102:0/835143857 wait complete. 2024-08-17T02:29:08.162 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:08.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.261+0000 7f1ca359e700 1 Processor -- start 2024-08-17T02:29:08.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.261+0000 7f1ca359e700 1 -- start start 2024-08-17T02:29:08.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca359e700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1ca406e620 0x7f1ca40ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca359e700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca40af2b0 con 0x7f1ca40b0350 2024-08-17T02:29:08.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca359e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca40af590 con 0x7f1ca4155d20 2024-08-17T02:29:08.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca359e700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca40b07a0 con 0x7f1ca406e620 2024-08-17T02:29:08.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca2d9d700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1ca406e620 0x7f1ca40ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca1d9b700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1ca40b0350 0x7f1ca406df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:54994/0 (socket says 172.21.15.102:54994) 2024-08-17T02:29:08.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca1d9b700 1 -- 172.21.15.102:0/2766967988 learned_addr learned my addr 172.21.15.102:0/2766967988 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:08.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca159a700 1 -- 172.21.15.102:0/2766967988 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178812910 0 0) 0x7f1ca40af2b0 con 0x7f1ca40b0350 2024-08-17T02:29:08.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca159a700 1 -- 172.21.15.102:0/2766967988 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c90003570 con 0x7f1ca40b0350 2024-08-17T02:29:08.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca159a700 1 -- 172.21.15.102:0/2766967988 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1049917646 0 0) 0x7f1c90003570 con 0x7f1ca40b0350 2024-08-17T02:29:08.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca2d9d700 1 -- 172.21.15.102:0/2766967988 >> v1:172.21.15.121:6789/0 conn(0x7f1ca4155d20 legacy=0x7f1ca40aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca2d9d700 1 -- 172.21.15.102:0/2766967988 >> v1:172.21.15.102:6789/0 conn(0x7f1ca40b0350 legacy=0x7f1ca406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca2d9d700 1 -- 172.21.15.102:0/2766967988 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca40af870 con 0x7f1ca406e620 2024-08-17T02:29:08.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca2d9d700 1 --2- 172.21.15.102:0/2766967988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ca406e620 0x7f1ca40ad7c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0098e0 tx=0x7f1c9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e989094ca165ab2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca159a700 1 -- 172.21.15.102:0/2766967988 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c0017f0 con 0x7f1ca406e620 2024-08-17T02:29:08.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca159a700 1 -- 172.21.15.102:0/2766967988 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c011420 con 0x7f1ca406e620 2024-08-17T02:29:08.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca159a700 1 -- 172.21.15.102:0/2766967988 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c0117c0 con 0x7f1ca406e620 2024-08-17T02:29:08.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca359e700 1 -- 172.21.15.102:0/2766967988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ca406e620 msgr2=0x7f1ca40ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca359e700 1 --2- 172.21.15.102:0/2766967988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ca406e620 0x7f1ca40ad7c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0098e0 tx=0x7f1c9c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca359e700 1 -- 172.21.15.102:0/2766967988 shutdown_connections 2024-08-17T02:29:08.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca359e700 1 --2- 172.21.15.102:0/2766967988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ca406e620 0x7f1ca40ad7c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca359e700 1 -- 172.21.15.102:0/2766967988 >> 172.21.15.102:0/2766967988 conn(0x7f1ca40678d0 msgr2=0x7f1ca4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca359e700 1 -- 172.21.15.102:0/2766967988 shutdown_connections 2024-08-17T02:29:08.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.265+0000 7f1ca359e700 1 -- 172.21.15.102:0/2766967988 wait complete. 2024-08-17T02:29:08.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca359e700 1 Processor -- start 2024-08-17T02:29:08.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca359e700 1 -- start start 2024-08-17T02:29:08.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca359e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ca406e620 0x7f1ca4141400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca359e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ca40b0350 0x7f1ca41403e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca359e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ca4155d20 0x7f1ca414f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca359e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca413bd10 con 0x7f1ca40b0350 2024-08-17T02:29:08.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca359e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca4155570 con 0x7f1ca406e620 2024-08-17T02:29:08.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca359e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca413b090 con 0x7f1ca4155d20 2024-08-17T02:29:08.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca1d9b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ca40b0350 0x7f1ca41403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca1d9b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ca40b0350 0x7f1ca41403e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33390/0 (socket says 172.21.15.102:33390) 2024-08-17T02:29:08.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca1d9b700 1 -- 172.21.15.102:0/115237296 learned_addr learned my addr 172.21.15.102:0/115237296 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:08.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca2d9d700 1 --2- 172.21.15.102:0/115237296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ca4155d20 0x7f1ca414f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca259c700 1 --2- 172.21.15.102:0/115237296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ca406e620 0x7f1ca4141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca1d9b700 1 -- 172.21.15.102:0/115237296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ca4155d20 msgr2=0x7f1ca414f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca1d9b700 1 --2- 172.21.15.102:0/115237296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ca4155d20 0x7f1ca414f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca1d9b700 1 -- 172.21.15.102:0/115237296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ca406e620 msgr2=0x7f1ca4141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca1d9b700 1 --2- 172.21.15.102:0/115237296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ca406e620 0x7f1ca4141400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca1d9b700 1 -- 172.21.15.102:0/115237296 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c009420 con 0x7f1ca40b0350 2024-08-17T02:29:08.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca1d9b700 1 --2- 172.21.15.102:0/115237296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ca40b0350 0x7f1ca41403e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00ccf0 tx=0x7f1c8c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1c9a7fc700 1 -- 172.21.15.102:0/115237296 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c004dc0 con 0x7f1ca40b0350 2024-08-17T02:29:08.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1c9a7fc700 1 -- 172.21.15.102:0/115237296 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8c00a660 con 0x7f1ca40b0350 2024-08-17T02:29:08.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca359e700 1 -- 172.21.15.102:0/115237296 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca413b370 con 0x7f1ca40b0350 2024-08-17T02:29:08.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1c9a7fc700 1 -- 172.21.15.102:0/115237296 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c00aa20 con 0x7f1ca40b0350 2024-08-17T02:29:08.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.269+0000 7f1ca359e700 1 -- 172.21.15.102:0/115237296 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca413b930 con 0x7f1ca40b0350 2024-08-17T02:29:08.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.273+0000 7f1ca359e700 1 -- 172.21.15.102:0/115237296 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca413be50 con 0x7f1ca40b0350 2024-08-17T02:29:08.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.273+0000 7f1c9a7fc700 1 -- 172.21.15.102:0/115237296 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1c8c007150 con 0x7f1ca40b0350 2024-08-17T02:29:08.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.273+0000 7f1c9a7fc700 1 --2- 172.21.15.102:0/115237296 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1c84060860 0x7f1c84062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.273+0000 7f1c9a7fc700 1 -- 172.21.15.102:0/115237296 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f1c8c07c590 con 0x7f1ca40b0350 2024-08-17T02:29:08.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.273+0000 7f1ca259c700 1 --2- 172.21.15.102:0/115237296 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1c84060860 0x7f1c84062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.273+0000 7f1ca259c700 1 --2- 172.21.15.102:0/115237296 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1c84060860 0x7f1c84062d10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1c94003a80 tx=0x7f1c94007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.281+0000 7f1c9a7fc700 1 -- 172.21.15.102:0/115237296 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1ca413be50 con 0x7f1ca40b0350 2024-08-17T02:29:08.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.477+0000 7f1ca359e700 1 -- 172.21.15.102:0/115237296 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ca413be50 con 0x7f1ca40b0350 2024-08-17T02:29:08.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.481+0000 7f1c9a7fc700 1 -- 172.21.15.102:0/115237296 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4626 (secure 0 0 0) 0x7f1ca413be50 con 0x7f1ca40b0350 2024-08-17T02:29:08.483 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:08.483 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3728405798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3728405798},{"type":"v1","addr":"172.21.15.102:6835","nonce":3728405798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2759836087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2759836087},{"type":"v1","addr":"172.21.15.121:6833","nonce":2759836087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5337,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/3310056391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":3310056391},{"type":"v1","addr":"172.21.15.102:6837","nonce":3310056391}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:57.316251+0000","modified":"2024-08-17T02:26:58.534785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4676":{"gid":4676,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6835/2189006578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2189006578},{"type":"v1","addr":"172.21.15.121:6835","nonce":2189006578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000658238","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:08.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.481+0000 7f1ca359e700 1 -- 172.21.15.102:0/115237296 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1c84060860 msgr2=0x7f1c84062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.481+0000 7f1ca359e700 1 --2- 172.21.15.102:0/115237296 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1c84060860 0x7f1c84062d10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1c94003a80 tx=0x7f1c94007ec0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.481+0000 7f1ca359e700 1 -- 172.21.15.102:0/115237296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ca40b0350 msgr2=0x7f1ca41403e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.481+0000 7f1ca359e700 1 --2- 172.21.15.102:0/115237296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ca40b0350 0x7f1ca41403e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00ccf0 tx=0x7f1c8c001670 comp rx=0 tx=0).stop 2024-08-17T02:29:08.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.481+0000 7f1ca359e700 1 -- 172.21.15.102:0/115237296 shutdown_connections 2024-08-17T02:29:08.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.481+0000 7f1ca359e700 1 --2- 172.21.15.102:0/115237296 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1c84060860 0x7f1c84062d10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.481+0000 7f1ca359e700 1 --2- 172.21.15.102:0/115237296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ca40b0350 0x7f1ca41403e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.481+0000 7f1ca359e700 1 --2- 172.21.15.102:0/115237296 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1ca4155d20 0x7f1ca414f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.481+0000 7f1ca359e700 1 --2- 172.21.15.102:0/115237296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ca406e620 0x7f1ca4141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.481+0000 7f1ca359e700 1 -- 172.21.15.102:0/115237296 >> 172.21.15.102:0/115237296 conn(0x7f1ca40678d0 msgr2=0x7f1ca4147f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.481+0000 7f1ca359e700 1 -- 172.21.15.102:0/115237296 shutdown_connections 2024-08-17T02:29:08.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.481+0000 7f1ca359e700 1 -- 172.21.15.102:0/115237296 wait complete. 2024-08-17T02:29:08.486 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 19 2024-08-17T02:29:08.497 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:08.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f21948f6700 1 Processor -- start 2024-08-17T02:29:08.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f21948f6700 1 -- start start 2024-08-17T02:29:08.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f21948f6700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f21900b0d20 0x7f219006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f21948f6700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f21900b1800 0x7f2190141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f21948f6700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2190141a00 con 0x7f219006e450 2024-08-17T02:29:08.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f21948f6700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f219006e8a0 con 0x7f21900b0d20 2024-08-17T02:29:08.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f21948f6700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2190140b10 con 0x7f21900b1800 2024-08-17T02:29:08.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f2186ffd700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f219006e450 0x7f21900b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55002/0 (socket says 172.21.15.102:55002) 2024-08-17T02:29:08.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f2186ffd700 1 -- 172.21.15.102:0/110820852 learned_addr learned my addr 172.21.15.102:0/110820852 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:08.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218f7fe700 1 --2- 172.21.15.102:0/110820852 >> v2:172.21.15.102:3300/0 conn(0x7f21900b0d20 0x7f219006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 -- 172.21.15.102:0/110820852 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280966152 0 0) 0x7f2190141a00 con 0x7f219006e450 2024-08-17T02:29:08.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 -- 172.21.15.102:0/110820852 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f217c003570 con 0x7f219006e450 2024-08-17T02:29:08.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218ffff700 1 --2- 172.21.15.102:0/110820852 >> v2:172.21.15.121:3300/0 conn(0x7f21900b1800 0x7f2190141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 -- 172.21.15.102:0/110820852 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3680832210 0 0) 0x7f217c003570 con 0x7f219006e450 2024-08-17T02:29:08.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 -- 172.21.15.102:0/110820852 >> v2:172.21.15.121:3300/0 conn(0x7f21900b1800 msgr2=0x7f2190141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:08.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 --2- 172.21.15.102:0/110820852 >> v2:172.21.15.121:3300/0 conn(0x7f21900b1800 0x7f2190141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 -- 172.21.15.102:0/110820852 >> v2:172.21.15.102:3300/0 conn(0x7f21900b0d20 msgr2=0x7f219006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:08.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 --2- 172.21.15.102:0/110820852 >> v2:172.21.15.102:3300/0 conn(0x7f21900b0d20 0x7f219006df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 -- 172.21.15.102:0/110820852 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2190140df0 con 0x7f219006e450 2024-08-17T02:29:08.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 -- 172.21.15.102:0/110820852 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7f2178001470 con 0x7f219006e450 2024-08-17T02:29:08.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218f7fe700 1 --2- 172.21.15.102:0/110820852 >> v2:172.21.15.102:3300/0 conn(0x7f21900b0d20 0x7f219006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:08.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 -- 172.21.15.102:0/110820852 >> v1:172.21.15.102:6789/0 conn(0x7f219006e450 legacy=0x7f21900b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 --2- 172.21.15.102:0/110820852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f217c003a60 0x7f217c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 --2- 172.21.15.102:0/110820852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f217c004810 0x7f217c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 --2- 172.21.15.102:0/110820852 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f217c0051c0 0x7f217c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 -- 172.21.15.102:0/110820852 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219006e8a0 con 0x7f217c004810 2024-08-17T02:29:08.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 -- 172.21.15.102:0/110820852 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190140b10 con 0x7f217c003a60 2024-08-17T02:29:08.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 -- 172.21.15.102:0/110820852 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217c00c080 con 0x7f217c0051c0 2024-08-17T02:29:08.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218f7fe700 1 --2- 172.21.15.102:0/110820852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f217c003a60 0x7f217c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f2186ffd700 1 --2- 172.21.15.102:0/110820852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f217c004810 0x7f217c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218ffff700 1 --2- 172.21.15.102:0/110820852 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f217c0051c0 0x7f217c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f2186ffd700 1 -- 172.21.15.102:0/110820852 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f217c0051c0 msgr2=0x7f217c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:08.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f2186ffd700 1 --2- 172.21.15.102:0/110820852 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f217c0051c0 0x7f217c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f2186ffd700 1 -- 172.21.15.102:0/110820852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f217c003a60 msgr2=0x7f217c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:08.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f2186ffd700 1 --2- 172.21.15.102:0/110820852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f217c003a60 0x7f217c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218ffff700 1 -- 172.21.15.102:0/110820852 reap_dead start 2024-08-17T02:29:08.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f2186ffd700 1 -- 172.21.15.102:0/110820852 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c003570 con 0x7f217c004810 2024-08-17T02:29:08.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218f7fe700 1 --2- 172.21.15.102:0/110820852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f217c003a60 0x7f217c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:08.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f2186ffd700 1 --2- 172.21.15.102:0/110820852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f217c004810 0x7f217c004c80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f217800c390 tx=0x7f2178001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd91f34efbeec7b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 -- 172.21.15.102:0/110820852 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217800cbe0 con 0x7f217c004810 2024-08-17T02:29:08.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 -- 172.21.15.102:0/110820852 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217800cd80 con 0x7f217c004810 2024-08-17T02:29:08.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.605+0000 7f218effd700 1 -- 172.21.15.102:0/110820852 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2178005b70 con 0x7f217c004810 2024-08-17T02:29:08.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f21948f6700 1 -- 172.21.15.102:0/110820852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f217c004810 msgr2=0x7f217c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f21948f6700 1 --2- 172.21.15.102:0/110820852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f217c004810 0x7f217c004c80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f217800c390 tx=0x7f2178001e90 comp rx=0 tx=0).stop 2024-08-17T02:29:08.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f21948f6700 1 -- 172.21.15.102:0/110820852 shutdown_connections 2024-08-17T02:29:08.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f21948f6700 1 --2- 172.21.15.102:0/110820852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f217c004810 0x7f217c004c80 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f21948f6700 1 -- 172.21.15.102:0/110820852 >> 172.21.15.102:0/110820852 conn(0x7f21900678d0 msgr2=0x7f2190067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f21948f6700 1 -- 172.21.15.102:0/110820852 shutdown_connections 2024-08-17T02:29:08.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f21948f6700 1 -- 172.21.15.102:0/110820852 wait complete. 2024-08-17T02:29:08.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f21948f6700 1 Processor -- start 2024-08-17T02:29:08.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f21948f6700 1 -- start start 2024-08-17T02:29:08.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f21948f6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f217c004810 0x7f219015af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f21948f6700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2190145cb0 0x7f2190146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f21948f6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21900a68c0 0x7f21900a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f21948f6700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2190146660 con 0x7f21900a68c0 2024-08-17T02:29:08.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f21948f6700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219016daa0 con 0x7f217c004810 2024-08-17T02:29:08.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f21948f6700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21900a7630 con 0x7f2190145cb0 2024-08-17T02:29:08.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f218ffff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21900a68c0 0x7f21900a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f218ffff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21900a68c0 0x7f21900a6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33412/0 (socket says 172.21.15.102:33412) 2024-08-17T02:29:08.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f218ffff700 1 -- 172.21.15.102:0/54406222 learned_addr learned my addr 172.21.15.102:0/54406222 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:08.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f218f7fe700 1 --2- 172.21.15.102:0/54406222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f217c004810 0x7f219015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.609+0000 7f2186ffd700 1 --2- 172.21.15.102:0/54406222 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2190145cb0 0x7f2190146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f218ffff700 1 -- 172.21.15.102:0/54406222 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2190145cb0 msgr2=0x7f2190146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f218ffff700 1 --2- 172.21.15.102:0/54406222 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2190145cb0 0x7f2190146120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f218ffff700 1 -- 172.21.15.102:0/54406222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f217c004810 msgr2=0x7f219015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f218ffff700 1 --2- 172.21.15.102:0/54406222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f217c004810 0x7f219015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f218ffff700 1 -- 172.21.15.102:0/54406222 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21900a7910 con 0x7f21900a68c0 2024-08-17T02:29:08.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f2186ffd700 1 --2- 172.21.15.102:0/54406222 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2190145cb0 0x7f2190146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:08.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f218ffff700 1 --2- 172.21.15.102:0/54406222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21900a68c0 0x7f21900a6d30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f219006c980 tx=0x7f2188009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f2187fff700 1 -- 172.21.15.102:0/54406222 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188009b10 con 0x7f21900a68c0 2024-08-17T02:29:08.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f2187fff700 1 -- 172.21.15.102:0/54406222 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2188002c80 con 0x7f21900a68c0 2024-08-17T02:29:08.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f21948f6700 1 -- 172.21.15.102:0/54406222 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21900a7bf0 con 0x7f21900a68c0 2024-08-17T02:29:08.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f2187fff700 1 -- 172.21.15.102:0/54406222 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188015420 con 0x7f21900a68c0 2024-08-17T02:29:08.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f21948f6700 1 -- 172.21.15.102:0/54406222 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21900a7270 con 0x7f21900a68c0 2024-08-17T02:29:08.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f21948f6700 1 -- 172.21.15.102:0/54406222 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21900643a0 con 0x7f21900a68c0 2024-08-17T02:29:08.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f2187fff700 1 -- 172.21.15.102:0/54406222 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2188003040 con 0x7f21900a68c0 2024-08-17T02:29:08.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f2187fff700 1 --2- 172.21.15.102:0/54406222 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2170060860 0x7f2170062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f2187fff700 1 -- 172.21.15.102:0/54406222 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f218807d3a0 con 0x7f21900a68c0 2024-08-17T02:29:08.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f218f7fe700 1 --2- 172.21.15.102:0/54406222 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2170060860 0x7f2170062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.613+0000 7f218f7fe700 1 --2- 172.21.15.102:0/54406222 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2170060860 0x7f2170062d10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2180009910 tx=0x7f21800091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.621+0000 7f2187fff700 1 -- 172.21.15.102:0/54406222 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f218804d770 con 0x7f21900a68c0 2024-08-17T02:29:08.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.781+0000 7f21948f6700 1 -- 172.21.15.102:0/54406222 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f219016dbe0 con 0x7f21900a68c0 2024-08-17T02:29:08.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.785+0000 7f2187fff700 1 -- 172.21.15.102:0/54406222 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15562 (secure 0 0 0) 0x7f2188050d90 con 0x7f21900a68c0 2024-08-17T02:29:08.787 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:08.787 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":39,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:29:06.893617+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000658238.meta","create_time":"2024-08-17T02:26:55.316074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000658238"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000658238.data","create_time":"2024-08-17T02:26:56.329435+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000658238"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:6837/1340437033":"2024-08-18T02:29:03.879648+0000","172.21.15.102:6836/1340437033":"2024-08-18T02:29:03.879648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:08.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.785+0000 7f21948f6700 1 -- 172.21.15.102:0/54406222 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2170060860 msgr2=0x7f2170062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.785+0000 7f21948f6700 1 --2- 172.21.15.102:0/54406222 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2170060860 0x7f2170062d10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2180009910 tx=0x7f21800091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.785+0000 7f21948f6700 1 -- 172.21.15.102:0/54406222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21900a68c0 msgr2=0x7f21900a6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.785+0000 7f21948f6700 1 --2- 172.21.15.102:0/54406222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21900a68c0 0x7f21900a6d30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f219006c980 tx=0x7f2188009710 comp rx=0 tx=0).stop 2024-08-17T02:29:08.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.785+0000 7f21948f6700 1 -- 172.21.15.102:0/54406222 shutdown_connections 2024-08-17T02:29:08.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.785+0000 7f21948f6700 1 --2- 172.21.15.102:0/54406222 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2170060860 0x7f2170062d10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.785+0000 7f21948f6700 1 --2- 172.21.15.102:0/54406222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21900a68c0 0x7f21900a6d30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.785+0000 7f21948f6700 1 --2- 172.21.15.102:0/54406222 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f2190145cb0 0x7f2190146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.785+0000 7f21948f6700 1 --2- 172.21.15.102:0/54406222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f217c004810 0x7f219015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.785+0000 7f21948f6700 1 -- 172.21.15.102:0/54406222 >> 172.21.15.102:0/54406222 conn(0x7f21900678d0 msgr2=0x7f219015dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.785+0000 7f21948f6700 1 -- 172.21.15.102:0/54406222 shutdown_connections 2024-08-17T02:29:08.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.785+0000 7f21948f6700 1 -- 172.21.15.102:0/54406222 wait complete. 2024-08-17T02:29:08.801 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000658238 and related pools 2024-08-17T02:29:08.802 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:08.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.905+0000 7f5f451e8700 1 Processor -- start 2024-08-17T02:29:08.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.905+0000 7f5f451e8700 1 -- start start 2024-08-17T02:29:08.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f451e8700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5f400cc2e0 0x7f5f400b3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f451e8700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f400ce120 con 0x7f5f400cea40 2024-08-17T02:29:08.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f451e8700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f400ce390 con 0x7f5f40159810 2024-08-17T02:29:08.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f451e8700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f400c5c60 con 0x7f5f400cc2e0 2024-08-17T02:29:08.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f3f59e700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f5f400cea40 0x7f5f400c6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55018/0 (socket says 172.21.15.102:55018) 2024-08-17T02:29:08.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f3659c700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5f400cc2e0 0x7f5f400b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f3f59e700 1 -- 172.21.15.102:0/1322787882 learned_addr learned my addr 172.21.15.102:0/1322787882 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:08.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f3e59c700 1 -- 172.21.15.102:0/1322787882 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090701609 0 0) 0x7f5f400ce390 con 0x7f5f40159810 2024-08-17T02:29:08.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f3e59c700 1 -- 172.21.15.102:0/1322787882 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f2c003570 con 0x7f5f40159810 2024-08-17T02:29:08.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f3e59c700 1 -- 172.21.15.102:0/1322787882 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618050793 0 0) 0x7f5f400ce120 con 0x7f5f400cea40 2024-08-17T02:29:08.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f3659c700 1 -- 172.21.15.102:0/1322787882 >> v1:172.21.15.121:6789/0 conn(0x7f5f40159810 legacy=0x7f5f400d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f3659c700 1 -- 172.21.15.102:0/1322787882 >> v1:172.21.15.102:6789/0 conn(0x7f5f400cea40 legacy=0x7f5f400c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f3659c700 1 -- 172.21.15.102:0/1322787882 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f400ce670 con 0x7f5f400cc2e0 2024-08-17T02:29:08.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f3659c700 1 --2- 172.21.15.102:0/1322787882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f400cc2e0 0x7f5f400b3270 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5f300098e0 tx=0x7f5f300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0435073e5ba324 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f3e59c700 1 -- 172.21.15.102:0/1322787882 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3000b640 con 0x7f5f400cc2e0 2024-08-17T02:29:08.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f3e59c700 1 -- 172.21.15.102:0/1322787882 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3000b7a0 con 0x7f5f400cc2e0 2024-08-17T02:29:08.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f3e59c700 1 -- 172.21.15.102:0/1322787882 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3000bb40 con 0x7f5f400cc2e0 2024-08-17T02:29:08.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f451e8700 1 -- 172.21.15.102:0/1322787882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f400cc2e0 msgr2=0x7f5f400b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f451e8700 1 --2- 172.21.15.102:0/1322787882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f400cc2e0 0x7f5f400b3270 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5f300098e0 tx=0x7f5f300091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f451e8700 1 -- 172.21.15.102:0/1322787882 shutdown_connections 2024-08-17T02:29:08.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f451e8700 1 --2- 172.21.15.102:0/1322787882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f400cc2e0 0x7f5f400b3270 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f451e8700 1 -- 172.21.15.102:0/1322787882 >> 172.21.15.102:0/1322787882 conn(0x7f5f40067590 msgr2=0x7f5f400d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f451e8700 1 -- 172.21.15.102:0/1322787882 shutdown_connections 2024-08-17T02:29:08.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.909+0000 7f5f451e8700 1 -- 172.21.15.102:0/1322787882 wait complete. 2024-08-17T02:29:08.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f451e8700 1 Processor -- start 2024-08-17T02:29:08.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f451e8700 1 -- start start 2024-08-17T02:29:08.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f451e8700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f400cc2e0 0x7f5f4009a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f451e8700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f400cea40 0x7f5f40154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f451e8700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f40159810 0x7f5f4009d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f451e8700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400c7560 con 0x7f5f400cea40 2024-08-17T02:29:08.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f451e8700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400cab40 con 0x7f5f40159810 2024-08-17T02:29:08.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f451e8700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4009a860 con 0x7f5f400cc2e0 2024-08-17T02:29:08.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f3659c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f400cea40 0x7f5f40154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f3659c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f400cea40 0x7f5f40154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33438/0 (socket says 172.21.15.102:33438) 2024-08-17T02:29:08.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f3659c700 1 -- 172.21.15.102:0/3140989161 learned_addr learned my addr 172.21.15.102:0/3140989161 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:08.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f3ed9d700 1 --2- 172.21.15.102:0/3140989161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f400cc2e0 0x7f5f4009a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f3f59e700 1 --2- 172.21.15.102:0/3140989161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f40159810 0x7f5f4009d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f3659c700 1 -- 172.21.15.102:0/3140989161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f400cc2e0 msgr2=0x7f5f4009a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f3659c700 1 --2- 172.21.15.102:0/3140989161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f400cc2e0 0x7f5f4009a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f3659c700 1 -- 172.21.15.102:0/3140989161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f40159810 msgr2=0x7f5f4009d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f3659c700 1 --2- 172.21.15.102:0/3140989161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f40159810 0x7f5f4009d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f3659c700 1 -- 172.21.15.102:0/3140989161 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f30009420 con 0x7f5f400cea40 2024-08-17T02:29:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f3ed9d700 1 --2- 172.21.15.102:0/3140989161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f400cc2e0 0x7f5f4009a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f3659c700 1 --2- 172.21.15.102:0/3140989161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f400cea40 0x7f5f40154960 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5f40070d10 tx=0x7f5f30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f377fe700 1 -- 172.21.15.102:0/3140989161 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3001f070 con 0x7f5f400cea40 2024-08-17T02:29:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f451e8700 1 -- 172.21.15.102:0/3140989161 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4009ab40 con 0x7f5f400cea40 2024-08-17T02:29:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f451e8700 1 -- 172.21.15.102:0/3140989161 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4009b100 con 0x7f5f400cea40 2024-08-17T02:29:08.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f377fe700 1 -- 172.21.15.102:0/3140989161 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3000bb20 con 0x7f5f400cea40 2024-08-17T02:29:08.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.913+0000 7f5f377fe700 1 -- 172.21.15.102:0/3140989161 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30011650 con 0x7f5f400cea40 2024-08-17T02:29:08.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.917+0000 7f5f451e8700 1 -- 172.21.15.102:0/3140989161 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f400c7710 con 0x7f5f400cea40 2024-08-17T02:29:08.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.917+0000 7f5f377fe700 1 -- 172.21.15.102:0/3140989161 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5f30011a40 con 0x7f5f400cea40 2024-08-17T02:29:08.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.917+0000 7f5f377fe700 1 --2- 172.21.15.102:0/3140989161 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5f20060860 0x7f5f20062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.917+0000 7f5f377fe700 1 -- 172.21.15.102:0/3140989161 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f5f3007e0e0 con 0x7f5f400cea40 2024-08-17T02:29:08.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.917+0000 7f5f3ed9d700 1 --2- 172.21.15.102:0/3140989161 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5f20060860 0x7f5f20062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.917+0000 7f5f3ed9d700 1 --2- 172.21.15.102:0/3140989161 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5f20060860 0x7f5f20062d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5f280038f0 tx=0x7f5f28009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:08.925+0000 7f5f377fe700 1 -- 172.21.15.102:0/3140989161 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5f400c7710 con 0x7f5f400cea40 2024-08-17T02:29:09.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.125+0000 7f5f451e8700 1 -- 172.21.15.102:0/3140989161 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f400645c0 con 0x7f5f400cea40 2024-08-17T02:29:09.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.129+0000 7f5f377fe700 1 -- 172.21.15.102:0/3140989161 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4626 (secure 0 0 0) 0x7f5f3004e4b0 con 0x7f5f400cea40 2024-08-17T02:29:09.130 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:09.130 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3728405798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3728405798},{"type":"v1","addr":"172.21.15.102:6835","nonce":3728405798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2759836087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2759836087},{"type":"v1","addr":"172.21.15.121:6833","nonce":2759836087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5337,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/3310056391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":3310056391},{"type":"v1","addr":"172.21.15.102:6837","nonce":3310056391}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:57.316251+0000","modified":"2024-08-17T02:26:58.534785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4676":{"gid":4676,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6835/2189006578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2189006578},{"type":"v1","addr":"172.21.15.121:6835","nonce":2189006578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000658238","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:09.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.129+0000 7f5f451e8700 1 -- 172.21.15.102:0/3140989161 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5f20060860 msgr2=0x7f5f20062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.129+0000 7f5f451e8700 1 --2- 172.21.15.102:0/3140989161 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5f20060860 0x7f5f20062d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5f280038f0 tx=0x7f5f28009040 comp rx=0 tx=0).stop 2024-08-17T02:29:09.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.129+0000 7f5f451e8700 1 -- 172.21.15.102:0/3140989161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f400cea40 msgr2=0x7f5f40154960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.129+0000 7f5f451e8700 1 --2- 172.21.15.102:0/3140989161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f400cea40 0x7f5f40154960 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5f40070d10 tx=0x7f5f30017000 comp rx=0 tx=0).stop 2024-08-17T02:29:09.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.129+0000 7f5f451e8700 1 -- 172.21.15.102:0/3140989161 shutdown_connections 2024-08-17T02:29:09.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.129+0000 7f5f451e8700 1 --2- 172.21.15.102:0/3140989161 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f5f20060860 0x7f5f20062d10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.129+0000 7f5f451e8700 1 --2- 172.21.15.102:0/3140989161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f400cea40 0x7f5f40154960 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.129+0000 7f5f451e8700 1 --2- 172.21.15.102:0/3140989161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f40159810 0x7f5f4009d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.129+0000 7f5f451e8700 1 --2- 172.21.15.102:0/3140989161 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f5f400cc2e0 0x7f5f4009a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.129+0000 7f5f451e8700 1 -- 172.21.15.102:0/3140989161 >> 172.21.15.102:0/3140989161 conn(0x7f5f40067590 msgr2=0x7f5f40069cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:09.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.129+0000 7f5f451e8700 1 -- 172.21.15.102:0/3140989161 shutdown_connections 2024-08-17T02:29:09.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.129+0000 7f5f451e8700 1 -- 172.21.15.102:0/3140989161 wait complete. 2024-08-17T02:29:09.134 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 19 2024-08-17T02:29:09.144 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:09.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f25a53a6700 1 Processor -- start 2024-08-17T02:29:09.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f25a53a6700 1 -- start start 2024-08-17T02:29:09.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f25a53a6700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25a00cd1b0 0x7f25a01536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f25a53a6700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f25a015a190 0x7f25a015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f25a53a6700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a015a5f0 con 0x7f25a0153320 2024-08-17T02:29:09.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f25a53a6700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a00ce430 con 0x7f25a015a190 2024-08-17T02:29:09.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f25a53a6700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a015dbd0 con 0x7f25a00cd1b0 2024-08-17T02:29:09.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259ffff700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f25a0153320 0x7f25a00ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55024/0 (socket says 172.21.15.102:55024) 2024-08-17T02:29:09.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259ffff700 1 -- 172.21.15.102:0/2482061382 learned_addr learned my addr 172.21.15.102:0/2482061382 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:09.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259f7fe700 1 --2- 172.21.15.102:0/2482061382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25a00cd1b0 0x7f25a01536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f25a4ba5700 1 --2- 172.21.15.102:0/2482061382 >> v2:172.21.15.121:3300/0 conn(0x7f25a015a190 0x7f25a015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259effd700 1 -- 172.21.15.102:0/2482061382 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347927392 0 0) 0x7f25a015a5f0 con 0x7f25a0153320 2024-08-17T02:29:09.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259effd700 1 -- 172.21.15.102:0/2482061382 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f258c003570 con 0x7f25a0153320 2024-08-17T02:29:09.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259effd700 1 -- 172.21.15.102:0/2482061382 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 449677312 0 0) 0x7f258c003570 con 0x7f25a0153320 2024-08-17T02:29:09.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259effd700 1 -- 172.21.15.102:0/2482061382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25a00cd1b0 msgr2=0x7f25a01536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:09.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259effd700 1 --2- 172.21.15.102:0/2482061382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25a00cd1b0 0x7f25a01536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259effd700 1 -- 172.21.15.102:0/2482061382 >> v2:172.21.15.121:3300/0 conn(0x7f25a015a190 msgr2=0x7f25a015cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:09.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259effd700 1 --2- 172.21.15.102:0/2482061382 >> v2:172.21.15.121:3300/0 conn(0x7f25a015a190 0x7f25a015cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259effd700 1 -- 172.21.15.102:0/2482061382 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a015d370 con 0x7f25a0153320 2024-08-17T02:29:09.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259effd700 1 -- 172.21.15.102:0/2482061382 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7f25900017f0 con 0x7f25a0153320 2024-08-17T02:29:09.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259effd700 1 -- 172.21.15.102:0/2482061382 >> v1:172.21.15.102:6789/0 conn(0x7f25a0153320 legacy=0x7f25a00ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259effd700 1 --2- 172.21.15.102:0/2482061382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f258c003a60 0x7f258c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259effd700 1 --2- 172.21.15.102:0/2482061382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f258c004810 0x7f258c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259effd700 1 --2- 172.21.15.102:0/2482061382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25a00cd1b0 0x7f258c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259effd700 1 -- 172.21.15.102:0/2482061382 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a00ce430 con 0x7f258c004810 2024-08-17T02:29:09.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259effd700 1 -- 172.21.15.102:0/2482061382 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a015dbd0 con 0x7f258c003a60 2024-08-17T02:29:09.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259effd700 1 -- 172.21.15.102:0/2482061382 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258c00ba60 con 0x7f25a00cd1b0 2024-08-17T02:29:09.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259f7fe700 1 --2- 172.21.15.102:0/2482061382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f258c004810 0x7f258c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f25a4ba5700 1 --2- 172.21.15.102:0/2482061382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25a00cd1b0 0x7f258c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.245+0000 7f259ffff700 1 --2- 172.21.15.102:0/2482061382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f258c003a60 0x7f258c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f259f7fe700 1 -- 172.21.15.102:0/2482061382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25a00cd1b0 msgr2=0x7f258c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:09.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f259f7fe700 1 --2- 172.21.15.102:0/2482061382 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f25a00cd1b0 0x7f258c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f259f7fe700 1 -- 172.21.15.102:0/2482061382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f258c003a60 msgr2=0x7f258c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:09.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f259f7fe700 1 --2- 172.21.15.102:0/2482061382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f258c003a60 0x7f258c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f259f7fe700 1 -- 172.21.15.102:0/2482061382 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c003570 con 0x7f258c004810 2024-08-17T02:29:09.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f259ffff700 1 --2- 172.21.15.102:0/2482061382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f258c003a60 0x7f258c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:09.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f259f7fe700 1 --2- 172.21.15.102:0/2482061382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f258c004810 0x7f258c004c80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2588009c30 tx=0x7f25880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942a9d5122d44ff0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f259effd700 1 -- 172.21.15.102:0/2482061382 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258800e710 con 0x7f258c004810 2024-08-17T02:29:09.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f259effd700 1 -- 172.21.15.102:0/2482061382 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258800e870 con 0x7f258c004810 2024-08-17T02:29:09.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f259effd700 1 -- 172.21.15.102:0/2482061382 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258800ec30 con 0x7f258c004810 2024-08-17T02:29:09.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f25a53a6700 1 -- 172.21.15.102:0/2482061382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f258c004810 msgr2=0x7f258c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f25a53a6700 1 --2- 172.21.15.102:0/2482061382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f258c004810 0x7f258c004c80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2588009c30 tx=0x7f25880091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f25a4ba5700 1 -- 172.21.15.102:0/2482061382 reap_dead start 2024-08-17T02:29:09.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f25a53a6700 1 -- 172.21.15.102:0/2482061382 shutdown_connections 2024-08-17T02:29:09.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f25a53a6700 1 -- 172.21.15.102:0/2482061382 >> 172.21.15.102:0/2482061382 conn(0x7f25a00d00a0 msgr2=0x7f25a00d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:09.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f25a53a6700 1 -- 172.21.15.102:0/2482061382 shutdown_connections 2024-08-17T02:29:09.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.249+0000 7f25a53a6700 1 -- 172.21.15.102:0/2482061382 wait complete. 2024-08-17T02:29:09.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f25a53a6700 1 Processor -- start 2024-08-17T02:29:09.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f25a53a6700 1 -- start start 2024-08-17T02:29:09.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f25a53a6700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f258c004810 0x7f25a00c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f25a53a6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25a00b4080 0x7f25a0142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f25a53a6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25a00d04a0 0x7f25a00d0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f25a53a6700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a00d0e50 con 0x7f25a00b4080 2024-08-17T02:29:09.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f25a53a6700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a00ca120 con 0x7f25a00d04a0 2024-08-17T02:29:09.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f25a53a6700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a00c7690 con 0x7f258c004810 2024-08-17T02:29:09.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f259f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25a00b4080 0x7f25a0142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f259f7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25a00b4080 0x7f25a0142a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33446/0 (socket says 172.21.15.102:33446) 2024-08-17T02:29:09.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f259f7fe700 1 -- 172.21.15.102:0/4122910088 learned_addr learned my addr 172.21.15.102:0/4122910088 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:09.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f259ffff700 1 --2- 172.21.15.102:0/4122910088 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f258c004810 0x7f25a00c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f25a4ba5700 1 --2- 172.21.15.102:0/4122910088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25a00d04a0 0x7f25a00d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f259f7fe700 1 -- 172.21.15.102:0/4122910088 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f258c004810 msgr2=0x7f25a00c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f259f7fe700 1 --2- 172.21.15.102:0/4122910088 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f258c004810 0x7f25a00c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f259f7fe700 1 -- 172.21.15.102:0/4122910088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25a00d04a0 msgr2=0x7f25a00d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f259f7fe700 1 --2- 172.21.15.102:0/4122910088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25a00d04a0 0x7f25a00d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f259f7fe700 1 -- 172.21.15.102:0/4122910088 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a0169ec0 con 0x7f25a00b4080 2024-08-17T02:29:09.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f25a4ba5700 1 --2- 172.21.15.102:0/4122910088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25a00d04a0 0x7f25a00d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:09.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f259f7fe700 1 --2- 172.21.15.102:0/4122910088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25a00b4080 0x7f25a0142a40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2588009fa0 tx=0x7f258801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f2597fff700 1 -- 172.21.15.102:0/4122910088 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2588023070 con 0x7f25a00b4080 2024-08-17T02:29:09.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f2597fff700 1 -- 172.21.15.102:0/4122910088 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258800e9e0 con 0x7f25a00b4080 2024-08-17T02:29:09.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f2597fff700 1 -- 172.21.15.102:0/4122910088 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2588006e50 con 0x7f25a00b4080 2024-08-17T02:29:09.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f25a53a6700 1 -- 172.21.15.102:0/4122910088 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a016a1a0 con 0x7f25a00b4080 2024-08-17T02:29:09.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.253+0000 7f25a53a6700 1 -- 172.21.15.102:0/4122910088 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a016a760 con 0x7f25a00b4080 2024-08-17T02:29:09.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.257+0000 7f25a53a6700 1 -- 172.21.15.102:0/4122910088 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a0158ef0 con 0x7f25a00b4080 2024-08-17T02:29:09.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.257+0000 7f2597fff700 1 -- 172.21.15.102:0/4122910088 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2588013680 con 0x7f25a00b4080 2024-08-17T02:29:09.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.257+0000 7f2597fff700 1 --2- 172.21.15.102:0/4122910088 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2580060890 0x7f2580062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.257+0000 7f2597fff700 1 -- 172.21.15.102:0/4122910088 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f258807e2c0 con 0x7f25a00b4080 2024-08-17T02:29:09.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.257+0000 7f259ffff700 1 --2- 172.21.15.102:0/4122910088 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2580060890 0x7f2580062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.257+0000 7f259ffff700 1 --2- 172.21.15.102:0/4122910088 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2580060890 0x7f2580062d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2590001190 tx=0x7f25a015d500 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.265+0000 7f2597fff700 1 -- 172.21.15.102:0/4122910088 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2588052080 con 0x7f25a00b4080 2024-08-17T02:29:09.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.465+0000 7f25a53a6700 1 -- 172.21.15.102:0/4122910088 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25a00d0e50 con 0x7f25a00b4080 2024-08-17T02:29:09.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.465+0000 7f2597fff700 1 -- 172.21.15.102:0/4122910088 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4626 (secure 0 0 0) 0x7f2588051c10 con 0x7f25a00b4080 2024-08-17T02:29:09.469 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:09.469 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3728405798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3728405798},{"type":"v1","addr":"172.21.15.102:6835","nonce":3728405798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2759836087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2759836087},{"type":"v1","addr":"172.21.15.121:6833","nonce":2759836087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5337,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/3310056391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":3310056391},{"type":"v1","addr":"172.21.15.102:6837","nonce":3310056391}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:57.316251+0000","modified":"2024-08-17T02:26:58.534785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4676":{"gid":4676,"name":"d","rank":0,"incarnation":16,"state":"up:active","state_seq":7,"addr":"172.21.15.121:6835/2189006578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2189006578},{"type":"v1","addr":"172.21.15.121:6835","nonce":2189006578}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000658238","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:09.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.469+0000 7f25a53a6700 1 -- 172.21.15.102:0/4122910088 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2580060890 msgr2=0x7f2580062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.469+0000 7f25a53a6700 1 --2- 172.21.15.102:0/4122910088 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2580060890 0x7f2580062d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2590001190 tx=0x7f25a015d500 comp rx=0 tx=0).stop 2024-08-17T02:29:09.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.469+0000 7f25a53a6700 1 -- 172.21.15.102:0/4122910088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25a00b4080 msgr2=0x7f25a0142a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.469+0000 7f25a53a6700 1 --2- 172.21.15.102:0/4122910088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25a00b4080 0x7f25a0142a40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2588009fa0 tx=0x7f258801a000 comp rx=0 tx=0).stop 2024-08-17T02:29:09.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.469+0000 7f25a53a6700 1 -- 172.21.15.102:0/4122910088 shutdown_connections 2024-08-17T02:29:09.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.469+0000 7f25a53a6700 1 --2- 172.21.15.102:0/4122910088 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2580060890 0x7f2580062d40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.469+0000 7f25a53a6700 1 --2- 172.21.15.102:0/4122910088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25a00b4080 0x7f25a0142a40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.469+0000 7f25a53a6700 1 --2- 172.21.15.102:0/4122910088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f25a00d04a0 0x7f25a00d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.469+0000 7f25a53a6700 1 --2- 172.21.15.102:0/4122910088 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f258c004810 0x7f25a00c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.469+0000 7f25a53a6700 1 -- 172.21.15.102:0/4122910088 >> 172.21.15.102:0/4122910088 conn(0x7f25a00d00a0 msgr2=0x7f25a015b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:09.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.469+0000 7f25a53a6700 1 -- 172.21.15.102:0/4122910088 shutdown_connections 2024-08-17T02:29:09.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.469+0000 7f25a53a6700 1 -- 172.21.15.102:0/4122910088 wait complete. 2024-08-17T02:29:09.472 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 19 2024-08-17T02:29:09.483 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:09.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f3627fff700 1 Processor -- start 2024-08-17T02:29:09.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f3627fff700 1 -- start start 2024-08-17T02:29:09.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f3627fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3628151740 0x7f362806b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f3627fff700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362815a920 con 0x7f362815b240 2024-08-17T02:29:09.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f3627fff700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362806c2f0 con 0x7f3628151370 2024-08-17T02:29:09.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f3627fff700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362806c780 con 0x7f3628151740 2024-08-17T02:29:09.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f36267fc700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f362815b240 0x7f362806a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55026/0 (socket says 172.21.15.102:55026) 2024-08-17T02:29:09.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f36267fc700 1 -- 172.21.15.102:0/562800481 learned_addr learned my addr 172.21.15.102:0/562800481 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:09.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f36277fe700 1 --2- 172.21.15.102:0/562800481 >> v2:172.21.15.121:3300/0 conn(0x7f3628151740 0x7f362806b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f3625ffb700 1 -- 172.21.15.102:0/562800481 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4068268128 0 0) 0x7f361c001110 con 0x7f362815b240 2024-08-17T02:29:09.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f3625ffb700 1 -- 172.21.15.102:0/562800481 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3610003570 con 0x7f362815b240 2024-08-17T02:29:09.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f3625ffb700 1 -- 172.21.15.102:0/562800481 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3514323981 0 0) 0x7f3610003570 con 0x7f362815b240 2024-08-17T02:29:09.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f3625ffb700 1 -- 172.21.15.102:0/562800481 >> v2:172.21.15.121:3300/0 conn(0x7f3628151740 msgr2=0x7f362806b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:09.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f3625ffb700 1 --2- 172.21.15.102:0/562800481 >> v2:172.21.15.121:3300/0 conn(0x7f3628151740 0x7f362806b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f3625ffb700 1 -- 172.21.15.102:0/562800481 >> v1:172.21.15.121:6789/0 conn(0x7f3628151370 legacy=0x7f362815ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f3625ffb700 1 -- 172.21.15.102:0/562800481 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362806b6e0 con 0x7f362815b240 2024-08-17T02:29:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f3625ffb700 1 -- 172.21.15.102:0/562800481 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7f361c001600 con 0x7f362815b240 2024-08-17T02:29:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.581+0000 7f3625ffb700 1 -- 172.21.15.102:0/562800481 >> v1:172.21.15.102:6789/0 conn(0x7f362815b240 legacy=0x7f362806a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3625ffb700 1 --2- 172.21.15.102:0/562800481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3610003a60 0x7f3610003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3625ffb700 1 --2- 172.21.15.102:0/562800481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3610004810 0x7f3610004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3625ffb700 1 --2- 172.21.15.102:0/562800481 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36100051c0 0x7f361000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3625ffb700 1 -- 172.21.15.102:0/562800481 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362806c780 con 0x7f3610003a60 2024-08-17T02:29:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3625ffb700 1 -- 172.21.15.102:0/562800481 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361000c0d0 con 0x7f3610004810 2024-08-17T02:29:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3625ffb700 1 -- 172.21.15.102:0/562800481 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361000c290 con 0x7f36100051c0 2024-08-17T02:29:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3626ffd700 1 --2- 172.21.15.102:0/562800481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3610003a60 0x7f3610003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f36277fe700 1 --2- 172.21.15.102:0/562800481 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36100051c0 0x7f361000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3626ffd700 1 -- 172.21.15.102:0/562800481 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36100051c0 msgr2=0x7f361000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:09.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3626ffd700 1 --2- 172.21.15.102:0/562800481 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f36100051c0 0x7f361000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3626ffd700 1 -- 172.21.15.102:0/562800481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3610004810 msgr2=0x7f3610004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:09.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3626ffd700 1 --2- 172.21.15.102:0/562800481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3610004810 0x7f3610004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3626ffd700 1 -- 172.21.15.102:0/562800481 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3610003570 con 0x7f3610003a60 2024-08-17T02:29:09.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f36277fe700 1 -- 172.21.15.102:0/562800481 reap_dead start 2024-08-17T02:29:09.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3626ffd700 1 --2- 172.21.15.102:0/562800481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3610003a60 0x7f3610003e70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f36180018b0 tx=0x7f3618007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f3d2491b19e530 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3625ffb700 1 -- 172.21.15.102:0/562800481 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618012420 con 0x7f3610003a60 2024-08-17T02:29:09.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3625ffb700 1 -- 172.21.15.102:0/562800481 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36180125a0 con 0x7f3610003a60 2024-08-17T02:29:09.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3625ffb700 1 -- 172.21.15.102:0/562800481 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618012960 con 0x7f3610003a60 2024-08-17T02:29:09.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3627fff700 1 -- 172.21.15.102:0/562800481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3610003a60 msgr2=0x7f3610003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3627fff700 1 --2- 172.21.15.102:0/562800481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3610003a60 0x7f3610003e70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f36180018b0 tx=0x7f3618007d30 comp rx=0 tx=0).stop 2024-08-17T02:29:09.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3627fff700 1 -- 172.21.15.102:0/562800481 shutdown_connections 2024-08-17T02:29:09.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3627fff700 1 --2- 172.21.15.102:0/562800481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3610003a60 0x7f3610003e70 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3627fff700 1 -- 172.21.15.102:0/562800481 >> 172.21.15.102:0/562800481 conn(0x7f362806cc40 msgr2=0x7f362806d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:09.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3627fff700 1 -- 172.21.15.102:0/562800481 shutdown_connections 2024-08-17T02:29:09.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3627fff700 1 -- 172.21.15.102:0/562800481 wait complete. 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3627fff700 1 Processor -- start 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.585+0000 7f3627fff700 1 -- start start 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3627fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3610003a60 0x7f362814ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3627fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3628168850 0x7f36281596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3627fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3628168cc0 0x7f3628159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3627fff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36280c4760 con 0x7f3610003a60 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3627fff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3628153540 con 0x7f3628168cc0 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3627fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36281540c0 con 0x7f3628168850 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3626ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3610003a60 0x7f362814ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3626ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3610003a60 0x7f362814ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33462/0 (socket says 172.21.15.102:33462) 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f36267fc700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3628168850 0x7f36281596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3626ffd700 1 -- 172.21.15.102:0/2098256409 learned_addr learned my addr 172.21.15.102:0/2098256409 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f36277fe700 1 --2- 172.21.15.102:0/2098256409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3628168cc0 0x7f3628159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3626ffd700 1 -- 172.21.15.102:0/2098256409 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3628168850 msgr2=0x7f36281596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3626ffd700 1 --2- 172.21.15.102:0/2098256409 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3628168850 0x7f36281596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3626ffd700 1 -- 172.21.15.102:0/2098256409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3628168cc0 msgr2=0x7f3628159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3626ffd700 1 --2- 172.21.15.102:0/2098256409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3628168cc0 0x7f3628159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3626ffd700 1 -- 172.21.15.102:0/2098256409 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362814f010 con 0x7f3610003a60 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3626ffd700 1 --2- 172.21.15.102:0/2098256409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3610003a60 0x7f362814ead0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f361800c3f0 tx=0x7f3618015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f360effd700 1 -- 172.21.15.102:0/2098256409 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618001200 con 0x7f3610003a60 2024-08-17T02:29:09.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f360effd700 1 -- 172.21.15.102:0/2098256409 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361800caf0 con 0x7f3610003a60 2024-08-17T02:29:09.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f360effd700 1 -- 172.21.15.102:0/2098256409 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361800ce70 con 0x7f3610003a60 2024-08-17T02:29:09.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3627fff700 1 -- 172.21.15.102:0/2098256409 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3628153790 con 0x7f3610003a60 2024-08-17T02:29:09.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.589+0000 7f3627fff700 1 -- 172.21.15.102:0/2098256409 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3628153d50 con 0x7f3610003a60 2024-08-17T02:29:09.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.593+0000 7f3627fff700 1 -- 172.21.15.102:0/2098256409 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36280638f0 con 0x7f3610003a60 2024-08-17T02:29:09.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.593+0000 7f360effd700 1 -- 172.21.15.102:0/2098256409 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f361801f620 con 0x7f3610003a60 2024-08-17T02:29:09.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.593+0000 7f360effd700 1 --2- 172.21.15.102:0/2098256409 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3614060890 0x7f3614062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.593+0000 7f360effd700 1 -- 172.21.15.102:0/2098256409 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f361807e590 con 0x7f3610003a60 2024-08-17T02:29:09.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.593+0000 7f36267fc700 1 --2- 172.21.15.102:0/2098256409 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3614060890 0x7f3614062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.593+0000 7f36267fc700 1 --2- 172.21.15.102:0/2098256409 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3614060890 0x7f3614062d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f361c001ed0 tx=0x7f362806c260 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.597+0000 7f360effd700 1 -- 172.21.15.102:0/2098256409 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f361804ea20 con 0x7f3610003a60 2024-08-17T02:29:09.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.757+0000 7f3627fff700 1 -- 172.21.15.102:0/2098256409 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36280c4760 con 0x7f3610003a60 2024-08-17T02:29:09.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.761+0000 7f360effd700 1 -- 172.21.15.102:0/2098256409 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15562 (secure 0 0 0) 0x7f3618052040 con 0x7f3610003a60 2024-08-17T02:29:09.763 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:09.764 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":39,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:29:06.893617+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000658238.meta","create_time":"2024-08-17T02:26:55.316074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000658238"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000658238.data","create_time":"2024-08-17T02:26:56.329435+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000658238"}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:6837/1340437033":"2024-08-18T02:29:03.879648+0000","172.21.15.102:6836/1340437033":"2024-08-18T02:29:03.879648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:09.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.761+0000 7f3627fff700 1 -- 172.21.15.102:0/2098256409 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3614060890 msgr2=0x7f3614062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.761+0000 7f3627fff700 1 --2- 172.21.15.102:0/2098256409 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3614060890 0x7f3614062d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f361c001ed0 tx=0x7f362806c260 comp rx=0 tx=0).stop 2024-08-17T02:29:09.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.761+0000 7f3627fff700 1 -- 172.21.15.102:0/2098256409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3610003a60 msgr2=0x7f362814ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.761+0000 7f3627fff700 1 --2- 172.21.15.102:0/2098256409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3610003a60 0x7f362814ead0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f361800c3f0 tx=0x7f3618015000 comp rx=0 tx=0).stop 2024-08-17T02:29:09.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.761+0000 7f3627fff700 1 -- 172.21.15.102:0/2098256409 shutdown_connections 2024-08-17T02:29:09.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.761+0000 7f3627fff700 1 --2- 172.21.15.102:0/2098256409 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3614060890 0x7f3614062d40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.761+0000 7f3627fff700 1 --2- 172.21.15.102:0/2098256409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3628168cc0 0x7f3628159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.761+0000 7f3627fff700 1 --2- 172.21.15.102:0/2098256409 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3628168850 0x7f36281596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.761+0000 7f3627fff700 1 --2- 172.21.15.102:0/2098256409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3610003a60 0x7f362814ead0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.765+0000 7f3627fff700 1 -- 172.21.15.102:0/2098256409 >> 172.21.15.102:0/2098256409 conn(0x7f362806cc40 msgr2=0x7f362814fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:09.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.765+0000 7f3627fff700 1 -- 172.21.15.102:0/2098256409 shutdown_connections 2024-08-17T02:29:09.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.765+0000 7f3627fff700 1 -- 172.21.15.102:0/2098256409 wait complete. 2024-08-17T02:29:09.778 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000658238 2024-08-17T02:29:09.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa32f39700 1 Processor -- start 2024-08-17T02:29:09.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa32f39700 1 -- start start 2024-08-17T02:29:09.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa32f39700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa2c06e620 0x7ffa2c0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa32f39700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ffa2c0b1630 0x7ffa2c141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa32f39700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2c141a00 con 0x7ffa2c0b0d20 2024-08-17T02:29:09.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa32f39700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2c140b10 con 0x7ffa2c0b1630 2024-08-17T02:29:09.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa32f39700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c140df0 con 0x7ffa2c06e620 2024-08-17T02:29:09.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa31f37700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ffa2c0b0d20 0x7ffa2c06df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55034/0 (socket says 172.21.15.102:55034) 2024-08-17T02:29:09.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa31f37700 1 -- 172.21.15.102:0/291117842 learned_addr learned my addr 172.21.15.102:0/291117842 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:09.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa31736700 1 --2- 172.21.15.102:0/291117842 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa2c06e620 0x7ffa2c0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa32738700 1 --2- 172.21.15.102:0/291117842 >> v2:172.21.15.121:3300/0 conn(0x7ffa2c0b1630 0x7ffa2c141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa30f35700 1 -- 172.21.15.102:0/291117842 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197621862 0 0) 0x7ffa2c141a00 con 0x7ffa2c0b0d20 2024-08-17T02:29:09.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa30f35700 1 -- 172.21.15.102:0/291117842 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa14003570 con 0x7ffa2c0b0d20 2024-08-17T02:29:09.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa30f35700 1 -- 172.21.15.102:0/291117842 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 167280946 0 0) 0x7ffa14003570 con 0x7ffa2c0b0d20 2024-08-17T02:29:09.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa31736700 1 -- 172.21.15.102:0/291117842 >> v2:172.21.15.121:3300/0 conn(0x7ffa2c0b1630 msgr2=0x7ffa2c141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:09.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa31736700 1 --2- 172.21.15.102:0/291117842 >> v2:172.21.15.121:3300/0 conn(0x7ffa2c0b1630 0x7ffa2c141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa31736700 1 -- 172.21.15.102:0/291117842 >> v1:172.21.15.102:6789/0 conn(0x7ffa2c0b0d20 legacy=0x7ffa2c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa31736700 1 -- 172.21.15.102:0/291117842 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2c1410d0 con 0x7ffa2c06e620 2024-08-17T02:29:09.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa31736700 1 --2- 172.21.15.102:0/291117842 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa2c06e620 0x7ffa2c0b10f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009e60 tx=0x7ffa28009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe57c6376fd18992 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.881+0000 7ffa30f35700 1 -- 172.21.15.102:0/291117842 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800e070 con 0x7ffa2c06e620 2024-08-17T02:29:09.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa30f35700 1 -- 172.21.15.102:0/291117842 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2800b7a0 con 0x7ffa2c06e620 2024-08-17T02:29:09.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa30f35700 1 -- 172.21.15.102:0/291117842 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c001470 con 0x7ffa2c06e620 2024-08-17T02:29:09.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32f39700 1 -- 172.21.15.102:0/291117842 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa2c06e620 msgr2=0x7ffa2c0b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32f39700 1 --2- 172.21.15.102:0/291117842 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa2c06e620 0x7ffa2c0b10f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009e60 tx=0x7ffa28009780 comp rx=0 tx=0).stop 2024-08-17T02:29:09.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32f39700 1 -- 172.21.15.102:0/291117842 shutdown_connections 2024-08-17T02:29:09.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32f39700 1 --2- 172.21.15.102:0/291117842 >> v2:172.21.15.121:3300/0 conn(0x7ffa2c0b1630 0x7ffa2c141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32f39700 1 --2- 172.21.15.102:0/291117842 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa2c06e620 0x7ffa2c0b10f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32f39700 1 -- 172.21.15.102:0/291117842 >> 172.21.15.102:0/291117842 conn(0x7ffa2c0678d0 msgr2=0x7ffa2c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:09.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32f39700 1 -- 172.21.15.102:0/291117842 shutdown_connections 2024-08-17T02:29:09.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32f39700 1 -- 172.21.15.102:0/291117842 wait complete. 2024-08-17T02:29:09.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32f39700 1 Processor -- start 2024-08-17T02:29:09.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32f39700 1 -- start start 2024-08-17T02:29:09.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32f39700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa2c06e620 0x7ffa2c141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32f39700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa2c0b0d20 0x7ffa2c156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32f39700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa2c0b1630 0x7ffa2c156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32f39700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c1546a0 con 0x7ffa2c0b1630 2024-08-17T02:29:09.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32f39700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c1434f0 con 0x7ffa2c0b0d20 2024-08-17T02:29:09.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32f39700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c16dc00 con 0x7ffa2c06e620 2024-08-17T02:29:09.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32738700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa2c0b1630 0x7ffa2c156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32738700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa2c0b1630 0x7ffa2c156750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33464/0 (socket says 172.21.15.102:33464) 2024-08-17T02:29:09.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa32738700 1 -- 172.21.15.102:0/2625638638 learned_addr learned my addr 172.21.15.102:0/2625638638 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:09.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa31736700 1 --2- 172.21.15.102:0/2625638638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa2c0b0d20 0x7ffa2c156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.885+0000 7ffa31f37700 1 --2- 172.21.15.102:0/2625638638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa2c06e620 0x7ffa2c141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.889+0000 7ffa32738700 1 -- 172.21.15.102:0/2625638638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa2c06e620 msgr2=0x7ffa2c141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.889+0000 7ffa32738700 1 --2- 172.21.15.102:0/2625638638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa2c06e620 0x7ffa2c141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.889+0000 7ffa32738700 1 -- 172.21.15.102:0/2625638638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa2c0b0d20 msgr2=0x7ffa2c156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.889+0000 7ffa32738700 1 --2- 172.21.15.102:0/2625638638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa2c0b0d20 0x7ffa2c156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.889+0000 7ffa32738700 1 -- 172.21.15.102:0/2625638638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa28009a20 con 0x7ffa2c0b1630 2024-08-17T02:29:09.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.889+0000 7ffa32738700 1 --2- 172.21.15.102:0/2625638638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa2c0b1630 0x7ffa2c156750 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400ea50 tx=0x7ffa240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.889+0000 7ffa21ffb700 1 -- 172.21.15.102:0/2625638638 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2400c920 con 0x7ffa2c0b1630 2024-08-17T02:29:09.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.889+0000 7ffa21ffb700 1 -- 172.21.15.102:0/2625638638 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2400caa0 con 0x7ffa2c0b1630 2024-08-17T02:29:09.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.889+0000 7ffa32f39700 1 -- 172.21.15.102:0/2625638638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2c1428e0 con 0x7ffa2c0b1630 2024-08-17T02:29:09.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.889+0000 7ffa21ffb700 1 -- 172.21.15.102:0/2625638638 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2400ce60 con 0x7ffa2c0b1630 2024-08-17T02:29:09.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.889+0000 7ffa32f39700 1 -- 172.21.15.102:0/2625638638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2c142ea0 con 0x7ffa2c0b1630 2024-08-17T02:29:09.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.889+0000 7ffa32f39700 1 -- 172.21.15.102:0/2625638638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2c143680 con 0x7ffa2c0b1630 2024-08-17T02:29:09.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.889+0000 7ffa21ffb700 1 -- 172.21.15.102:0/2625638638 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ffa24013680 con 0x7ffa2c0b1630 2024-08-17T02:29:09.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.889+0000 7ffa21ffb700 1 --2- 172.21.15.102:0/2625638638 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ffa18060860 0x7ffa18062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.893+0000 7ffa21ffb700 1 -- 172.21.15.102:0/2625638638 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7ffa2407d050 con 0x7ffa2c0b1630 2024-08-17T02:29:09.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.893+0000 7ffa31f37700 1 --2- 172.21.15.102:0/2625638638 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ffa18060860 0x7ffa18062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.893+0000 7ffa31f37700 1 --2- 172.21.15.102:0/2625638638 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ffa18060860 0x7ffa18062d10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c001620 tx=0x7ffa1c0014c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:09.897+0000 7ffa21ffb700 1 -- 172.21.15.102:0/2625638638 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ffa2404d420 con 0x7ffa2c0b1630 2024-08-17T02:29:10.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.093+0000 7ffa32f39700 1 -- 172.21.15.102:0/2625638638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000658238"} v 0) v1 -- 0x7ffa2c0643a0 con 0x7ffa2c0b1630 2024-08-17T02:29:10.097 INFO:tasks.ceph.mon.a.smithi102.stderr:2024-08-17T02:29:10.093+0000 7fd2c6a69700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:29:10.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.101+0000 7ffa21ffb700 1 -- 172.21.15.102:0/2625638638 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000658238"}]=0 volume_0000000000658238 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 195+0+0 (secure 0 0 0) 0x7ffa24050a40 con 0x7ffa2c0b1630 2024-08-17T02:29:10.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.105+0000 7ffa32f39700 1 -- 172.21.15.102:0/2625638638 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ffa18060860 msgr2=0x7ffa18062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.105+0000 7ffa32f39700 1 --2- 172.21.15.102:0/2625638638 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ffa18060860 0x7ffa18062d10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c001620 tx=0x7ffa1c0014c0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.105+0000 7ffa32f39700 1 -- 172.21.15.102:0/2625638638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa2c0b1630 msgr2=0x7ffa2c156750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.105+0000 7ffa32f39700 1 --2- 172.21.15.102:0/2625638638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa2c0b1630 0x7ffa2c156750 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400ea50 tx=0x7ffa240091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.105+0000 7ffa32f39700 1 -- 172.21.15.102:0/2625638638 shutdown_connections 2024-08-17T02:29:10.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.105+0000 7ffa32f39700 1 --2- 172.21.15.102:0/2625638638 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ffa18060860 0x7ffa18062d10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.105+0000 7ffa32f39700 1 --2- 172.21.15.102:0/2625638638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa2c0b1630 0x7ffa2c156750 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.105+0000 7ffa32f39700 1 --2- 172.21.15.102:0/2625638638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa2c0b0d20 0x7ffa2c156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.105+0000 7ffa32f39700 1 --2- 172.21.15.102:0/2625638638 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ffa2c06e620 0x7ffa2c141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.105+0000 7ffa32f39700 1 -- 172.21.15.102:0/2625638638 >> 172.21.15.102:0/2625638638 conn(0x7ffa2c0678d0 msgr2=0x7ffa2c15dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:10.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.105+0000 7ffa32f39700 1 -- 172.21.15.102:0/2625638638 shutdown_connections 2024-08-17T02:29:10.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.105+0000 7ffa32f39700 1 -- 172.21.15.102:0/2625638638 wait complete. 2024-08-17T02:29:10.110 INFO:teuthology.orchestra.run.smithi102.stderr:volume_0000000000658238 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:29:10.111 INFO:tasks.ceph.mds.d.smithi121.stderr: -3054> 2024-08-17T02:27:02.568+0000 7f1833b32700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:29:10.124 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000658238 --yes-i-really-mean-it 2024-08-17T02:29:10.139 INFO:tasks.ceph.mds.d.smithi121.stdout:starting mds.d at 2024-08-17T02:29:10.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.233+0000 7f4182ecc700 1 Processor -- start 2024-08-17T02:29:10.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.233+0000 7f4182ecc700 1 -- start start 2024-08-17T02:29:10.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.233+0000 7f4182ecc700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f417c13f680 0x7f417c0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.233+0000 7f4182ecc700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f417c13fa50 0x7f417c0ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.233+0000 7f4182ecc700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417c0afc70 con 0x7f417c0b0100 2024-08-17T02:29:10.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.233+0000 7f4182ecc700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417c0adc00 con 0x7f417c13fa50 2024-08-17T02:29:10.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.233+0000 7f4182ecc700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417c0af060 con 0x7f417c13f680 2024-08-17T02:29:10.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.233+0000 7f41816c9700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f417c13fa50 0x7f417c0ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.233+0000 7f41816c9700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f417c13fa50 0x7f417c0ad6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33474/0 (socket says 172.21.15.102:33474) 2024-08-17T02:29:10.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.233+0000 7f41816c9700 1 -- 172.21.15.102:0/3527053931 learned_addr learned my addr 172.21.15.102:0/3527053931 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:10.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.233+0000 7f4181eca700 1 --2- 172.21.15.102:0/3527053931 >> v2:172.21.15.121:3300/0 conn(0x7f417c13f680 0x7f417c0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4181eca700 1 -- 172.21.15.102:0/3527053931 >> v2:172.21.15.102:3300/0 conn(0x7f417c13fa50 msgr2=0x7f417c0ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:10.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4181eca700 1 --2- 172.21.15.102:0/3527053931 >> v2:172.21.15.102:3300/0 conn(0x7f417c13fa50 0x7f417c0ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4181eca700 1 -- 172.21.15.102:0/3527053931 >> v1:172.21.15.121:6789/0 conn(0x7f417c0b0100 legacy=0x7f417c06e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4181eca700 1 -- 172.21.15.102:0/3527053931 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c0af340 con 0x7f417c13f680 2024-08-17T02:29:10.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f41816c9700 1 --2- 172.21.15.102:0/3527053931 >> v2:172.21.15.102:3300/0 conn(0x7f417c13fa50 0x7f417c0ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:10.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4181eca700 1 --2- 172.21.15.102:0/3527053931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f417c13f680 0x7f417c0aea80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f417c06ca10 tx=0x7f41740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bfd241a40a66def server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:10.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4180ec8700 1 -- 172.21.15.102:0/3527053931 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174011630 con 0x7f417c13f680 2024-08-17T02:29:10.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4180ec8700 1 -- 172.21.15.102:0/3527053931 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4174011790 con 0x7f417c13f680 2024-08-17T02:29:10.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4180ec8700 1 -- 172.21.15.102:0/3527053931 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174011b30 con 0x7f417c13f680 2024-08-17T02:29:10.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4182ecc700 1 -- 172.21.15.102:0/3527053931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f417c13f680 msgr2=0x7f417c0aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4182ecc700 1 --2- 172.21.15.102:0/3527053931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f417c13f680 0x7f417c0aea80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f417c06ca10 tx=0x7f41740091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4182ecc700 1 -- 172.21.15.102:0/3527053931 shutdown_connections 2024-08-17T02:29:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4182ecc700 1 --2- 172.21.15.102:0/3527053931 >> v2:172.21.15.102:3300/0 conn(0x7f417c13fa50 0x7f417c0ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4182ecc700 1 --2- 172.21.15.102:0/3527053931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f417c13f680 0x7f417c0aea80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4182ecc700 1 -- 172.21.15.102:0/3527053931 >> 172.21.15.102:0/3527053931 conn(0x7f417c0678a0 msgr2=0x7f417c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4182ecc700 1 -- 172.21.15.102:0/3527053931 shutdown_connections 2024-08-17T02:29:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4182ecc700 1 -- 172.21.15.102:0/3527053931 wait complete. 2024-08-17T02:29:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4182ecc700 1 Processor -- start 2024-08-17T02:29:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.237+0000 7f4182ecc700 1 -- start start 2024-08-17T02:29:10.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4182ecc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f417c0b0100 0x7f417c155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4182ecc700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f417c13f680 0x7f417c157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4182ecc700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f417c13fa50 0x7f417c1578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4182ecc700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c156160 con 0x7f417c0b0100 2024-08-17T02:29:10.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4182ecc700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c15a600 con 0x7f417c13f680 2024-08-17T02:29:10.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4182ecc700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c0ab1a0 con 0x7f417c13fa50 2024-08-17T02:29:10.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4181eca700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f417c0b0100 0x7f417c155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4181eca700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f417c0b0100 0x7f417c155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33488/0 (socket says 172.21.15.102:33488) 2024-08-17T02:29:10.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4181eca700 1 -- 172.21.15.102:0/1381425206 learned_addr learned my addr 172.21.15.102:0/1381425206 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:10.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f41816c9700 1 --2- 172.21.15.102:0/1381425206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f417c13f680 0x7f417c157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f41826cb700 1 --2- 172.21.15.102:0/1381425206 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f417c13fa50 0x7f417c1578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4181eca700 1 -- 172.21.15.102:0/1381425206 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f417c13fa50 msgr2=0x7f417c1578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4181eca700 1 --2- 172.21.15.102:0/1381425206 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f417c13fa50 0x7f417c1578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4181eca700 1 -- 172.21.15.102:0/1381425206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f417c13f680 msgr2=0x7f417c157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4181eca700 1 --2- 172.21.15.102:0/1381425206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f417c13f680 0x7f417c157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4181eca700 1 -- 172.21.15.102:0/1381425206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417800bcf0 con 0x7f417c0b0100 2024-08-17T02:29:10.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f41816c9700 1 --2- 172.21.15.102:0/1381425206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f417c13f680 0x7f417c157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:10.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4181eca700 1 --2- 172.21.15.102:0/1381425206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f417c0b0100 0x7f417c155c20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4174009f50 tx=0x7f4174017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:10.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4171ffb700 1 -- 172.21.15.102:0/1381425206 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174011b10 con 0x7f417c0b0100 2024-08-17T02:29:10.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4171ffb700 1 -- 172.21.15.102:0/1381425206 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41740253f0 con 0x7f417c0b0100 2024-08-17T02:29:10.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4182ecc700 1 -- 172.21.15.102:0/1381425206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4174009420 con 0x7f417c0b0100 2024-08-17T02:29:10.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4171ffb700 1 -- 172.21.15.102:0/1381425206 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174025790 con 0x7f417c0b0100 2024-08-17T02:29:10.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4182ecc700 1 -- 172.21.15.102:0/1381425206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417c0aaec0 con 0x7f417c0b0100 2024-08-17T02:29:10.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.241+0000 7f4182ecc700 1 -- 172.21.15.102:0/1381425206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417c064330 con 0x7f417c0b0100 2024-08-17T02:29:10.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.245+0000 7f4171ffb700 1 -- 172.21.15.102:0/1381425206 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4174025b80 con 0x7f417c0b0100 2024-08-17T02:29:10.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.245+0000 7f4171ffb700 1 --2- 172.21.15.102:0/1381425206 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4168060860 0x7f4168062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.245+0000 7f4171ffb700 1 -- 172.21.15.102:0/1381425206 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f417407e570 con 0x7f417c0b0100 2024-08-17T02:29:10.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.245+0000 7f41816c9700 1 --2- 172.21.15.102:0/1381425206 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4168060860 0x7f4168062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.245+0000 7f41816c9700 1 --2- 172.21.15.102:0/1381425206 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4168060860 0x7f4168062d10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f417c06ec20 tx=0x7f417800d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:10.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.249+0000 7f4171ffb700 1 -- 172.21.15.102:0/1381425206 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f417404e8e0 con 0x7f417c0b0100 2024-08-17T02:29:10.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:10.453+0000 7f4182ecc700 1 -- 172.21.15.102:0/1381425206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000658238", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f417c06ed70 con 0x7f417c0b0100 2024-08-17T02:29:11.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.105+0000 7f4171ffb700 1 -- 172.21.15.102:0/1381425206 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000658238", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7f4174051f00 con 0x7f417c0b0100 2024-08-17T02:29:11.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.109+0000 7f4182ecc700 1 -- 172.21.15.102:0/1381425206 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4168060860 msgr2=0x7f4168062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.109+0000 7f4182ecc700 1 --2- 172.21.15.102:0/1381425206 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4168060860 0x7f4168062d10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f417c06ec20 tx=0x7f417800d040 comp rx=0 tx=0).stop 2024-08-17T02:29:11.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.109+0000 7f4182ecc700 1 -- 172.21.15.102:0/1381425206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f417c0b0100 msgr2=0x7f417c155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.109+0000 7f4182ecc700 1 --2- 172.21.15.102:0/1381425206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f417c0b0100 0x7f417c155c20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4174009f50 tx=0x7f4174017000 comp rx=0 tx=0).stop 2024-08-17T02:29:11.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.109+0000 7f4182ecc700 1 -- 172.21.15.102:0/1381425206 shutdown_connections 2024-08-17T02:29:11.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.109+0000 7f4182ecc700 1 --2- 172.21.15.102:0/1381425206 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4168060860 0x7f4168062d10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.109+0000 7f4182ecc700 1 --2- 172.21.15.102:0/1381425206 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f417c13fa50 0x7f417c1578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.109+0000 7f4182ecc700 1 --2- 172.21.15.102:0/1381425206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f417c13f680 0x7f417c157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.109+0000 7f4182ecc700 1 --2- 172.21.15.102:0/1381425206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f417c0b0100 0x7f417c155c20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.109+0000 7f4182ecc700 1 -- 172.21.15.102:0/1381425206 >> 172.21.15.102:0/1381425206 conn(0x7f417c0678a0 msgr2=0x7f417c13dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:11.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.109+0000 7f4182ecc700 1 -- 172.21.15.102:0/1381425206 shutdown_connections 2024-08-17T02:29:11.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.109+0000 7f4182ecc700 1 -- 172.21.15.102:0/1381425206 wait complete. 2024-08-17T02:29:11.128 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000658238.meta cephfs.volume_0000000000658238.meta --yes-i-really-really-mean-it 2024-08-17T02:29:11.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.245+0000 7f006f3e9700 1 Processor -- start 2024-08-17T02:29:11.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.245+0000 7f006f3e9700 1 -- start start 2024-08-17T02:29:11.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.245+0000 7f006f3e9700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0068068db0 0x7f006806aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006f3e9700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f00680af4d0 0x7f00680ac990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006f3e9700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006806af80 con 0x7f0068155c90 2024-08-17T02:29:11.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006f3e9700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006806ba50 con 0x7f0068068db0 2024-08-17T02:29:11.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006f3e9700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00680ac500 con 0x7f00680af4d0 2024-08-17T02:29:11.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006dbe6700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0068068db0 0x7f006806aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006dbe6700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0068068db0 0x7f006806aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33496/0 (socket says 172.21.15.102:33496) 2024-08-17T02:29:11.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006dbe6700 1 -- 172.21.15.102:0/4009832970 learned_addr learned my addr 172.21.15.102:0/4009832970 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:11.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006e3e7700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0068155c90 0x7f00680686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55036/0 (socket says 172.21.15.102:55036) 2024-08-17T02:29:11.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006ebe8700 1 --2- 172.21.15.102:0/4009832970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f00680af4d0 0x7f00680ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006dbe6700 1 -- 172.21.15.102:0/4009832970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f00680af4d0 msgr2=0x7f00680ac990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:11.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006dbe6700 1 --2- 172.21.15.102:0/4009832970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f00680af4d0 0x7f00680ac990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006dbe6700 1 -- 172.21.15.102:0/4009832970 >> v1:172.21.15.102:6789/0 conn(0x7f0068155c90 legacy=0x7f00680686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006d3e5700 1 -- 172.21.15.102:0/4009832970 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057368007 0 0) 0x7f006806af80 con 0x7f0068155c90 2024-08-17T02:29:11.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006dbe6700 1 -- 172.21.15.102:0/4009832970 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006806b1b0 con 0x7f0068068db0 2024-08-17T02:29:11.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006dbe6700 1 --2- 172.21.15.102:0/4009832970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0068068db0 0x7f006806aa40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f00580099b0 tx=0x7f0058009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c349c01a30a22e52 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:11.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006d3e5700 1 -- 172.21.15.102:0/4009832970 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058009ea0 con 0x7f0068068db0 2024-08-17T02:29:11.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006d3e5700 1 -- 172.21.15.102:0/4009832970 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005800b860 con 0x7f0068068db0 2024-08-17T02:29:11.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006d3e5700 1 -- 172.21.15.102:0/4009832970 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005800bc00 con 0x7f0068068db0 2024-08-17T02:29:11.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006f3e9700 1 -- 172.21.15.102:0/4009832970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0068068db0 msgr2=0x7f006806aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006f3e9700 1 --2- 172.21.15.102:0/4009832970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0068068db0 0x7f006806aa40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f00580099b0 tx=0x7f0058009250 comp rx=0 tx=0).stop 2024-08-17T02:29:11.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006f3e9700 1 -- 172.21.15.102:0/4009832970 shutdown_connections 2024-08-17T02:29:11.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006f3e9700 1 --2- 172.21.15.102:0/4009832970 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f00680af4d0 0x7f00680ac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006f3e9700 1 --2- 172.21.15.102:0/4009832970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0068068db0 0x7f006806aa40 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006f3e9700 1 -- 172.21.15.102:0/4009832970 >> 172.21.15.102:0/4009832970 conn(0x7f00680ccfa0 msgr2=0x7f006806d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:11.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006f3e9700 1 -- 172.21.15.102:0/4009832970 shutdown_connections 2024-08-17T02:29:11.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.249+0000 7f006f3e9700 1 -- 172.21.15.102:0/4009832970 wait complete. 2024-08-17T02:29:11.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006f3e9700 1 Processor -- start 2024-08-17T02:29:11.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006f3e9700 1 -- start start 2024-08-17T02:29:11.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006f3e9700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0068068db0 0x7f00680a75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006f3e9700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f00680af4d0 0x7f0068165a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006f3e9700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0068155c90 0x7f00680c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006f3e9700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680c1580 con 0x7f0068068db0 2024-08-17T02:29:11.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006f3e9700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680aa6f0 con 0x7f0068155c90 2024-08-17T02:29:11.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006f3e9700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00680aa130 con 0x7f00680af4d0 2024-08-17T02:29:11.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006e3e7700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0068068db0 0x7f00680a75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006e3e7700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0068068db0 0x7f00680a75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33498/0 (socket says 172.21.15.102:33498) 2024-08-17T02:29:11.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006e3e7700 1 -- 172.21.15.102:0/3675386210 learned_addr learned my addr 172.21.15.102:0/3675386210 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:11.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006ebe8700 1 --2- 172.21.15.102:0/3675386210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0068155c90 0x7f00680c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006dbe6700 1 --2- 172.21.15.102:0/3675386210 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f00680af4d0 0x7f0068165a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006e3e7700 1 -- 172.21.15.102:0/3675386210 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f00680af4d0 msgr2=0x7f0068165a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006e3e7700 1 --2- 172.21.15.102:0/3675386210 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f00680af4d0 0x7f0068165a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006e3e7700 1 -- 172.21.15.102:0/3675386210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0068155c90 msgr2=0x7f00680c2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006e3e7700 1 --2- 172.21.15.102:0/3675386210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0068155c90 0x7f00680c2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006e3e7700 1 -- 172.21.15.102:0/3675386210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00580094f0 con 0x7f0068068db0 2024-08-17T02:29:11.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006e3e7700 1 --2- 172.21.15.102:0/3675386210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0068068db0 0x7f00680a75a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f006400e7c0 tx=0x7f0064001200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:11.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f005e7fc700 1 -- 172.21.15.102:0/3675386210 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0064007c80 con 0x7f0068068db0 2024-08-17T02:29:11.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f005e7fc700 1 -- 172.21.15.102:0/3675386210 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0064007de0 con 0x7f0068068db0 2024-08-17T02:29:11.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.253+0000 7f006f3e9700 1 -- 172.21.15.102:0/3675386210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00680aa410 con 0x7f0068068db0 2024-08-17T02:29:11.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.257+0000 7f005e7fc700 1 -- 172.21.15.102:0/3675386210 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0064009340 con 0x7f0068068db0 2024-08-17T02:29:11.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.257+0000 7f006f3e9700 1 -- 172.21.15.102:0/3675386210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00680c8cb0 con 0x7f0068068db0 2024-08-17T02:29:11.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.257+0000 7f006f3e9700 1 -- 172.21.15.102:0/3675386210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00680644b0 con 0x7f0068068db0 2024-08-17T02:29:11.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.257+0000 7f005e7fc700 1 -- 172.21.15.102:0/3675386210 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f00640096f0 con 0x7f0068068db0 2024-08-17T02:29:11.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.257+0000 7f005e7fc700 1 --2- 172.21.15.102:0/3675386210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f004c060860 0x7f004c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.257+0000 7f006dbe6700 1 --2- 172.21.15.102:0/3675386210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f004c060860 0x7f004c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.257+0000 7f005e7fc700 1 -- 172.21.15.102:0/3675386210 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f006407e780 con 0x7f0068068db0 2024-08-17T02:29:11.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.257+0000 7f006dbe6700 1 --2- 172.21.15.102:0/3675386210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f004c060860 0x7f004c062d10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f00580099b0 tx=0x7f0058017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:11.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.265+0000 7f005e7fc700 1 -- 172.21.15.102:0/3675386210 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f006404eb70 con 0x7f0068068db0 2024-08-17T02:29:11.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:11.429+0000 7f006f3e9700 1 -- 172.21.15.102:0/3675386210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000658238.meta", "pool2": "cephfs.volume_0000000000658238.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0068067410 con 0x7f0068068db0 2024-08-17T02:29:12.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.113+0000 7f005e7fc700 1 -- 172.21.15.102:0/3675386210 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000658238.meta", "pool2": "cephfs.volume_0000000000658238.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000658238.meta' removed v41) v1 ==== 241+0+0 (secure 0 0 0) 0x7f0064052190 con 0x7f0068068db0 2024-08-17T02:29:12.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.121+0000 7f006f3e9700 1 -- 172.21.15.102:0/3675386210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f004c060860 msgr2=0x7f004c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.121+0000 7f006f3e9700 1 --2- 172.21.15.102:0/3675386210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f004c060860 0x7f004c062d10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f00580099b0 tx=0x7f0058017000 comp rx=0 tx=0).stop 2024-08-17T02:29:12.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.121+0000 7f006f3e9700 1 -- 172.21.15.102:0/3675386210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0068068db0 msgr2=0x7f00680a75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.121+0000 7f006f3e9700 1 --2- 172.21.15.102:0/3675386210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0068068db0 0x7f00680a75a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f006400e7c0 tx=0x7f0064001200 comp rx=0 tx=0).stop 2024-08-17T02:29:12.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.121+0000 7f006f3e9700 1 -- 172.21.15.102:0/3675386210 shutdown_connections 2024-08-17T02:29:12.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.121+0000 7f006f3e9700 1 --2- 172.21.15.102:0/3675386210 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f004c060860 0x7f004c062d10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.121+0000 7f006f3e9700 1 --2- 172.21.15.102:0/3675386210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0068155c90 0x7f00680c2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.121+0000 7f006f3e9700 1 --2- 172.21.15.102:0/3675386210 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f00680af4d0 0x7f0068165a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.121+0000 7f006f3e9700 1 --2- 172.21.15.102:0/3675386210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0068068db0 0x7f00680a75a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.121+0000 7f006f3e9700 1 -- 172.21.15.102:0/3675386210 >> 172.21.15.102:0/3675386210 conn(0x7f00680ccfa0 msgr2=0x7f00680b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.121+0000 7f006f3e9700 1 -- 172.21.15.102:0/3675386210 shutdown_connections 2024-08-17T02:29:12.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.121+0000 7f006f3e9700 1 -- 172.21.15.102:0/3675386210 wait complete. 2024-08-17T02:29:12.126 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs.volume_0000000000658238.meta' removed 2024-08-17T02:29:12.138 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000658238.data cephfs.volume_0000000000658238.data --yes-i-really-really-mean-it 2024-08-17T02:29:12.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.245+0000 7fa90359e700 1 Processor -- start 2024-08-17T02:29:12.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.245+0000 7fa90359e700 1 -- start start 2024-08-17T02:29:12.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90359e700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa90406a270 0x7fa9040b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90359e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9040b12b0 0x7fa9040ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90359e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90415d110 con 0x7fa9040aef20 2024-08-17T02:29:12.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90359e700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9040b0690 con 0x7fa90406a270 2024-08-17T02:29:12.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90359e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040b0200 con 0x7fa9040b12b0 2024-08-17T02:29:12.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90259c700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa90406a270 0x7fa9040b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90259c700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa90406a270 0x7fa9040b0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33844/0 (socket says 172.21.15.102:33844) 2024-08-17T02:29:12.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90259c700 1 -- 172.21.15.102:0/3558810386 learned_addr learned my addr 172.21.15.102:0/3558810386 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:12.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa901d9b700 1 --2- 172.21.15.102:0/3558810386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9040b12b0 0x7fa9040ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa902d9d700 1 --1- 172.21.15.102:0/3558810386 >> v1:172.21.15.121:6789/0 conn(0x7fa9040aef20 0x7fa9040b2f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:60730/0 (socket says 172.21.15.102:60730) 2024-08-17T02:29:12.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90259c700 1 -- 172.21.15.102:0/3558810386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9040b12b0 msgr2=0x7fa9040ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:12.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90259c700 1 --2- 172.21.15.102:0/3558810386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9040b12b0 0x7fa9040ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90259c700 1 -- 172.21.15.102:0/3558810386 >> v1:172.21.15.121:6789/0 conn(0x7fa9040aef20 legacy=0x7fa9040b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90259c700 1 -- 172.21.15.102:0/3558810386 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9040af3a0 con 0x7fa90406a270 2024-08-17T02:29:12.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90259c700 1 --2- 172.21.15.102:0/3558810386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90406a270 0x7fa9040b0d70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80099b0 tx=0x7fa8f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3be6fe5a8523286 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90159a700 1 -- 172.21.15.102:0/3558810386 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8009ea0 con 0x7fa90406a270 2024-08-17T02:29:12.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90159a700 1 -- 172.21.15.102:0/3558810386 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f800b860 con 0x7fa90406a270 2024-08-17T02:29:12.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90159a700 1 -- 172.21.15.102:0/3558810386 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f800bc00 con 0x7fa90406a270 2024-08-17T02:29:12.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90359e700 1 -- 172.21.15.102:0/3558810386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90406a270 msgr2=0x7fa9040b0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90359e700 1 --2- 172.21.15.102:0/3558810386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90406a270 0x7fa9040b0d70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80099b0 tx=0x7fa8f8009250 comp rx=0 tx=0).stop 2024-08-17T02:29:12.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90359e700 1 -- 172.21.15.102:0/3558810386 shutdown_connections 2024-08-17T02:29:12.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90359e700 1 --2- 172.21.15.102:0/3558810386 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9040b12b0 0x7fa9040ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90359e700 1 --2- 172.21.15.102:0/3558810386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90406a270 0x7fa9040b0d70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90359e700 1 -- 172.21.15.102:0/3558810386 >> 172.21.15.102:0/3558810386 conn(0x7fa9040cdea0 msgr2=0x7fa9040ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90359e700 1 -- 172.21.15.102:0/3558810386 shutdown_connections 2024-08-17T02:29:12.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.249+0000 7fa90359e700 1 -- 172.21.15.102:0/3558810386 wait complete. 2024-08-17T02:29:12.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90359e700 1 Processor -- start 2024-08-17T02:29:12.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90359e700 1 -- start start 2024-08-17T02:29:12.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90359e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90406a270 0x7fa9040acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90359e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9040aef20 0x7fa904155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90359e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9040b12b0 0x7fa90415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90359e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90415a6f0 con 0x7fa90406a270 2024-08-17T02:29:12.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90359e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040ad240 con 0x7fa9040b12b0 2024-08-17T02:29:12.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90359e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa904159800 con 0x7fa9040aef20 2024-08-17T02:29:12.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90259c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90406a270 0x7fa9040acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90259c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90406a270 0x7fa9040acd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33852/0 (socket says 172.21.15.102:33852) 2024-08-17T02:29:12.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90259c700 1 -- 172.21.15.102:0/1626549454 learned_addr learned my addr 172.21.15.102:0/1626549454 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:12.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa901d9b700 1 --2- 172.21.15.102:0/1626549454 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9040aef20 0x7fa904155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa902d9d700 1 --2- 172.21.15.102:0/1626549454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9040b12b0 0x7fa90415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90259c700 1 -- 172.21.15.102:0/1626549454 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9040aef20 msgr2=0x7fa904155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90259c700 1 --2- 172.21.15.102:0/1626549454 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9040aef20 0x7fa904155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90259c700 1 -- 172.21.15.102:0/1626549454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9040b12b0 msgr2=0x7fa90415ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90259c700 1 --2- 172.21.15.102:0/1626549454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9040b12b0 0x7fa90415ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90259c700 1 -- 172.21.15.102:0/1626549454 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f80094f0 con 0x7fa90406a270 2024-08-17T02:29:12.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90259c700 1 --2- 172.21.15.102:0/1626549454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90406a270 0x7fa9040acd00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa904068130 tx=0x7fa8f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa8f27fc700 1 -- 172.21.15.102:0/1626549454 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8000d10 con 0x7fa90406a270 2024-08-17T02:29:12.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa8f27fc700 1 -- 172.21.15.102:0/1626549454 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f800b9d0 con 0x7fa90406a270 2024-08-17T02:29:12.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90359e700 1 -- 172.21.15.102:0/1626549454 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa904159ae0 con 0x7fa90406a270 2024-08-17T02:29:12.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa8f27fc700 1 -- 172.21.15.102:0/1626549454 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8025420 con 0x7fa90406a270 2024-08-17T02:29:12.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.253+0000 7fa90359e700 1 -- 172.21.15.102:0/1626549454 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90415a0a0 con 0x7fa90406a270 2024-08-17T02:29:12.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.257+0000 7fa90359e700 1 -- 172.21.15.102:0/1626549454 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9040644b0 con 0x7fa90406a270 2024-08-17T02:29:12.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.257+0000 7fa8f27fc700 1 -- 172.21.15.102:0/1626549454 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa8f8023070 con 0x7fa90406a270 2024-08-17T02:29:12.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.257+0000 7fa8f27fc700 1 --2- 172.21.15.102:0/1626549454 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa8e4060890 0x7fa8e4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.257+0000 7fa901d9b700 1 --2- 172.21.15.102:0/1626549454 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa8e4060890 0x7fa8e4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.257+0000 7fa8f27fc700 1 -- 172.21.15.102:0/1626549454 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5448+0+0 (secure 0 0 0) 0x7fa8f807dfe0 con 0x7fa90406a270 2024-08-17T02:29:12.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.257+0000 7fa901d9b700 1 --2- 172.21.15.102:0/1626549454 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa8e4060890 0x7fa8e4062d40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa904157810 tx=0x7fa8f40091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.265+0000 7fa8f27fc700 1 -- 172.21.15.102:0/1626549454 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa8f804e4f0 con 0x7fa90406a270 2024-08-17T02:29:12.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:12.433+0000 7fa90359e700 1 -- 172.21.15.102:0/1626549454 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000658238.data", "pool2": "cephfs.volume_0000000000658238.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa90406aed0 con 0x7fa90406a270 2024-08-17T02:29:13.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.125+0000 7fa8f27fc700 1 -- 172.21.15.102:0/1626549454 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000658238.data", "pool2": "cephfs.volume_0000000000658238.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000658238.data' removed v42) v1 ==== 241+0+0 (secure 0 0 0) 0x7fa8f8051b10 con 0x7fa90406a270 2024-08-17T02:29:13.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.133+0000 7fa90359e700 1 -- 172.21.15.102:0/1626549454 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa8e4060890 msgr2=0x7fa8e4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.133+0000 7fa90359e700 1 --2- 172.21.15.102:0/1626549454 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa8e4060890 0x7fa8e4062d40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa904157810 tx=0x7fa8f40091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.133+0000 7fa90359e700 1 -- 172.21.15.102:0/1626549454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90406a270 msgr2=0x7fa9040acd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.133+0000 7fa90359e700 1 --2- 172.21.15.102:0/1626549454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90406a270 0x7fa9040acd00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa904068130 tx=0x7fa8f8017000 comp rx=0 tx=0).stop 2024-08-17T02:29:13.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.133+0000 7fa90359e700 1 -- 172.21.15.102:0/1626549454 shutdown_connections 2024-08-17T02:29:13.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.133+0000 7fa90359e700 1 --2- 172.21.15.102:0/1626549454 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fa8e4060890 0x7fa8e4062d40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.133+0000 7fa90359e700 1 --2- 172.21.15.102:0/1626549454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9040b12b0 0x7fa90415ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.133+0000 7fa90359e700 1 --2- 172.21.15.102:0/1626549454 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fa9040aef20 0x7fa904155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.133+0000 7fa90359e700 1 --2- 172.21.15.102:0/1626549454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90406a270 0x7fa9040acd00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.133+0000 7fa90359e700 1 -- 172.21.15.102:0/1626549454 >> 172.21.15.102:0/1626549454 conn(0x7fa9040cdea0 msgr2=0x7fa9041580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.133+0000 7fa90359e700 1 -- 172.21.15.102:0/1626549454 shutdown_connections 2024-08-17T02:29:13.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.133+0000 7fa90359e700 1 -- 172.21.15.102:0/1626549454 wait complete. 2024-08-17T02:29:13.136 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs.volume_0000000000658238.data' removed 2024-08-17T02:29:13.149 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:29:13.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.261+0000 7ff9f0702700 1 Processor -- start 2024-08-17T02:29:13.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.261+0000 7ff9f0702700 1 -- start start 2024-08-17T02:29:13.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.261+0000 7ff9f0702700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff9e81593f0 0x7ff9e806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.261+0000 7ff9f0702700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff9e80b0000 0x7ff9e806bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.261+0000 7ff9f0702700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e80b2990 con 0x7ff9e8159020 2024-08-17T02:29:13.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.261+0000 7ff9f0702700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e80b3190 con 0x7ff9e80b0000 2024-08-17T02:29:13.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.261+0000 7ff9f0702700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e8067ba0 con 0x7ff9e81593f0 2024-08-17T02:29:13.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.261+0000 7ff9eec9f700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff9e80b0000 0x7ff9e806bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.261+0000 7ff9ee49e700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff9e8159020 0x7ff9e80b2280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55894/0 (socket says 172.21.15.102:55894) 2024-08-17T02:29:13.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9ee49e700 1 -- 172.21.15.102:0/2341899834 learned_addr learned my addr 172.21.15.102:0/2341899834 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:13.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9edc9d700 1 --2- 172.21.15.102:0/2341899834 >> v2:172.21.15.121:3300/0 conn(0x7ff9e81593f0 0x7ff9e806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9eec9f700 1 -- 172.21.15.102:0/2341899834 >> v2:172.21.15.121:3300/0 conn(0x7ff9e81593f0 msgr2=0x7ff9e806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:13.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9eec9f700 1 --2- 172.21.15.102:0/2341899834 >> v2:172.21.15.121:3300/0 conn(0x7ff9e81593f0 0x7ff9e806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9ed49c700 1 -- 172.21.15.102:0/2341899834 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090819051 0 0) 0x7ff9d8001110 con 0x7ff9e8159020 2024-08-17T02:29:13.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9eec9f700 1 -- 172.21.15.102:0/2341899834 >> v1:172.21.15.102:6789/0 conn(0x7ff9e8159020 legacy=0x7ff9e80b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9eec9f700 1 -- 172.21.15.102:0/2341899834 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e80b2bd0 con 0x7ff9e80b0000 2024-08-17T02:29:13.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9eec9f700 1 --2- 172.21.15.102:0/2341899834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9e80b0000 0x7ff9e806bee0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8070d00 tx=0x7ff9e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33160d120d10b4e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9ed49c700 1 -- 172.21.15.102:0/2341899834 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e000e070 con 0x7ff9e80b0000 2024-08-17T02:29:13.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9ed49c700 1 -- 172.21.15.102:0/2341899834 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e000bb60 con 0x7ff9e80b0000 2024-08-17T02:29:13.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9ed49c700 1 -- 172.21.15.102:0/2341899834 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0012430 con 0x7ff9e80b0000 2024-08-17T02:29:13.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9f0702700 1 -- 172.21.15.102:0/2341899834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9e80b0000 msgr2=0x7ff9e806bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9f0702700 1 --2- 172.21.15.102:0/2341899834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9e80b0000 0x7ff9e806bee0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8070d00 tx=0x7ff9e0009780 comp rx=0 tx=0).stop 2024-08-17T02:29:13.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9f0702700 1 -- 172.21.15.102:0/2341899834 shutdown_connections 2024-08-17T02:29:13.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9f0702700 1 --2- 172.21.15.102:0/2341899834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9e80b0000 0x7ff9e806bee0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9f0702700 1 --2- 172.21.15.102:0/2341899834 >> v2:172.21.15.121:3300/0 conn(0x7ff9e81593f0 0x7ff9e806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9f0702700 1 -- 172.21.15.102:0/2341899834 >> 172.21.15.102:0/2341899834 conn(0x7ff9e806e2e0 msgr2=0x7ff9e806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9f0702700 1 -- 172.21.15.102:0/2341899834 shutdown_connections 2024-08-17T02:29:13.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9f0702700 1 -- 172.21.15.102:0/2341899834 wait complete. 2024-08-17T02:29:13.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9f0702700 1 Processor -- start 2024-08-17T02:29:13.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.265+0000 7ff9f0702700 1 -- start start 2024-08-17T02:29:13.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9f0702700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9e80b0000 0x7ff9e80caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9f0702700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9e8159020 0x7ff9e80aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9f0702700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9e81593f0 0x7ff9e80af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9f0702700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e8154640 con 0x7ff9e81593f0 2024-08-17T02:29:13.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9f0702700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e80aa470 con 0x7ff9e80b0000 2024-08-17T02:29:13.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9f0702700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e80a9860 con 0x7ff9e8159020 2024-08-17T02:29:13.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9eec9f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9e81593f0 0x7ff9e80af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9eec9f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9e81593f0 0x7ff9e80af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33870/0 (socket says 172.21.15.102:33870) 2024-08-17T02:29:13.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9eec9f700 1 -- 172.21.15.102:0/4285857838 learned_addr learned my addr 172.21.15.102:0/4285857838 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:13.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9ee49e700 1 --2- 172.21.15.102:0/4285857838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9e80b0000 0x7ff9e80caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9edc9d700 1 --2- 172.21.15.102:0/4285857838 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9e8159020 0x7ff9e80aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9eec9f700 1 -- 172.21.15.102:0/4285857838 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9e8159020 msgr2=0x7ff9e80aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9eec9f700 1 --2- 172.21.15.102:0/4285857838 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9e8159020 0x7ff9e80aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9eec9f700 1 -- 172.21.15.102:0/4285857838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9e80b0000 msgr2=0x7ff9e80caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9eec9f700 1 --2- 172.21.15.102:0/4285857838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9e80b0000 0x7ff9e80caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9eec9f700 1 -- 172.21.15.102:0/4285857838 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e0009a20 con 0x7ff9e81593f0 2024-08-17T02:29:13.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9eec9f700 1 --2- 172.21.15.102:0/4285857838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9e81593f0 0x7ff9e80af330 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8070db0 tx=0x7ff9e0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9de7fc700 1 -- 172.21.15.102:0/4285857838 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0027470 con 0x7ff9e81593f0 2024-08-17T02:29:13.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9de7fc700 1 -- 172.21.15.102:0/4285857838 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e00275d0 con 0x7ff9e81593f0 2024-08-17T02:29:13.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9de7fc700 1 -- 172.21.15.102:0/4285857838 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0027990 con 0x7ff9e81593f0 2024-08-17T02:29:13.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9f0702700 1 -- 172.21.15.102:0/4285857838 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e80a9b40 con 0x7ff9e81593f0 2024-08-17T02:29:13.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9f0702700 1 -- 172.21.15.102:0/4285857838 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e80aa100 con 0x7ff9e81593f0 2024-08-17T02:29:13.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.269+0000 7ff9f0702700 1 -- 172.21.15.102:0/4285857838 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e80aa600 con 0x7ff9e81593f0 2024-08-17T02:29:13.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.273+0000 7ff9de7fc700 1 -- 172.21.15.102:0/4285857838 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff9e0024070 con 0x7ff9e81593f0 2024-08-17T02:29:13.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.273+0000 7ff9de7fc700 1 --2- 172.21.15.102:0/4285857838 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff9cc060860 0x7ff9cc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.273+0000 7ff9de7fc700 1 -- 172.21.15.102:0/4285857838 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff9e007f440 con 0x7ff9e81593f0 2024-08-17T02:29:13.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.273+0000 7ff9ee49e700 1 --2- 172.21.15.102:0/4285857838 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff9cc060860 0x7ff9cc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.273+0000 7ff9ee49e700 1 --2- 172.21.15.102:0/4285857838 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff9cc060860 0x7ff9cc062d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8006fc0 tx=0x7ff9d8007b90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.281+0000 7ff9de7fc700 1 -- 172.21.15.102:0/4285857838 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff9e004fa90 con 0x7ff9e81593f0 2024-08-17T02:29:13.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.445+0000 7ff9f0702700 1 -- 172.21.15.102:0/4285857838 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff9e80645c0 con 0x7ff9e81593f0 2024-08-17T02:29:13.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.453+0000 7ff9de7fc700 1 -- 172.21.15.102:0/4285857838 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff9e0009880 con 0x7ff9e81593f0 2024-08-17T02:29:13.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.457+0000 7ff9f0702700 1 -- 172.21.15.102:0/4285857838 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff9cc060860 msgr2=0x7ff9cc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.457+0000 7ff9f0702700 1 --2- 172.21.15.102:0/4285857838 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff9cc060860 0x7ff9cc062d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8006fc0 tx=0x7ff9d8007b90 comp rx=0 tx=0).stop 2024-08-17T02:29:13.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.457+0000 7ff9f0702700 1 -- 172.21.15.102:0/4285857838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9e81593f0 msgr2=0x7ff9e80af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.457+0000 7ff9f0702700 1 --2- 172.21.15.102:0/4285857838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9e81593f0 0x7ff9e80af330 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8070db0 tx=0x7ff9e0019000 comp rx=0 tx=0).stop 2024-08-17T02:29:13.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.457+0000 7ff9f0702700 1 -- 172.21.15.102:0/4285857838 shutdown_connections 2024-08-17T02:29:13.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.457+0000 7ff9f0702700 1 --2- 172.21.15.102:0/4285857838 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff9cc060860 0x7ff9cc062d10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.457+0000 7ff9f0702700 1 --2- 172.21.15.102:0/4285857838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9e81593f0 0x7ff9e80af330 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.457+0000 7ff9f0702700 1 --2- 172.21.15.102:0/4285857838 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff9e8159020 0x7ff9e80aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.457+0000 7ff9f0702700 1 --2- 172.21.15.102:0/4285857838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9e80b0000 0x7ff9e80caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.457+0000 7ff9f0702700 1 -- 172.21.15.102:0/4285857838 >> 172.21.15.102:0/4285857838 conn(0x7ff9e806e2e0 msgr2=0x7ff9e80cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.457+0000 7ff9f0702700 1 -- 172.21.15.102:0/4285857838 shutdown_connections 2024-08-17T02:29:13.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.457+0000 7ff9f0702700 1 -- 172.21.15.102:0/4285857838 wait complete. 2024-08-17T02:29:13.472 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:29:13.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e41305700 1 Processor -- start 2024-08-17T02:29:13.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e41305700 1 -- start start 2024-08-17T02:29:13.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e41305700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1e3c15aa30 0x7f1e3c15a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e41305700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1e3c0b3b30 0x7f1e3c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e41305700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c15a820 con 0x7f1e3c0aac50 2024-08-17T02:29:13.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e41305700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c15bc90 con 0x7f1e3c0b3b30 2024-08-17T02:29:13.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e41305700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c0b4470 con 0x7f1e3c15aa30 2024-08-17T02:29:13.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e3affd700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1e3c0aac50 0x7f1e3c1574a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55908/0 (socket says 172.21.15.102:55908) 2024-08-17T02:29:13.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e3affd700 1 -- 172.21.15.102:0/2259615694 learned_addr learned my addr 172.21.15.102:0/2259615694 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:13.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e3b7fe700 1 --2- 172.21.15.102:0/2259615694 >> v2:172.21.15.102:3300/0 conn(0x7f1e3c0b3b30 0x7f1e3c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e3a7fc700 1 --2- 172.21.15.102:0/2259615694 >> v2:172.21.15.121:3300/0 conn(0x7f1e3c15aa30 0x7f1e3c15a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e39ffb700 1 -- 172.21.15.102:0/2259615694 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1795779528 0 0) 0x7f1e2c001610 con 0x7f1e3c0aac50 2024-08-17T02:29:13.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e39ffb700 1 -- 172.21.15.102:0/2259615694 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e28003570 con 0x7f1e3c0aac50 2024-08-17T02:29:13.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e3b7fe700 1 -- 172.21.15.102:0/2259615694 >> v2:172.21.15.121:3300/0 conn(0x7f1e3c15aa30 msgr2=0x7f1e3c15a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:13.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e3b7fe700 1 --2- 172.21.15.102:0/2259615694 >> v2:172.21.15.121:3300/0 conn(0x7f1e3c15aa30 0x7f1e3c15a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e3b7fe700 1 -- 172.21.15.102:0/2259615694 >> v1:172.21.15.102:6789/0 conn(0x7f1e3c0aac50 legacy=0x7f1e3c1574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e3b7fe700 1 -- 172.21.15.102:0/2259615694 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c15b010 con 0x7f1e3c0b3b30 2024-08-17T02:29:13.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e3b7fe700 1 --2- 172.21.15.102:0/2259615694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3c0b3b30 0x7f1e3c0b3f30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c08a590 tx=0x7f1e340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f16591b2c4e2ab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e39ffb700 1 -- 172.21.15.102:0/2259615694 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34011630 con 0x7f1e3c0b3b30 2024-08-17T02:29:13.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e39ffb700 1 -- 172.21.15.102:0/2259615694 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e34011790 con 0x7f1e3c0b3b30 2024-08-17T02:29:13.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.577+0000 7f1e39ffb700 1 -- 172.21.15.102:0/2259615694 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34011b30 con 0x7f1e3c0b3b30 2024-08-17T02:29:13.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.581+0000 7f1e41305700 1 -- 172.21.15.102:0/2259615694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3c0b3b30 msgr2=0x7f1e3c0b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.581+0000 7f1e41305700 1 --2- 172.21.15.102:0/2259615694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3c0b3b30 0x7f1e3c0b3f30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c08a590 tx=0x7f1e340091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.581+0000 7f1e41305700 1 -- 172.21.15.102:0/2259615694 shutdown_connections 2024-08-17T02:29:13.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.581+0000 7f1e41305700 1 --2- 172.21.15.102:0/2259615694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3c0b3b30 0x7f1e3c0b3f30 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.581+0000 7f1e41305700 1 --2- 172.21.15.102:0/2259615694 >> v2:172.21.15.121:3300/0 conn(0x7f1e3c15aa30 0x7f1e3c15a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.581+0000 7f1e41305700 1 -- 172.21.15.102:0/2259615694 >> 172.21.15.102:0/2259615694 conn(0x7f1e3c0994d0 msgr2=0x7f1e3c0675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.581+0000 7f1e41305700 1 -- 172.21.15.102:0/2259615694 shutdown_connections 2024-08-17T02:29:13.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.581+0000 7f1e41305700 1 -- 172.21.15.102:0/2259615694 wait complete. 2024-08-17T02:29:13.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.581+0000 7f1e41305700 1 Processor -- start 2024-08-17T02:29:13.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.581+0000 7f1e41305700 1 -- start start 2024-08-17T02:29:13.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e41305700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1e3c0aac50 0x7f1e3c09d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e41305700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e3c0b3b30 0x7f1e3c15bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e41305700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3c15aa30 0x7f1e3c0b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e41305700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c169ed0 con 0x7f1e3c15aa30 2024-08-17T02:29:13.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e41305700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c169630 con 0x7f1e3c0b3b30 2024-08-17T02:29:13.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e41305700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c169910 con 0x7f1e3c0aac50 2024-08-17T02:29:13.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e3b7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3c15aa30 0x7f1e3c0b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e3b7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3c15aa30 0x7f1e3c0b17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33898/0 (socket says 172.21.15.102:33898) 2024-08-17T02:29:13.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e3b7fe700 1 -- 172.21.15.102:0/3837869842 learned_addr learned my addr 172.21.15.102:0/3837869842 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:13.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e3affd700 1 --2- 172.21.15.102:0/3837869842 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1e3c0aac50 0x7f1e3c09d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e3a7fc700 1 --2- 172.21.15.102:0/3837869842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e3c0b3b30 0x7f1e3c15bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e3b7fe700 1 -- 172.21.15.102:0/3837869842 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1e3c0aac50 msgr2=0x7f1e3c09d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e3b7fe700 1 --2- 172.21.15.102:0/3837869842 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1e3c0aac50 0x7f1e3c09d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e3b7fe700 1 -- 172.21.15.102:0/3837869842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e3c0b3b30 msgr2=0x7f1e3c15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e3b7fe700 1 --2- 172.21.15.102:0/3837869842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e3c0b3b30 0x7f1e3c15bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e3b7fe700 1 -- 172.21.15.102:0/3837869842 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e34009420 con 0x7f1e3c15aa30 2024-08-17T02:29:13.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e3b7fe700 1 --2- 172.21.15.102:0/3837869842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3c15aa30 0x7f1e3c0b17b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c067de0 tx=0x7f1e34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e32ffd700 1 -- 172.21.15.102:0/3837869842 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34011b10 con 0x7f1e3c15aa30 2024-08-17T02:29:13.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e32ffd700 1 -- 172.21.15.102:0/3837869842 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e340233f0 con 0x7f1e3c15aa30 2024-08-17T02:29:13.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e41305700 1 -- 172.21.15.102:0/3837869842 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c169bf0 con 0x7f1e3c15aa30 2024-08-17T02:29:13.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e32ffd700 1 -- 172.21.15.102:0/3837869842 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34023790 con 0x7f1e3c15aa30 2024-08-17T02:29:13.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e41305700 1 -- 172.21.15.102:0/3837869842 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c15c4f0 con 0x7f1e3c15aa30 2024-08-17T02:29:13.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.585+0000 7f1e41305700 1 -- 172.21.15.102:0/3837869842 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c09ae10 con 0x7f1e3c15aa30 2024-08-17T02:29:13.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.589+0000 7f1e32ffd700 1 -- 172.21.15.102:0/3837869842 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1e340193b0 con 0x7f1e3c15aa30 2024-08-17T02:29:13.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.589+0000 7f1e32ffd700 1 --2- 172.21.15.102:0/3837869842 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1e1c060860 0x7f1e1c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.589+0000 7f1e32ffd700 1 -- 172.21.15.102:0/3837869842 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1e3407dfb0 con 0x7f1e3c15aa30 2024-08-17T02:29:13.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.589+0000 7f1e3affd700 1 --2- 172.21.15.102:0/3837869842 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1e1c060860 0x7f1e1c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.589+0000 7f1e3affd700 1 --2- 172.21.15.102:0/3837869842 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1e1c060860 0x7f1e1c062d10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c001770 tx=0x7f1e2c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.597+0000 7f1e32ffd700 1 -- 172.21.15.102:0/3837869842 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1e340ae480 con 0x7f1e3c15aa30 2024-08-17T02:29:13.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:13.821+0000 7f1e41305700 1 -- 172.21.15.102:0/3837869842 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f1e3c0645c0 con 0x7f1e3c15aa30 2024-08-17T02:29:14.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:14.133+0000 7f1e32ffd700 1 -- 172.21.15.102:0/3837869842 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v149) v1 ==== 135+0+0 (secure 0 0 0) 0x7f1e340150c0 con 0x7f1e3c15aa30 2024-08-17T02:29:14.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:14.137+0000 7f1e41305700 1 -- 172.21.15.102:0/3837869842 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1e1c060860 msgr2=0x7f1e1c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:14.137+0000 7f1e41305700 1 --2- 172.21.15.102:0/3837869842 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1e1c060860 0x7f1e1c062d10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c001770 tx=0x7f1e2c009040 comp rx=0 tx=0).stop 2024-08-17T02:29:14.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:14.137+0000 7f1e41305700 1 -- 172.21.15.102:0/3837869842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3c15aa30 msgr2=0x7f1e3c0b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:14.137+0000 7f1e41305700 1 --2- 172.21.15.102:0/3837869842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3c15aa30 0x7f1e3c0b17b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c067de0 tx=0x7f1e34017000 comp rx=0 tx=0).stop 2024-08-17T02:29:14.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:14.137+0000 7f1e41305700 1 -- 172.21.15.102:0/3837869842 shutdown_connections 2024-08-17T02:29:14.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:14.137+0000 7f1e41305700 1 --2- 172.21.15.102:0/3837869842 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f1e1c060860 0x7f1e1c062d10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:14.137+0000 7f1e41305700 1 --2- 172.21.15.102:0/3837869842 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e3c15aa30 0x7f1e3c0b17b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:14.137+0000 7f1e41305700 1 --2- 172.21.15.102:0/3837869842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e3c0b3b30 0x7f1e3c15bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:14.137+0000 7f1e41305700 1 --2- 172.21.15.102:0/3837869842 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1e3c0aac50 0x7f1e3c09d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:14.137+0000 7f1e41305700 1 -- 172.21.15.102:0/3837869842 >> 172.21.15.102:0/3837869842 conn(0x7f1e3c0994d0 msgr2=0x7f1e3c0afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:14.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:14.137+0000 7f1e41305700 1 -- 172.21.15.102:0/3837869842 shutdown_connections 2024-08-17T02:29:14.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:14.137+0000 7f1e41305700 1 -- 172.21.15.102:0/3837869842 wait complete. 2024-08-17T02:29:14.159 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:29:14.159 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:14.159 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:29:14.160 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:14.160 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:29:14.160 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:29:14.160 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:29:14.160 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:29:14.160 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:29:14.160 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:29:14.160 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:29:14.160 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:29:14.160 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:29:14.160 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:29:14.160 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:29:14.160 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:29:14.160 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:29:14.160 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:29:14.161 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:29:14.161 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:29:14.161 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:29:14.161 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:29:14.161 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:29:14.161 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:29:14.161 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:29:14.161 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi102 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000658238 --yes-i-really-mean-it' 2024-08-17T02:29:14.161 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:14.161 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:29:14.161 INFO:tasks.cephfs_test_runner:Ran 1 test in 168.225s 2024-08-17T02:29:14.161 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:14.161 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:29:14.161 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:14.161 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:29:14.162 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:14.162 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:29:14.162 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:29:14.162 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:29:14.162 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:29:14.162 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:29:14.162 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:29:14.162 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:29:14.162 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:29:14.162 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:29:14.162 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:29:14.162 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:29:14.162 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:29:14.162 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:29:14.162 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:29:14.162 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:29:14.163 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:29:14.163 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:29:14.163 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:29:14.163 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:29:14.163 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:29:14.163 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:29:14.163 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi102 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000658238 --yes-i-really-mean-it' 2024-08-17T02:29:14.163 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:14.163 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:14.389 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=064c69340f68449fb3b1bf23dd22311d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:14.391 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:29:14.401 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-08-17T02:29:14.415 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-08-17T02:29:14.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:14.415 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-08-17T02:29:14.431 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:29:14.432 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:29:14.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:14.432 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:29:14.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:14.488 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:29:14.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:14.502 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-08-17T02:29:14.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:14.656 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-08-17T02:29:14.664 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:29:14.664 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:29:14.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:14.665 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:29:14.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:14.679 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:29:14.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:14.741 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2024-08-17T02:29:14.887 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:29:14.897 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:29:14.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:15.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22ffff700 1 Processor -- start 2024-08-17T02:29:15.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22ffff700 1 -- start start 2024-08-17T02:29:15.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22ffff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2300af4d0 0x7ff2301557b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22ffff700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff230155e30 con 0x7ff2300686a0 2024-08-17T02:29:15.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22ffff700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff230156110 con 0x7ff2301553e0 2024-08-17T02:29:15.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22ffff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2301563f0 con 0x7ff2300af4d0 2024-08-17T02:29:15.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22f7fe700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff2300686a0 0x7ff2300abf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55916/0 (socket says 172.21.15.102:55916) 2024-08-17T02:29:15.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22f7fe700 1 -- 172.21.15.102:0/1797739316 learned_addr learned my addr 172.21.15.102:0/1797739316 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:15.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22e7fc700 1 --2- 172.21.15.102:0/1797739316 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2300af4d0 0x7ff2301557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 -- 172.21.15.102:0/1797739316 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056840298 0 0) 0x7ff230155e30 con 0x7ff2300686a0 2024-08-17T02:29:15.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 -- 172.21.15.102:0/1797739316 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff218003570 con 0x7ff2300686a0 2024-08-17T02:29:15.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 -- 172.21.15.102:0/1797739316 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350127026 0 0) 0x7ff230156110 con 0x7ff2301553e0 2024-08-17T02:29:15.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 -- 172.21.15.102:0/1797739316 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff230155e30 con 0x7ff2301553e0 2024-08-17T02:29:15.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 -- 172.21.15.102:0/1797739316 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2024874248 0 0) 0x7ff218003570 con 0x7ff2300686a0 2024-08-17T02:29:15.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 -- 172.21.15.102:0/1797739316 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2300af4d0 msgr2=0x7ff2301557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 --2- 172.21.15.102:0/1797739316 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2300af4d0 0x7ff2301557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 -- 172.21.15.102:0/1797739316 >> v1:172.21.15.121:6789/0 conn(0x7ff2301553e0 legacy=0x7ff2300b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 -- 172.21.15.102:0/1797739316 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2301566d0 con 0x7ff2300686a0 2024-08-17T02:29:15.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 -- 172.21.15.102:0/1797739316 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7ff2280017f0 con 0x7ff2300686a0 2024-08-17T02:29:15.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 -- 172.21.15.102:0/1797739316 >> v1:172.21.15.102:6789/0 conn(0x7ff2300686a0 legacy=0x7ff2300abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 --2- 172.21.15.102:0/1797739316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff218003c20 0x7ff218004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 --2- 172.21.15.102:0/1797739316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff218004810 0x7ff218004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 --2- 172.21.15.102:0/1797739316 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2300af4d0 0x7ff2180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 -- 172.21.15.102:0/1797739316 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2301563f0 con 0x7ff218004810 2024-08-17T02:29:15.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 -- 172.21.15.102:0/1797739316 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21800cc50 con 0x7ff218003c20 2024-08-17T02:29:15.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.005+0000 7ff22dffb700 1 -- 172.21.15.102:0/1797739316 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21800ce10 con 0x7ff2300af4d0 2024-08-17T02:29:15.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22e7fc700 1 --2- 172.21.15.102:0/1797739316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff218004810 0x7ff218004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22f7fe700 1 --2- 172.21.15.102:0/1797739316 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2300af4d0 0x7ff2180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22effd700 1 --2- 172.21.15.102:0/1797739316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff218003c20 0x7ff218004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22e7fc700 1 -- 172.21.15.102:0/1797739316 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2300af4d0 msgr2=0x7ff2180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22e7fc700 1 --2- 172.21.15.102:0/1797739316 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2300af4d0 0x7ff2180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22e7fc700 1 -- 172.21.15.102:0/1797739316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff218003c20 msgr2=0x7ff218004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22e7fc700 1 --2- 172.21.15.102:0/1797739316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff218003c20 0x7ff218004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22e7fc700 1 -- 172.21.15.102:0/1797739316 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff218003570 con 0x7ff218004810 2024-08-17T02:29:15.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22e7fc700 1 --2- 172.21.15.102:0/1797739316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff218004810 0x7ff218004c80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff224009c00 tx=0x7ff2240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224436754f964344 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22dffb700 1 -- 172.21.15.102:0/1797739316 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22400e710 con 0x7ff218004810 2024-08-17T02:29:15.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22dffb700 1 -- 172.21.15.102:0/1797739316 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22400e870 con 0x7ff218004810 2024-08-17T02:29:15.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22dffb700 1 -- 172.21.15.102:0/1797739316 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22400ec30 con 0x7ff218004810 2024-08-17T02:29:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22ffff700 1 -- 172.21.15.102:0/1797739316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff218004810 msgr2=0x7ff218004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22ffff700 1 --2- 172.21.15.102:0/1797739316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff218004810 0x7ff218004c80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff224009c00 tx=0x7ff2240091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22f7fe700 1 -- 172.21.15.102:0/1797739316 reap_dead start 2024-08-17T02:29:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22ffff700 1 -- 172.21.15.102:0/1797739316 shutdown_connections 2024-08-17T02:29:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22ffff700 1 -- 172.21.15.102:0/1797739316 >> 172.21.15.102:0/1797739316 conn(0x7ff23006d800 msgr2=0x7ff23006dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22ffff700 1 -- 172.21.15.102:0/1797739316 shutdown_connections 2024-08-17T02:29:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22ffff700 1 -- 172.21.15.102:0/1797739316 wait complete. 2024-08-17T02:29:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22ffff700 1 Processor -- start 2024-08-17T02:29:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.009+0000 7ff22ffff700 1 -- start start 2024-08-17T02:29:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22ffff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff218004810 0x7ff2300a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22ffff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2300a6690 0x7ff2300a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22ffff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff230153250 0x7ff2301536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22ffff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff230153c00 con 0x7ff218004810 2024-08-17T02:29:15.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22ffff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300a7cf0 con 0x7ff230153250 2024-08-17T02:29:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22ffff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300a70e0 con 0x7ff2300a6690 2024-08-17T02:29:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22effd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff218004810 0x7ff2300a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22effd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff218004810 0x7ff2300a95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33918/0 (socket says 172.21.15.102:33918) 2024-08-17T02:29:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22effd700 1 -- 172.21.15.102:0/3912806887 learned_addr learned my addr 172.21.15.102:0/3912806887 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22e7fc700 1 --2- 172.21.15.102:0/3912806887 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2300a6690 0x7ff2300a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22f7fe700 1 --2- 172.21.15.102:0/3912806887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff230153250 0x7ff2301536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22effd700 1 -- 172.21.15.102:0/3912806887 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2300a6690 msgr2=0x7ff2300a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22effd700 1 --2- 172.21.15.102:0/3912806887 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2300a6690 0x7ff2300a6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22effd700 1 -- 172.21.15.102:0/3912806887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff230153250 msgr2=0x7ff2301536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22effd700 1 --2- 172.21.15.102:0/3912806887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff230153250 0x7ff2301536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22effd700 1 -- 172.21.15.102:0/3912806887 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2300a73c0 con 0x7ff218004810 2024-08-17T02:29:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22effd700 1 --2- 172.21.15.102:0/3912806887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff218004810 0x7ff2300a95e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff22000e840 tx=0x7ff220009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff216ffd700 1 -- 172.21.15.102:0/3912806887 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220013700 con 0x7ff218004810 2024-08-17T02:29:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff216ffd700 1 -- 172.21.15.102:0/3912806887 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff220013860 con 0x7ff218004810 2024-08-17T02:29:15.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff216ffd700 1 -- 172.21.15.102:0/3912806887 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220013c20 con 0x7ff218004810 2024-08-17T02:29:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22ffff700 1 -- 172.21.15.102:0/3912806887 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2300a76a0 con 0x7ff218004810 2024-08-17T02:29:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22ffff700 1 -- 172.21.15.102:0/3912806887 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2300a9b20 con 0x7ff218004810 2024-08-17T02:29:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff22ffff700 1 -- 172.21.15.102:0/3912806887 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2300638f0 con 0x7ff218004810 2024-08-17T02:29:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.013+0000 7ff216ffd700 1 -- 172.21.15.102:0/3912806887 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff2200023c0 con 0x7ff218004810 2024-08-17T02:29:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.017+0000 7ff216ffd700 1 --2- 172.21.15.102:0/3912806887 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff21c060890 0x7ff21c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.017+0000 7ff216ffd700 1 -- 172.21.15.102:0/3912806887 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff22007cf80 con 0x7ff218004810 2024-08-17T02:29:15.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.017+0000 7ff22e7fc700 1 --2- 172.21.15.102:0/3912806887 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff21c060890 0x7ff21c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.017+0000 7ff22e7fc700 1 --2- 172.21.15.102:0/3912806887 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff21c060890 0x7ff21c062d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff2300a6620 tx=0x7ff22401a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.021+0000 7ff216ffd700 1 -- 172.21.15.102:0/3912806887 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff2200ad480 con 0x7ff218004810 2024-08-17T02:29:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.189+0000 7ff22ffff700 1 -- 172.21.15.102:0/3912806887 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2300a7b20 con 0x7ff218004810 2024-08-17T02:29:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.193+0000 7ff216ffd700 1 -- 172.21.15.102:0/3912806887 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+12445 (secure 0 0 0) 0x7ff22004d670 con 0x7ff218004810 2024-08-17T02:29:15.194 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:15.195 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":42,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:29:13.112003+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6835/2189006578":"2024-08-18T02:29:10.097147+0000","172.21.15.121:6834/2189006578":"2024-08-18T02:29:10.097147+0000","172.21.15.102:6837/1340437033":"2024-08-18T02:29:03.879648+0000","172.21.15.102:6836/1340437033":"2024-08-18T02:29:03.879648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.193+0000 7ff22ffff700 1 -- 172.21.15.102:0/3912806887 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff21c060890 msgr2=0x7ff21c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.193+0000 7ff22ffff700 1 --2- 172.21.15.102:0/3912806887 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff21c060890 0x7ff21c062d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff2300a6620 tx=0x7ff22401a000 comp rx=0 tx=0).stop 2024-08-17T02:29:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.193+0000 7ff22ffff700 1 -- 172.21.15.102:0/3912806887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff218004810 msgr2=0x7ff2300a95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.193+0000 7ff22ffff700 1 --2- 172.21.15.102:0/3912806887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff218004810 0x7ff2300a95e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff22000e840 tx=0x7ff220009040 comp rx=0 tx=0).stop 2024-08-17T02:29:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.193+0000 7ff22ffff700 1 -- 172.21.15.102:0/3912806887 shutdown_connections 2024-08-17T02:29:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.193+0000 7ff22ffff700 1 --2- 172.21.15.102:0/3912806887 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7ff21c060890 0x7ff21c062d40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.193+0000 7ff22ffff700 1 --2- 172.21.15.102:0/3912806887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff230153250 0x7ff2301536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.193+0000 7ff22ffff700 1 --2- 172.21.15.102:0/3912806887 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7ff2300a6690 0x7ff2300a6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.193+0000 7ff22ffff700 1 --2- 172.21.15.102:0/3912806887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff218004810 0x7ff2300a95e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.193+0000 7ff22ffff700 1 -- 172.21.15.102:0/3912806887 >> 172.21.15.102:0/3912806887 conn(0x7ff23006d800 msgr2=0x7ff23006ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.193+0000 7ff22ffff700 1 -- 172.21.15.102:0/3912806887 shutdown_connections 2024-08-17T02:29:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.193+0000 7ff22ffff700 1 -- 172.21.15.102:0/3912806887 wait complete. 2024-08-17T02:29:15.207 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:29:15.207 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:15.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.309+0000 7fad030bb700 1 Processor -- start 2024-08-17T02:29:15.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.309+0000 7fad030bb700 1 -- start start 2024-08-17T02:29:15.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.309+0000 7fad030bb700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7facfc06e9d0 0x7facfc06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad030bb700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7facfc0ab540 0x7facfc0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad030bb700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facfc0aba70 con 0x7facfc155010 2024-08-17T02:29:15.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad030bb700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facfc0abd50 con 0x7facfc0ab540 2024-08-17T02:29:15.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad030bb700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc0ac030 con 0x7facfc06e9d0 2024-08-17T02:29:15.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad018b8700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7facfc0ab540 0x7facfc0b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad028ba700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7facfc155010 0x7facfc155470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55918/0 (socket says 172.21.15.102:55918) 2024-08-17T02:29:15.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad028ba700 1 -- 172.21.15.102:0/2911952506 learned_addr learned my addr 172.21.15.102:0/2911952506 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:15.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad020b9700 1 --2- 172.21.15.102:0/2911952506 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7facfc06e9d0 0x7facfc06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad018b8700 1 -- 172.21.15.102:0/2911952506 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7facfc06e9d0 msgr2=0x7facfc06eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad018b8700 1 --2- 172.21.15.102:0/2911952506 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7facfc06e9d0 0x7facfc06eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad018b8700 1 -- 172.21.15.102:0/2911952506 >> v1:172.21.15.102:6789/0 conn(0x7facfc155010 legacy=0x7facfc155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad018b8700 1 -- 172.21.15.102:0/2911952506 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc0ac310 con 0x7facfc0ab540 2024-08-17T02:29:15.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad010b7700 1 -- 172.21.15.102:0/2911952506 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623337875 0 0) 0x7facfc0aba70 con 0x7facfc155010 2024-08-17T02:29:15.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad018b8700 1 --2- 172.21.15.102:0/2911952506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facfc0ab540 0x7facfc0b1320 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7facf80098e0 tx=0x7facf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be890177af5da552 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad010b7700 1 -- 172.21.15.102:0/2911952506 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8009e80 con 0x7facfc0ab540 2024-08-17T02:29:15.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad010b7700 1 -- 172.21.15.102:0/2911952506 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf800b860 con 0x7facfc0ab540 2024-08-17T02:29:15.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad010b7700 1 -- 172.21.15.102:0/2911952506 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf800bbe0 con 0x7facfc0ab540 2024-08-17T02:29:15.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad030bb700 1 -- 172.21.15.102:0/2911952506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facfc0ab540 msgr2=0x7facfc0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad030bb700 1 --2- 172.21.15.102:0/2911952506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facfc0ab540 0x7facfc0b1320 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7facf80098e0 tx=0x7facf80091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad030bb700 1 -- 172.21.15.102:0/2911952506 shutdown_connections 2024-08-17T02:29:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad030bb700 1 --2- 172.21.15.102:0/2911952506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facfc0ab540 0x7facfc0b1320 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad030bb700 1 --2- 172.21.15.102:0/2911952506 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7facfc06e9d0 0x7facfc06eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad030bb700 1 -- 172.21.15.102:0/2911952506 >> 172.21.15.102:0/2911952506 conn(0x7facfc0678d0 msgr2=0x7facfc067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad030bb700 1 -- 172.21.15.102:0/2911952506 shutdown_connections 2024-08-17T02:29:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.313+0000 7fad030bb700 1 -- 172.21.15.102:0/2911952506 wait complete. 2024-08-17T02:29:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad030bb700 1 Processor -- start 2024-08-17T02:29:15.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad030bb700 1 -- start start 2024-08-17T02:29:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad030bb700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facfc06e9d0 0x7facfc15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad030bb700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facfc0ab540 0x7facfc0aa290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad030bb700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7facfc155010 0x7facfc1678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad030bb700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc0a7ea0 con 0x7facfc0ab540 2024-08-17T02:29:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad030bb700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc15ca20 con 0x7facfc06e9d0 2024-08-17T02:29:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad030bb700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc0a7b70 con 0x7facfc155010 2024-08-17T02:29:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad018b8700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facfc0ab540 0x7facfc0aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad018b8700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facfc0ab540 0x7facfc0aa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33934/0 (socket says 172.21.15.102:33934) 2024-08-17T02:29:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad018b8700 1 -- 172.21.15.102:0/4153855978 learned_addr learned my addr 172.21.15.102:0/4153855978 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad020b9700 1 --2- 172.21.15.102:0/4153855978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facfc06e9d0 0x7facfc15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad028ba700 1 --2- 172.21.15.102:0/4153855978 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7facfc155010 0x7facfc1678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad018b8700 1 -- 172.21.15.102:0/4153855978 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7facfc155010 msgr2=0x7facfc1678a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad018b8700 1 --2- 172.21.15.102:0/4153855978 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7facfc155010 0x7facfc1678a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad018b8700 1 -- 172.21.15.102:0/4153855978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facfc06e9d0 msgr2=0x7facfc15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad018b8700 1 --2- 172.21.15.102:0/4153855978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facfc06e9d0 0x7facfc15c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad018b8700 1 -- 172.21.15.102:0/4153855978 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf8009420 con 0x7facfc0ab540 2024-08-17T02:29:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad018b8700 1 --2- 172.21.15.102:0/4153855978 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facfc0ab540 0x7facfc0aa290 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7facf800b3c0 tx=0x7facf8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7facf27fc700 1 -- 172.21.15.102:0/4153855978 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf800bbe0 con 0x7facfc0ab540 2024-08-17T02:29:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7facf27fc700 1 -- 172.21.15.102:0/4153855978 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf8000c90 con 0x7facfc0ab540 2024-08-17T02:29:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad030bb700 1 -- 172.21.15.102:0/4153855978 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facfc0aabe0 con 0x7facfc0ab540 2024-08-17T02:29:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7facf27fc700 1 -- 172.21.15.102:0/4153855978 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8011690 con 0x7facfc0ab540 2024-08-17T02:29:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.317+0000 7fad030bb700 1 -- 172.21.15.102:0/4153855978 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facfc0ab1a0 con 0x7facfc0ab540 2024-08-17T02:29:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.321+0000 7fad030bb700 1 -- 172.21.15.102:0/4153855978 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facfc0643a0 con 0x7facfc0ab540 2024-08-17T02:29:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.321+0000 7facf27fc700 1 -- 172.21.15.102:0/4153855978 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7facf8011a80 con 0x7facfc0ab540 2024-08-17T02:29:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.321+0000 7facf27fc700 1 --2- 172.21.15.102:0/4153855978 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7face0060860 0x7face0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.321+0000 7facf27fc700 1 -- 172.21.15.102:0/4153855978 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7facf807e210 con 0x7facfc0ab540 2024-08-17T02:29:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.321+0000 7fad020b9700 1 --2- 172.21.15.102:0/4153855978 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7face0060860 0x7face0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.321+0000 7fad020b9700 1 --2- 172.21.15.102:0/4153855978 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7face0060860 0x7face0062d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7facec006fd0 tx=0x7facec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.329+0000 7facf27fc700 1 -- 172.21.15.102:0/4153855978 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7facf804e900 con 0x7facfc0ab540 2024-08-17T02:29:15.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.485+0000 7fad030bb700 1 -- 172.21.15.102:0/4153855978 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7facfc06f5f0 con 0x7face0060860 2024-08-17T02:29:15.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.489+0000 7facf27fc700 1 -- 172.21.15.102:0/4153855978 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49323 (secure 0 0 0) 0x7facfc06f5f0 con 0x7face0060860 2024-08-17T02:29:15.494 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:15.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.493+0000 7fad030bb700 1 -- 172.21.15.102:0/4153855978 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7face0060860 msgr2=0x7face0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.493+0000 7fad030bb700 1 --2- 172.21.15.102:0/4153855978 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7face0060860 0x7face0062d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7facec006fd0 tx=0x7facec008040 comp rx=0 tx=0).stop 2024-08-17T02:29:15.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.493+0000 7fad030bb700 1 -- 172.21.15.102:0/4153855978 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facfc0ab540 msgr2=0x7facfc0aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.493+0000 7fad030bb700 1 --2- 172.21.15.102:0/4153855978 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facfc0ab540 0x7facfc0aa290 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7facf800b3c0 tx=0x7facf8017000 comp rx=0 tx=0).stop 2024-08-17T02:29:15.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.493+0000 7fad030bb700 1 -- 172.21.15.102:0/4153855978 shutdown_connections 2024-08-17T02:29:15.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.493+0000 7fad030bb700 1 --2- 172.21.15.102:0/4153855978 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7face0060860 0x7face0062d10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.493+0000 7fad030bb700 1 --2- 172.21.15.102:0/4153855978 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facfc0ab540 0x7facfc0aa290 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.493+0000 7fad030bb700 1 --2- 172.21.15.102:0/4153855978 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7facfc155010 0x7facfc1678a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.493+0000 7fad030bb700 1 --2- 172.21.15.102:0/4153855978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facfc06e9d0 0x7facfc15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.493+0000 7fad030bb700 1 -- 172.21.15.102:0/4153855978 >> 172.21.15.102:0/4153855978 conn(0x7facfc0678d0 msgr2=0x7facfc151fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.493+0000 7fad030bb700 1 -- 172.21.15.102:0/4153855978 shutdown_connections 2024-08-17T02:29:15.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.493+0000 7fad030bb700 1 -- 172.21.15.102:0/4153855978 wait complete. 2024-08-17T02:29:15.498 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-08-17T02:29:15.508 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-08-17T02:29:15.253427+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2396316,"kb_used_data":4976,"kb_used_omap":13,"kb_used_meta":2391218,"kb_avail":752578404,"statfs":{"total":773094113280,"available":770640285696,"internally_reserved":0,"allocated":5095424,"data_stored":2786980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2448607936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001508"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-17T02:29:10.304381+0000","last_change":"2024-08-17T02:25:51.241912+0000","last_active":"2024-08-17T02:29:10.304381+0000","last_peered":"2024-08-17T02:29:10.304381+0000","last_clean":"2024-08-17T02:29:10.304381+0000","last_became_active":"2024-08-17T02:25:51.239655+0000","last_became_peered":"2024-08-17T02:25:51.239655+0000","last_unstale":"2024-08-17T02:29:10.304381+0000","last_undegraded":"2024-08-17T02:29:10.304381+0000","last_fullsized":"2024-08-17T02:29:10.304381+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_clean_scrub_stamp":"2024-08-17T02:25:49.863184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:53.845381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298420,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073420,"statfs":{"total":96636764160,"available":96331182080,"internally_reserved":0,"allocated":1089536,"data_stored":794518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94399999999999995,"15min":0.94299999999999995},"min":{"1min":0.64400000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.034,"15min":1.0309999999999999},"min":{"1min":0.78400000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.2450000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.145}]},{"osd":1,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.90700000000000003,"15min":0.91800000000000004},"min":{"1min":0.66300000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1319999999999999,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.879,"5min":0.89500000000000002,"15min":0.89800000000000002},"min":{"1min":0.65600000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2090000000000001,"5min":1.514,"15min":1.514},"last":0.94499999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.98299999999999998,"15min":1.0189999999999999},"min":{"1min":0.64100000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2170000000000001,"5min":1.669,"15min":1.669},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1200000000000001,"15min":1.1299999999999999},"min":{"1min":0.92900000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.258,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.1950000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.026,"15min":1.0600000000000001},"min":{"1min":0.71199999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.3140000000000001,"5min":1.778,"15min":1.778},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.101,"15min":1.1379999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.2330000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0860000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.98699999999999999,"15min":1.0189999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.1259999999999999,"5min":1.694,"15min":1.694},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.194,"15min":1.244},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.4430000000000001,"5min":1.893,"15min":1.893},"last":0.73099999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.165,"15min":1.234},"min":{"1min":0.749,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.238,"5min":1.681,"15min":1.681},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.1439999999999999,"15min":1.1859999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.2889999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.258}]},{"osd":6,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.21,"15min":1.264},"min":{"1min":0.84899999999999998,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.2470000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.169},{"interface":"front","average":{"1min":1.169,"5min":1.3100000000000001,"15min":1.3580000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.504,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.2190000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297816,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074024,"statfs":{"total":96636764160,"available":96331800576,"internally_reserved":0,"allocated":471040,"data_stored":193039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85899999999999999,"15min":0.85299999999999998},"min":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2070000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.65000000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1879999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.58799999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.86799999999999999,"15min":0.84499999999999997},"min":{"1min":0.64400000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.242,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96399999999999997,"15min":0.995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1879999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.226}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.85099999999999998,"15min":0.81999999999999995},"min":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.95799999999999996,"15min":0.95699999999999996},"min":{"1min":0.752,"5min":0.627,"15min":0.627},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.0369999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.93799999999999994,"15min":0.91900000000000004},"min":{"1min":0.64000000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.206,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0069999999999999,"15min":1.0189999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.24,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.083}]},{"osd":4,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.96099999999999997,"15min":0.97899999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1950000000000001,"5min":1.383,"15min":1.383},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.1439999999999999,"15min":1.163},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.298,"5min":1.544,"15min":1.544},"last":1.528}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.075,"15min":1.093},"min":{"1min":0.751,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.232,"5min":1.427,"15min":1.427},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.113,"15min":1.127},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3280000000000001,"5min":1.456,"15min":1.456},"last":1.663}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1080000000000001,"15min":1.1160000000000001},"min":{"1min":0.83699999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.3700000000000001,"5min":1.399,"15min":1.399},"last":1.296},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1739999999999999,"15min":1.1879999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2889999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.361}]}]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302000,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069840,"statfs":{"total":96636764160,"available":96327516160,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.89200000000000002,"15min":0.90400000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.169,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88,"15min":0.86699999999999999},"min":{"1min":0.64900000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.173,"5min":1.24,"15min":1.24},"last":0.89000000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.85199999999999998,"15min":0.85499999999999998},"min":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.93100000000000005,"15min":0.91200000000000003},"min":{"1min":0.65600000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.246,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.53800000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.86099999999999999,"15min":0.85299999999999998},"min":{"1min":0.60999999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98599999999999999,"15min":1.002},"min":{"1min":0.754,"5min":0.443,"15min":0.443},"max":{"1min":1.234,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.093}]},{"osd":3,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93600000000000005,"15min":0.93400000000000005},"min":{"1min":0.69899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1319999999999999,"5min":1.359,"15min":1.359},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.92000000000000004,"15min":0.91600000000000004},"min":{"1min":0.68200000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.1599999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.79200000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.97199999999999998,"15min":1.012},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1899999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.0569999999999999,"15min":1.075},"min":{"1min":0.67500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2769999999999999,"5min":1.409,"15min":1.409},"last":1.2929999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.998,"15min":1.0129999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1699999999999999,"5min":1.28,"15min":1.28},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.113,"5min":1.1259999999999999,"15min":1.1459999999999999},"min":{"1min":0.83499999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.256,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.4890000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.117,"15min":1.125},"min":{"1min":0.84599999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.3180000000000001,"5min":1.464,"15min":1.464},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.113,"15min":1.127},"min":{"1min":0.754,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.2989999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.1220000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301988,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":479232,"data_stored":198502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.873,"15min":0.88100000000000001},"min":{"1min":0.68300000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.131,"5min":1.47,"15min":1.47},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90900000000000003,"15min":0.90100000000000002},"min":{"1min":0.66700000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2350000000000001,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.99099999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.92200000000000004,"15min":0.93899999999999995},"min":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.1719999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.92000000000000004,"15min":0.90000000000000002},"min":{"1min":0.71099999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":1.0660000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.68799999999999994,"5min":0.626,"15min":0.626},"max":{"1min":1.252,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.018},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.0349999999999999,"15min":1.052},"min":{"1min":0.76500000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.044}]},{"osd":3,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.94399999999999995,"15min":0.95399999999999996},"min":{"1min":0.71799999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.171,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.997,"5min":1.0309999999999999,"15min":1.0549999999999999},"min":{"1min":0.84499999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2050000000000001,"5min":1.863,"15min":1.863},"last":0.878}]},{"osd":5,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.99399999999999999,"15min":1.0189999999999999},"min":{"1min":0.63800000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2649999999999999,"5min":1.401,"15min":1.401},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.98599999999999999,"15min":0.98099999999999998},"min":{"1min":0.69799999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3169999999999999,"5min":1.754,"15min":1.754},"last":0.67600000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.073,"15min":1.1000000000000001},"min":{"1min":0.65800000000000003,"5min":0.63,"15min":0.63},"max":{"1min":1.3,"5min":2.109,"15min":2.109},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1719999999999999,"15min":1.1879999999999999},"min":{"1min":0.91900000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.452,"5min":1.587,"15min":1.587},"last":0.93500000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.2210000000000001,"15min":1.276},"min":{"1min":0.77700000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.371,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.2390000000000001,"15min":1.2709999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.3049999999999999,"5min":2.202,"15min":2.202},"last":1.173}]}]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68000000000000005,"15min":0.68500000000000005},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66800000000000004,"15min":0.63700000000000001},"min":{"1min":0.53300000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92900000000000005,"5min":1.181,"15min":1.181},"last":0.52300000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.65600000000000003,"15min":0.63600000000000001},"min":{"1min":0.54000000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.745},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80400000000000005,"15min":0.79100000000000004},"min":{"1min":0.61899999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0569999999999999,"5min":1.161,"15min":1.161},"last":0.55900000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.82299999999999995,"15min":0.80500000000000005},"min":{"1min":0.748,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1279999999999999,"5min":1.411,"15min":1.411},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.58899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0820000000000001,"5min":1.099,"15min":1.099},"last":0.60099999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.94499999999999995,"15min":0.92600000000000005},"min":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.1870000000000001,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.98699999999999999,"15min":0.97799999999999998},"min":{"1min":0.753,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.97999999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0229999999999999,"15min":1.0209999999999999},"min":{"1min":0.749,"5min":0.624,"15min":0.624},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.099,"5min":1.101,"15min":1.099},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.3200000000000001,"5min":1.423,"15min":1.423},"last":1.006}]},{"osd":6,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1279999999999999,"15min":1.1120000000000001},"min":{"1min":0.88200000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0700000000000001,"15min":1.0580000000000001},"min":{"1min":0.89500000000000002,"5min":0.753,"15min":0.753},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.84099999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1279999999999999,"15min":1.1339999999999999},"min":{"1min":0.83099999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.319,"5min":1.913,"15min":1.913},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1459999999999999,"15min":1.1240000000000001},"min":{"1min":0.97399999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.5049999999999999,"5min":1.698,"15min":1.698},"last":1.1180000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542188,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297824,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074016,"statfs":{"total":96636764160,"available":96331792384,"internally_reserved":0,"allocated":479232,"data_stored":193953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.51700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.90100000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71399999999999997,"15min":0.70199999999999996},"min":{"1min":0.57399999999999995,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0840000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.99399999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78800000000000003,"15min":0.79700000000000004},"min":{"1min":0.63300000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1100000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.78500000000000003},"min":{"1min":0.59499999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95899999999999996,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.59999999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.90500000000000003,"15min":0.90700000000000003},"min":{"1min":0.65100000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.0880000000000001,"5min":1.258,"15min":1.258},"last":0.78500000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0760000000000001,"15min":1.1060000000000001},"min":{"1min":0.80500000000000005,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.236,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.02,"15min":1.0169999999999999},"min":{"1min":0.79400000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.256,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.202}]},{"osd":5,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.109,"15min":1.1160000000000001},"min":{"1min":0.83199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.375,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.222},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.105,"15min":1.1299999999999999},"min":{"1min":0.90300000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.2370000000000001,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.143}]},{"osd":6,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.091,"15min":1.1140000000000001},"min":{"1min":0.79600000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.1990000000000001,"5min":1.615,"15min":1.615},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2070000000000001,"15min":1.224},"min":{"1min":0.93700000000000006,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.403,"5min":1.681,"15min":1.681},"last":1.0620000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1819999999999999,"15min":1.198},"min":{"1min":0.94999999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.3979999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1539999999999999,"15min":1.1639999999999999},"min":{"1min":1.01,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3680000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.0900000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302000,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069840,"statfs":{"total":96636764160,"available":96327516160,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.76100000000000001},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1919999999999999,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77100000000000002,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99099999999999999,"5min":3.5209999999999999,"15min":3.5209999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.96999999999999997,"15min":1.0680000000000001},"min":{"1min":0.58399999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.302,"5min":9.1709999999999994,"15min":9.1709999999999994},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.90600000000000003,"15min":0.95699999999999996},"min":{"1min":0.58999999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.139,"5min":7.4320000000000004,"15min":7.4320000000000004},"last":0.72399999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":1.008,"15min":1.0860000000000001},"min":{"1min":0.70899999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.087,"5min":10.305,"15min":10.305},"last":0.88},{"interface":"front","average":{"1min":0.78200000000000003,"5min":1.0069999999999999,"15min":1.101},"min":{"1min":0.59199999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0549999999999999,"5min":10.105,"15min":10.105},"last":0.86099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.1259999999999999,"15min":1.1919999999999999},"min":{"1min":0.68200000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.861,"5min":6,"15min":6},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0629999999999999,"15min":1.0820000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.171,"5min":4.0209999999999999,"15min":4.0209999999999999},"last":1.1439999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.1499999999999999,"15min":1.204},"min":{"1min":0.79900000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.27,"5min":5.6459999999999999,"15min":5.6459999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.1910000000000001,"15min":1.2470000000000001},"min":{"1min":0.81299999999999994,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.986,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":1.367}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.2,"15min":1.242},"min":{"1min":0.84499999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.2509999999999999,"5min":6.7750000000000004,"15min":6.7750000000000004},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.2230000000000001,"15min":1.2729999999999999},"min":{"1min":0.93000000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.3129999999999999,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":1.113}]},{"osd":7,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.2490000000000001,"15min":1.3009999999999999},"min":{"1min":0.84399999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.3700000000000001,"5min":5.758,"15min":5.758},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.272,"15min":1.3220000000000001},"min":{"1min":0.96999999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":2.044,"5min":4.875,"15min":4.875},"last":1.3140000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298424,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073416,"statfs":{"total":96636764160,"available":96331177984,"internally_reserved":0,"allocated":1089536,"data_stored":794518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67000000000000004,"15min":0.67700000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.85399999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":1.351},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.72299999999999998,"15min":0.71199999999999997},"min":{"1min":0.56299999999999994,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.02,"5min":1.375,"15min":1.375},"last":0.89500000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.747,"15min":0.745},"min":{"1min":0.55900000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.02,"5min":1.214,"15min":1.214},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72899999999999998,"15min":0.70699999999999996},"min":{"1min":0.61599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0049999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.64400000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.70399999999999996,"15min":0.66800000000000004},"min":{"1min":0.621,"5min":0.436,"15min":0.436},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86699999999999999,"15min":0.85599999999999998},"min":{"1min":0.69899999999999995,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.071,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.2729999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0529999999999999,"15min":1.069},"min":{"1min":0.83099999999999996,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2130000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0329999999999999,"15min":1.042},"min":{"1min":0.82399999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.373,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0880000000000001,"15min":1.083},"min":{"1min":0.80700000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.278,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.042,"15min":1.0409999999999999},"min":{"1min":0.84399999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.2769999999999999,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.226}]},{"osd":6,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.99199999999999999,"15min":0.99099999999999999},"min":{"1min":0.71199999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.486,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.1659999999999999,"15min":1.1759999999999999},"min":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.4099999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.3879999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.214,"15min":1.26},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.385,"5min":3.9350000000000001,"15min":3.9350000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.097,"15min":1.093},"min":{"1min":0.94299999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.302}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:15.510 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.613+0000 7f8c1268a700 1 Processor -- start 2024-08-17T02:29:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.613+0000 7f8c1268a700 1 -- start start 2024-08-17T02:29:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c1268a700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8c0c155d20 0x7f8c0c0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c1268a700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8c0c0ad7c0 0x7f8c0c0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c1268a700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0c0af2b0 con 0x7f8c0c06df10 2024-08-17T02:29:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c1268a700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0c0adc10 con 0x7f8c0c0ad7c0 2024-08-17T02:29:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c1268a700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0c0af590 con 0x7f8c0c155d20 2024-08-17T02:29:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c10e87700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8c0c0ad7c0 0x7f8c0c0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c11e89700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f8c0c06df10 0x7f8c0c06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55922/0 (socket says 172.21.15.102:55922) 2024-08-17T02:29:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c10e87700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8c0c0ad7c0 0x7f8c0c0aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33944/0 (socket says 172.21.15.102:33944) 2024-08-17T02:29:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c11e89700 1 -- 172.21.15.102:0/3819208537 learned_addr learned my addr 172.21.15.102:0/3819208537 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c11688700 1 --2- 172.21.15.102:0/3819208537 >> v2:172.21.15.121:3300/0 conn(0x7f8c0c155d20 0x7f8c0c0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c10e87700 1 -- 172.21.15.102:0/3819208537 >> v2:172.21.15.121:3300/0 conn(0x7f8c0c155d20 msgr2=0x7f8c0c0b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c10e87700 1 --2- 172.21.15.102:0/3819208537 >> v2:172.21.15.121:3300/0 conn(0x7f8c0c155d20 0x7f8c0c0b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c10e87700 1 -- 172.21.15.102:0/3819208537 >> v1:172.21.15.102:6789/0 conn(0x7f8c0c06df10 legacy=0x7f8c0c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c10e87700 1 -- 172.21.15.102:0/3819208537 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c0af870 con 0x7f8c0c0ad7c0 2024-08-17T02:29:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c10e87700 1 --2- 172.21.15.102:0/3819208537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c0c0ad7c0 0x7f8c0c0aea80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0b1d50 tx=0x7f8c000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee8399ce49db864 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8bfffff700 1 -- 172.21.15.102:0/3819208537 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0000b6b0 con 0x7f8c0c0ad7c0 2024-08-17T02:29:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8bfffff700 1 -- 172.21.15.102:0/3819208537 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0000b810 con 0x7f8c0c0ad7c0 2024-08-17T02:29:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8bfffff700 1 -- 172.21.15.102:0/3819208537 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0000bbb0 con 0x7f8c0c0ad7c0 2024-08-17T02:29:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c1268a700 1 -- 172.21.15.102:0/3819208537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c0c0ad7c0 msgr2=0x7f8c0c0aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c1268a700 1 --2- 172.21.15.102:0/3819208537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c0c0ad7c0 0x7f8c0c0aea80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0b1d50 tx=0x7f8c000091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c1268a700 1 -- 172.21.15.102:0/3819208537 shutdown_connections 2024-08-17T02:29:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c1268a700 1 --2- 172.21.15.102:0/3819208537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c0c0ad7c0 0x7f8c0c0aea80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c1268a700 1 --2- 172.21.15.102:0/3819208537 >> v2:172.21.15.121:3300/0 conn(0x7f8c0c155d20 0x7f8c0c0b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c1268a700 1 -- 172.21.15.102:0/3819208537 >> 172.21.15.102:0/3819208537 conn(0x7f8c0c0678d0 msgr2=0x7f8c0c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c1268a700 1 -- 172.21.15.102:0/3819208537 shutdown_connections 2024-08-17T02:29:15.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c1268a700 1 -- 172.21.15.102:0/3819208537 wait complete. 2024-08-17T02:29:15.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.617+0000 7f8c1268a700 1 Processor -- start 2024-08-17T02:29:15.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c1268a700 1 -- start start 2024-08-17T02:29:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c1268a700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c0c06df10 0x7f8c0c0aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c1268a700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c0c0ad7c0 0x7f8c0c150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c1268a700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c0c155d20 0x7f8c0c158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c1268a700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c16ae60 con 0x7f8c0c155d20 2024-08-17T02:29:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c1268a700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c16b140 con 0x7f8c0c06df10 2024-08-17T02:29:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c1268a700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c16b420 con 0x7f8c0c0ad7c0 2024-08-17T02:29:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c11e89700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c0c155d20 0x7f8c0c158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c11e89700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c0c155d20 0x7f8c0c158750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33948/0 (socket says 172.21.15.102:33948) 2024-08-17T02:29:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c11e89700 1 -- 172.21.15.102:0/2354339114 learned_addr learned my addr 172.21.15.102:0/2354339114 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c11688700 1 --2- 172.21.15.102:0/2354339114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c0c06df10 0x7f8c0c0aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c10e87700 1 --2- 172.21.15.102:0/2354339114 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c0c0ad7c0 0x7f8c0c150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c11e89700 1 -- 172.21.15.102:0/2354339114 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c0c0ad7c0 msgr2=0x7f8c0c150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c11e89700 1 --2- 172.21.15.102:0/2354339114 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c0c0ad7c0 0x7f8c0c150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c11e89700 1 -- 172.21.15.102:0/2354339114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c0c06df10 msgr2=0x7f8c0c0aabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c11e89700 1 --2- 172.21.15.102:0/2354339114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c0c06df10 0x7f8c0c0aabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c11e89700 1 -- 172.21.15.102:0/2354339114 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c00009420 con 0x7f8c0c155d20 2024-08-17T02:29:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c11e89700 1 --2- 172.21.15.102:0/2354339114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c0c155d20 0x7f8c0c158750 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400cbc0 tx=0x7f8c040019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8bfd7fa700 1 -- 172.21.15.102:0/2354339114 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0400a940 con 0x7f8c0c155d20 2024-08-17T02:29:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8bfd7fa700 1 -- 172.21.15.102:0/2354339114 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0400aaa0 con 0x7f8c0c155d20 2024-08-17T02:29:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c1268a700 1 -- 172.21.15.102:0/2354339114 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c16b700 con 0x7f8c0c155d20 2024-08-17T02:29:15.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8bfd7fa700 1 -- 172.21.15.102:0/2354339114 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0400ae20 con 0x7f8c0c155d20 2024-08-17T02:29:15.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c1268a700 1 -- 172.21.15.102:0/2354339114 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c147490 con 0x7f8c0c155d20 2024-08-17T02:29:15.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.621+0000 7f8c1268a700 1 -- 172.21.15.102:0/2354339114 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0c0643a0 con 0x7f8c0c155d20 2024-08-17T02:29:15.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.625+0000 7f8bfd7fa700 1 -- 172.21.15.102:0/2354339114 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8c04007300 con 0x7f8c0c155d20 2024-08-17T02:29:15.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.625+0000 7f8bfd7fa700 1 --2- 172.21.15.102:0/2354339114 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8bf0060860 0x7f8bf0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.625+0000 7f8bfd7fa700 1 -- 172.21.15.102:0/2354339114 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f8c0407cdf0 con 0x7f8c0c155d20 2024-08-17T02:29:15.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.625+0000 7f8c11688700 1 --2- 172.21.15.102:0/2354339114 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8bf0060860 0x7f8bf0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.625+0000 7f8c11688700 1 --2- 172.21.15.102:0/2354339114 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8bf0060860 0x7f8bf0062d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8c08006fd0 tx=0x7f8c08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.633+0000 7f8bfd7fa700 1 -- 172.21.15.102:0/2354339114 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8c0404d430 con 0x7f8c0c155d20 2024-08-17T02:29:15.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.793+0000 7f8c1268a700 1 -- 172.21.15.102:0/2354339114 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c0c06f5f0 con 0x7f8bf0060860 2024-08-17T02:29:15.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.801+0000 7f8bfd7fa700 1 -- 172.21.15.102:0/2354339114 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49323 (secure 0 0 0) 0x7f8c0c06f5f0 con 0x7f8bf0060860 2024-08-17T02:29:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:15.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.805+0000 7f8c1268a700 1 -- 172.21.15.102:0/2354339114 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8bf0060860 msgr2=0x7f8bf0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.805+0000 7f8c1268a700 1 --2- 172.21.15.102:0/2354339114 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8bf0060860 0x7f8bf0062d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8c08006fd0 tx=0x7f8c08008040 comp rx=0 tx=0).stop 2024-08-17T02:29:15.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.805+0000 7f8c1268a700 1 -- 172.21.15.102:0/2354339114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c0c155d20 msgr2=0x7f8c0c158750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.805+0000 7f8c1268a700 1 --2- 172.21.15.102:0/2354339114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c0c155d20 0x7f8c0c158750 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400cbc0 tx=0x7f8c040019c0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.805+0000 7f8c1268a700 1 -- 172.21.15.102:0/2354339114 shutdown_connections 2024-08-17T02:29:15.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.805+0000 7f8c1268a700 1 --2- 172.21.15.102:0/2354339114 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8bf0060860 0x7f8bf0062d10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.805+0000 7f8c1268a700 1 --2- 172.21.15.102:0/2354339114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c0c155d20 0x7f8c0c158750 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.805+0000 7f8c1268a700 1 --2- 172.21.15.102:0/2354339114 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8c0c0ad7c0 0x7f8c0c150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.805+0000 7f8c1268a700 1 --2- 172.21.15.102:0/2354339114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c0c06df10 0x7f8c0c0aabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.805+0000 7f8c1268a700 1 -- 172.21.15.102:0/2354339114 >> 172.21.15.102:0/2354339114 conn(0x7f8c0c0678d0 msgr2=0x7f8c0c153bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.805+0000 7f8c1268a700 1 -- 172.21.15.102:0/2354339114 shutdown_connections 2024-08-17T02:29:15.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.805+0000 7f8c1268a700 1 -- 172.21.15.102:0/2354339114 wait complete. 2024-08-17T02:29:15.808 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-08-17T02:29:15.821 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-08-17T02:29:15.253427+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2396316,"kb_used_data":4976,"kb_used_omap":13,"kb_used_meta":2391218,"kb_avail":752578404,"statfs":{"total":773094113280,"available":770640285696,"internally_reserved":0,"allocated":5095424,"data_stored":2786980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2448607936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001508"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-17T02:29:10.304381+0000","last_change":"2024-08-17T02:25:51.241912+0000","last_active":"2024-08-17T02:29:10.304381+0000","last_peered":"2024-08-17T02:29:10.304381+0000","last_clean":"2024-08-17T02:29:10.304381+0000","last_became_active":"2024-08-17T02:25:51.239655+0000","last_became_peered":"2024-08-17T02:25:51.239655+0000","last_unstale":"2024-08-17T02:29:10.304381+0000","last_undegraded":"2024-08-17T02:29:10.304381+0000","last_fullsized":"2024-08-17T02:29:10.304381+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_clean_scrub_stamp":"2024-08-17T02:25:49.863184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:53.845381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298420,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073420,"statfs":{"total":96636764160,"available":96331182080,"internally_reserved":0,"allocated":1089536,"data_stored":794518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94399999999999995,"15min":0.94299999999999995},"min":{"1min":0.64400000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.034,"15min":1.0309999999999999},"min":{"1min":0.78400000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.2450000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.145}]},{"osd":1,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.90700000000000003,"15min":0.91800000000000004},"min":{"1min":0.66300000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1319999999999999,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.879,"5min":0.89500000000000002,"15min":0.89800000000000002},"min":{"1min":0.65600000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2090000000000001,"5min":1.514,"15min":1.514},"last":0.94499999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.98299999999999998,"15min":1.0189999999999999},"min":{"1min":0.64100000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2170000000000001,"5min":1.669,"15min":1.669},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1200000000000001,"15min":1.1299999999999999},"min":{"1min":0.92900000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.258,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.1950000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.026,"15min":1.0600000000000001},"min":{"1min":0.71199999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.3140000000000001,"5min":1.778,"15min":1.778},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.101,"15min":1.1379999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.2330000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0860000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.98699999999999999,"15min":1.0189999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.1259999999999999,"5min":1.694,"15min":1.694},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.194,"15min":1.244},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.4430000000000001,"5min":1.893,"15min":1.893},"last":0.73099999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.165,"15min":1.234},"min":{"1min":0.749,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.238,"5min":1.681,"15min":1.681},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.1439999999999999,"15min":1.1859999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.2889999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.258}]},{"osd":6,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.21,"15min":1.264},"min":{"1min":0.84899999999999998,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.2470000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.169},{"interface":"front","average":{"1min":1.169,"5min":1.3100000000000001,"15min":1.3580000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.504,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.2190000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297816,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074024,"statfs":{"total":96636764160,"available":96331800576,"internally_reserved":0,"allocated":471040,"data_stored":193039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85899999999999999,"15min":0.85299999999999998},"min":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2070000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.65000000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1879999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.58799999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.86799999999999999,"15min":0.84499999999999997},"min":{"1min":0.64400000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.242,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96399999999999997,"15min":0.995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1879999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.226}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.85099999999999998,"15min":0.81999999999999995},"min":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.95799999999999996,"15min":0.95699999999999996},"min":{"1min":0.752,"5min":0.627,"15min":0.627},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.0369999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.93799999999999994,"15min":0.91900000000000004},"min":{"1min":0.64000000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.206,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0069999999999999,"15min":1.0189999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.24,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.083}]},{"osd":4,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.96099999999999997,"15min":0.97899999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1950000000000001,"5min":1.383,"15min":1.383},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.1439999999999999,"15min":1.163},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.298,"5min":1.544,"15min":1.544},"last":1.528}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.075,"15min":1.093},"min":{"1min":0.751,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.232,"5min":1.427,"15min":1.427},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.113,"15min":1.127},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3280000000000001,"5min":1.456,"15min":1.456},"last":1.663}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1080000000000001,"15min":1.1160000000000001},"min":{"1min":0.83699999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.3700000000000001,"5min":1.399,"15min":1.399},"last":1.296},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1739999999999999,"15min":1.1879999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2889999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.361}]}]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302000,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069840,"statfs":{"total":96636764160,"available":96327516160,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.89200000000000002,"15min":0.90400000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.169,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88,"15min":0.86699999999999999},"min":{"1min":0.64900000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.173,"5min":1.24,"15min":1.24},"last":0.89000000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.85199999999999998,"15min":0.85499999999999998},"min":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.93100000000000005,"15min":0.91200000000000003},"min":{"1min":0.65600000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.246,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.53800000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.86099999999999999,"15min":0.85299999999999998},"min":{"1min":0.60999999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98599999999999999,"15min":1.002},"min":{"1min":0.754,"5min":0.443,"15min":0.443},"max":{"1min":1.234,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.093}]},{"osd":3,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93600000000000005,"15min":0.93400000000000005},"min":{"1min":0.69899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1319999999999999,"5min":1.359,"15min":1.359},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.92000000000000004,"15min":0.91600000000000004},"min":{"1min":0.68200000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.1599999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.79200000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.97199999999999998,"15min":1.012},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1899999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.0569999999999999,"15min":1.075},"min":{"1min":0.67500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2769999999999999,"5min":1.409,"15min":1.409},"last":1.2929999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.998,"15min":1.0129999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1699999999999999,"5min":1.28,"15min":1.28},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.113,"5min":1.1259999999999999,"15min":1.1459999999999999},"min":{"1min":0.83499999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.256,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.4890000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.117,"15min":1.125},"min":{"1min":0.84599999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.3180000000000001,"5min":1.464,"15min":1.464},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.113,"15min":1.127},"min":{"1min":0.754,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.2989999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.1220000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301988,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":479232,"data_stored":198502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.873,"15min":0.88100000000000001},"min":{"1min":0.68300000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.131,"5min":1.47,"15min":1.47},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90900000000000003,"15min":0.90100000000000002},"min":{"1min":0.66700000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2350000000000001,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.99099999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.92200000000000004,"15min":0.93899999999999995},"min":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.1719999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.92000000000000004,"15min":0.90000000000000002},"min":{"1min":0.71099999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":1.0660000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.68799999999999994,"5min":0.626,"15min":0.626},"max":{"1min":1.252,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.018},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.0349999999999999,"15min":1.052},"min":{"1min":0.76500000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.044}]},{"osd":3,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.94399999999999995,"15min":0.95399999999999996},"min":{"1min":0.71799999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.171,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.997,"5min":1.0309999999999999,"15min":1.0549999999999999},"min":{"1min":0.84499999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2050000000000001,"5min":1.863,"15min":1.863},"last":0.878}]},{"osd":5,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.99399999999999999,"15min":1.0189999999999999},"min":{"1min":0.63800000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2649999999999999,"5min":1.401,"15min":1.401},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.98599999999999999,"15min":0.98099999999999998},"min":{"1min":0.69799999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3169999999999999,"5min":1.754,"15min":1.754},"last":0.67600000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.073,"15min":1.1000000000000001},"min":{"1min":0.65800000000000003,"5min":0.63,"15min":0.63},"max":{"1min":1.3,"5min":2.109,"15min":2.109},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1719999999999999,"15min":1.1879999999999999},"min":{"1min":0.91900000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.452,"5min":1.587,"15min":1.587},"last":0.93500000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.2210000000000001,"15min":1.276},"min":{"1min":0.77700000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.371,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.2390000000000001,"15min":1.2709999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.3049999999999999,"5min":2.202,"15min":2.202},"last":1.173}]}]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68000000000000005,"15min":0.68500000000000005},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66800000000000004,"15min":0.63700000000000001},"min":{"1min":0.53300000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92900000000000005,"5min":1.181,"15min":1.181},"last":0.52300000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.65600000000000003,"15min":0.63600000000000001},"min":{"1min":0.54000000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.745},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80400000000000005,"15min":0.79100000000000004},"min":{"1min":0.61899999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0569999999999999,"5min":1.161,"15min":1.161},"last":0.55900000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.82299999999999995,"15min":0.80500000000000005},"min":{"1min":0.748,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1279999999999999,"5min":1.411,"15min":1.411},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.58899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0820000000000001,"5min":1.099,"15min":1.099},"last":0.60099999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.94499999999999995,"15min":0.92600000000000005},"min":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.1870000000000001,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.98699999999999999,"15min":0.97799999999999998},"min":{"1min":0.753,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.97999999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0229999999999999,"15min":1.0209999999999999},"min":{"1min":0.749,"5min":0.624,"15min":0.624},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.099,"5min":1.101,"15min":1.099},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.3200000000000001,"5min":1.423,"15min":1.423},"last":1.006}]},{"osd":6,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1279999999999999,"15min":1.1120000000000001},"min":{"1min":0.88200000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0700000000000001,"15min":1.0580000000000001},"min":{"1min":0.89500000000000002,"5min":0.753,"15min":0.753},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.84099999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1279999999999999,"15min":1.1339999999999999},"min":{"1min":0.83099999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.319,"5min":1.913,"15min":1.913},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1459999999999999,"15min":1.1240000000000001},"min":{"1min":0.97399999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.5049999999999999,"5min":1.698,"15min":1.698},"last":1.1180000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542188,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297824,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074016,"statfs":{"total":96636764160,"available":96331792384,"internally_reserved":0,"allocated":479232,"data_stored":193953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.51700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.90100000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71399999999999997,"15min":0.70199999999999996},"min":{"1min":0.57399999999999995,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0840000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.99399999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78800000000000003,"15min":0.79700000000000004},"min":{"1min":0.63300000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1100000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.78500000000000003},"min":{"1min":0.59499999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95899999999999996,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.59999999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.90500000000000003,"15min":0.90700000000000003},"min":{"1min":0.65100000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.0880000000000001,"5min":1.258,"15min":1.258},"last":0.78500000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0760000000000001,"15min":1.1060000000000001},"min":{"1min":0.80500000000000005,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.236,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.02,"15min":1.0169999999999999},"min":{"1min":0.79400000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.256,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.202}]},{"osd":5,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.109,"15min":1.1160000000000001},"min":{"1min":0.83199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.375,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.222},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.105,"15min":1.1299999999999999},"min":{"1min":0.90300000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.2370000000000001,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.143}]},{"osd":6,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.091,"15min":1.1140000000000001},"min":{"1min":0.79600000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.1990000000000001,"5min":1.615,"15min":1.615},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2070000000000001,"15min":1.224},"min":{"1min":0.93700000000000006,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.403,"5min":1.681,"15min":1.681},"last":1.0620000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1819999999999999,"15min":1.198},"min":{"1min":0.94999999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.3979999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1539999999999999,"15min":1.1639999999999999},"min":{"1min":1.01,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3680000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.0900000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302000,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069840,"statfs":{"total":96636764160,"available":96327516160,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.76100000000000001},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1919999999999999,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77100000000000002,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99099999999999999,"5min":3.5209999999999999,"15min":3.5209999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.96999999999999997,"15min":1.0680000000000001},"min":{"1min":0.58399999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.302,"5min":9.1709999999999994,"15min":9.1709999999999994},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.90600000000000003,"15min":0.95699999999999996},"min":{"1min":0.58999999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.139,"5min":7.4320000000000004,"15min":7.4320000000000004},"last":0.72399999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":1.008,"15min":1.0860000000000001},"min":{"1min":0.70899999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.087,"5min":10.305,"15min":10.305},"last":0.88},{"interface":"front","average":{"1min":0.78200000000000003,"5min":1.0069999999999999,"15min":1.101},"min":{"1min":0.59199999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0549999999999999,"5min":10.105,"15min":10.105},"last":0.86099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.1259999999999999,"15min":1.1919999999999999},"min":{"1min":0.68200000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.861,"5min":6,"15min":6},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0629999999999999,"15min":1.0820000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.171,"5min":4.0209999999999999,"15min":4.0209999999999999},"last":1.1439999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.1499999999999999,"15min":1.204},"min":{"1min":0.79900000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.27,"5min":5.6459999999999999,"15min":5.6459999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.1910000000000001,"15min":1.2470000000000001},"min":{"1min":0.81299999999999994,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.986,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":1.367}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.2,"15min":1.242},"min":{"1min":0.84499999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.2509999999999999,"5min":6.7750000000000004,"15min":6.7750000000000004},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.2230000000000001,"15min":1.2729999999999999},"min":{"1min":0.93000000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.3129999999999999,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":1.113}]},{"osd":7,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.2490000000000001,"15min":1.3009999999999999},"min":{"1min":0.84399999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.3700000000000001,"5min":5.758,"15min":5.758},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.272,"15min":1.3220000000000001},"min":{"1min":0.96999999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":2.044,"5min":4.875,"15min":4.875},"last":1.3140000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298424,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073416,"statfs":{"total":96636764160,"available":96331177984,"internally_reserved":0,"allocated":1089536,"data_stored":794518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67000000000000004,"15min":0.67700000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.85399999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":1.351},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.72299999999999998,"15min":0.71199999999999997},"min":{"1min":0.56299999999999994,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.02,"5min":1.375,"15min":1.375},"last":0.89500000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.747,"15min":0.745},"min":{"1min":0.55900000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.02,"5min":1.214,"15min":1.214},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72899999999999998,"15min":0.70699999999999996},"min":{"1min":0.61599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0049999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.64400000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.70399999999999996,"15min":0.66800000000000004},"min":{"1min":0.621,"5min":0.436,"15min":0.436},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86699999999999999,"15min":0.85599999999999998},"min":{"1min":0.69899999999999995,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.071,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.2729999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0529999999999999,"15min":1.069},"min":{"1min":0.83099999999999996,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2130000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0329999999999999,"15min":1.042},"min":{"1min":0.82399999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.373,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0880000000000001,"15min":1.083},"min":{"1min":0.80700000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.278,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.042,"15min":1.0409999999999999},"min":{"1min":0.84399999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.2769999999999999,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.226}]},{"osd":6,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.99199999999999999,"15min":0.99099999999999999},"min":{"1min":0.71199999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.486,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.1659999999999999,"15min":1.1759999999999999},"min":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.4099999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.3879999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.214,"15min":1.26},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.385,"5min":3.9350000000000001,"15min":3.9350000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.097,"15min":1.093},"min":{"1min":0.94299999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.302}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:15.822 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:29:15.823 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:15.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb5cf96700 1 Processor -- start 2024-08-17T02:29:15.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb5cf96700 1 -- start start 2024-08-17T02:29:15.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb5cf96700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbb58155d20 0x7fbb580b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb5cf96700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb580ad7c0 0x7fbb580aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb5cf96700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb580af2b0 con 0x7fbb5806df10 2024-08-17T02:29:15.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb5cf96700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb580adc10 con 0x7fbb58155d20 2024-08-17T02:29:15.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb5cf96700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580af590 con 0x7fbb580ad7c0 2024-08-17T02:29:15.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb577fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbb58155d20 0x7fbb580b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb577fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbb58155d20 0x7fbb580b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33958/0 (socket says 172.21.15.102:33958) 2024-08-17T02:29:15.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb577fe700 1 -- 172.21.15.102:0/641243465 learned_addr learned my addr 172.21.15.102:0/641243465 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:15.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb4ffff700 1 --2- 172.21.15.102:0/641243465 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb580ad7c0 0x7fbb580aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb577fe700 1 -- 172.21.15.102:0/641243465 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb580ad7c0 msgr2=0x7fbb580aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb577fe700 1 --2- 172.21.15.102:0/641243465 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb580ad7c0 0x7fbb580aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb577fe700 1 -- 172.21.15.102:0/641243465 >> v1:172.21.15.121:6789/0 conn(0x7fbb5806df10 legacy=0x7fbb581599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb577fe700 1 -- 172.21.15.102:0/641243465 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb580af870 con 0x7fbb58155d20 2024-08-17T02:29:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb577fe700 1 --2- 172.21.15.102:0/641243465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb58155d20 0x7fbb580b0350 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbb480099b0 tx=0x7fbb48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d199c5a2469f193 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.929+0000 7fbb56ffd700 1 -- 172.21.15.102:0/641243465 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48009ea0 con 0x7fbb58155d20 2024-08-17T02:29:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb56ffd700 1 -- 172.21.15.102:0/641243465 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4800b860 con 0x7fbb58155d20 2024-08-17T02:29:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb56ffd700 1 -- 172.21.15.102:0/641243465 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4800bc00 con 0x7fbb58155d20 2024-08-17T02:29:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb5cf96700 1 -- 172.21.15.102:0/641243465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb58155d20 msgr2=0x7fbb580b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb5cf96700 1 --2- 172.21.15.102:0/641243465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb58155d20 0x7fbb580b0350 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbb480099b0 tx=0x7fbb48009250 comp rx=0 tx=0).stop 2024-08-17T02:29:15.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb5cf96700 1 -- 172.21.15.102:0/641243465 shutdown_connections 2024-08-17T02:29:15.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb5cf96700 1 --2- 172.21.15.102:0/641243465 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb580ad7c0 0x7fbb580aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb5cf96700 1 --2- 172.21.15.102:0/641243465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb58155d20 0x7fbb580b0350 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb5cf96700 1 -- 172.21.15.102:0/641243465 >> 172.21.15.102:0/641243465 conn(0x7fbb580678d0 msgr2=0x7fbb58067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb5cf96700 1 -- 172.21.15.102:0/641243465 shutdown_connections 2024-08-17T02:29:15.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb5cf96700 1 -- 172.21.15.102:0/641243465 wait complete. 2024-08-17T02:29:15.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb5cf96700 1 Processor -- start 2024-08-17T02:29:15.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb5cf96700 1 -- start start 2024-08-17T02:29:15.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb5cf96700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb5806df10 0x7fbb581448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb5cf96700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb580ad7c0 0x7fbb58159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb5cf96700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb58155d20 0x7fbb58148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb5cf96700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb581494f0 con 0x7fbb580ad7c0 2024-08-17T02:29:15.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb5cf96700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58149720 con 0x7fbb58155d20 2024-08-17T02:29:15.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.933+0000 7fbb5cf96700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58149a00 con 0x7fbb5806df10 2024-08-17T02:29:15.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb4ffff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb580ad7c0 0x7fbb58159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb4ffff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb580ad7c0 0x7fbb58159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33964/0 (socket says 172.21.15.102:33964) 2024-08-17T02:29:15.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb4ffff700 1 -- 172.21.15.102:0/378679998 learned_addr learned my addr 172.21.15.102:0/378679998 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:15.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb577fe700 1 --2- 172.21.15.102:0/378679998 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb5806df10 0x7fbb581448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb57fff700 1 --2- 172.21.15.102:0/378679998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb58155d20 0x7fbb58148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb4ffff700 1 -- 172.21.15.102:0/378679998 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb5806df10 msgr2=0x7fbb581448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb4ffff700 1 --2- 172.21.15.102:0/378679998 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb5806df10 0x7fbb581448b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb4ffff700 1 -- 172.21.15.102:0/378679998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb58155d20 msgr2=0x7fbb58148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb4ffff700 1 --2- 172.21.15.102:0/378679998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb58155d20 0x7fbb58148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb4ffff700 1 -- 172.21.15.102:0/378679998 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb480094f0 con 0x7fbb580ad7c0 2024-08-17T02:29:15.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb57fff700 1 --2- 172.21.15.102:0/378679998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb58155d20 0x7fbb58148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:15.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb4ffff700 1 --2- 172.21.15.102:0/378679998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb580ad7c0 0x7fbb58159270 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000ec80 tx=0x7fbb400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb4f7fe700 1 -- 172.21.15.102:0/378679998 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4000c9d0 con 0x7fbb580ad7c0 2024-08-17T02:29:15.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb4f7fe700 1 -- 172.21.15.102:0/378679998 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4000cb30 con 0x7fbb580ad7c0 2024-08-17T02:29:15.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb5cf96700 1 -- 172.21.15.102:0/378679998 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb58149ce0 con 0x7fbb580ad7c0 2024-08-17T02:29:15.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb4f7fe700 1 -- 172.21.15.102:0/378679998 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40013470 con 0x7fbb580ad7c0 2024-08-17T02:29:15.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb5cf96700 1 -- 172.21.15.102:0/378679998 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5814a880 con 0x7fbb580ad7c0 2024-08-17T02:29:15.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.937+0000 7fbb5cf96700 1 -- 172.21.15.102:0/378679998 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb580643a0 con 0x7fbb580ad7c0 2024-08-17T02:29:15.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.941+0000 7fbb4f7fe700 1 -- 172.21.15.102:0/378679998 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbb40013820 con 0x7fbb580ad7c0 2024-08-17T02:29:15.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.941+0000 7fbb4f7fe700 1 --2- 172.21.15.102:0/378679998 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbb38060860 0x7fbb38062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.941+0000 7fbb4f7fe700 1 -- 172.21.15.102:0/378679998 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fbb4007d400 con 0x7fbb580ad7c0 2024-08-17T02:29:15.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.941+0000 7fbb577fe700 1 --2- 172.21.15.102:0/378679998 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbb38060860 0x7fbb38062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.941+0000 7fbb577fe700 1 --2- 172.21.15.102:0/378679998 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbb38060860 0x7fbb38062d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbb480099b0 tx=0x7fbb48017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:15.949+0000 7fbb4f7fe700 1 -- 172.21.15.102:0/378679998 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbb4004db70 con 0x7fbb580ad7c0 2024-08-17T02:29:16.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.109+0000 7fbb5cf96700 1 -- 172.21.15.102:0/378679998 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb5814a160 con 0x7fbb38060860 2024-08-17T02:29:16.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.113+0000 7fbb4f7fe700 1 -- 172.21.15.102:0/378679998 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49323 (secure 0 0 0) 0x7fbb5814a160 con 0x7fbb38060860 2024-08-17T02:29:16.115 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.113+0000 7fbb5cf96700 1 -- 172.21.15.102:0/378679998 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbb38060860 msgr2=0x7fbb38062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.113+0000 7fbb5cf96700 1 --2- 172.21.15.102:0/378679998 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbb38060860 0x7fbb38062d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbb480099b0 tx=0x7fbb48017000 comp rx=0 tx=0).stop 2024-08-17T02:29:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.113+0000 7fbb5cf96700 1 -- 172.21.15.102:0/378679998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb580ad7c0 msgr2=0x7fbb58159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.113+0000 7fbb5cf96700 1 --2- 172.21.15.102:0/378679998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb580ad7c0 0x7fbb58159270 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000ec80 tx=0x7fbb400091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.113+0000 7fbb5cf96700 1 -- 172.21.15.102:0/378679998 shutdown_connections 2024-08-17T02:29:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.113+0000 7fbb5cf96700 1 --2- 172.21.15.102:0/378679998 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fbb38060860 0x7fbb38062d10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.113+0000 7fbb5cf96700 1 --2- 172.21.15.102:0/378679998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb580ad7c0 0x7fbb58159270 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.113+0000 7fbb5cf96700 1 --2- 172.21.15.102:0/378679998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb58155d20 0x7fbb58148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.113+0000 7fbb5cf96700 1 --2- 172.21.15.102:0/378679998 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fbb5806df10 0x7fbb581448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.113+0000 7fbb5cf96700 1 -- 172.21.15.102:0/378679998 >> 172.21.15.102:0/378679998 conn(0x7fbb580678d0 msgr2=0x7fbb58063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.113+0000 7fbb5cf96700 1 -- 172.21.15.102:0/378679998 shutdown_connections 2024-08-17T02:29:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.113+0000 7fbb5cf96700 1 -- 172.21.15.102:0/378679998 wait complete. 2024-08-17T02:29:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-08-17T02:29:16.128 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-08-17T02:29:15.253427+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2396316,"kb_used_data":4976,"kb_used_omap":13,"kb_used_meta":2391218,"kb_avail":752578404,"statfs":{"total":773094113280,"available":770640285696,"internally_reserved":0,"allocated":5095424,"data_stored":2786980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2448607936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001508"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-17T02:29:10.304381+0000","last_change":"2024-08-17T02:25:51.241912+0000","last_active":"2024-08-17T02:29:10.304381+0000","last_peered":"2024-08-17T02:29:10.304381+0000","last_clean":"2024-08-17T02:29:10.304381+0000","last_became_active":"2024-08-17T02:25:51.239655+0000","last_became_peered":"2024-08-17T02:25:51.239655+0000","last_unstale":"2024-08-17T02:29:10.304381+0000","last_undegraded":"2024-08-17T02:29:10.304381+0000","last_fullsized":"2024-08-17T02:29:10.304381+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_clean_scrub_stamp":"2024-08-17T02:25:49.863184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:53.845381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298420,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073420,"statfs":{"total":96636764160,"available":96331182080,"internally_reserved":0,"allocated":1089536,"data_stored":794518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94399999999999995,"15min":0.94299999999999995},"min":{"1min":0.64400000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.034,"15min":1.0309999999999999},"min":{"1min":0.78400000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.2450000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.145}]},{"osd":1,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.90700000000000003,"15min":0.91800000000000004},"min":{"1min":0.66300000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1319999999999999,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.879,"5min":0.89500000000000002,"15min":0.89800000000000002},"min":{"1min":0.65600000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2090000000000001,"5min":1.514,"15min":1.514},"last":0.94499999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.98299999999999998,"15min":1.0189999999999999},"min":{"1min":0.64100000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2170000000000001,"5min":1.669,"15min":1.669},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1200000000000001,"15min":1.1299999999999999},"min":{"1min":0.92900000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.258,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.1950000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.026,"15min":1.0600000000000001},"min":{"1min":0.71199999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.3140000000000001,"5min":1.778,"15min":1.778},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.101,"15min":1.1379999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.2330000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.0860000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.98699999999999999,"15min":1.0189999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.1259999999999999,"5min":1.694,"15min":1.694},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.194,"15min":1.244},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.4430000000000001,"5min":1.893,"15min":1.893},"last":0.73099999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.165,"15min":1.234},"min":{"1min":0.749,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.238,"5min":1.681,"15min":1.681},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.1439999999999999,"15min":1.1859999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.2889999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.258}]},{"osd":6,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.21,"15min":1.264},"min":{"1min":0.84899999999999998,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.2470000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.169},{"interface":"front","average":{"1min":1.169,"5min":1.3100000000000001,"15min":1.3580000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.504,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.2190000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297816,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074024,"statfs":{"total":96636764160,"available":96331800576,"internally_reserved":0,"allocated":471040,"data_stored":193039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85899999999999999,"15min":0.85299999999999998},"min":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2070000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.65000000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1879999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.58799999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.86799999999999999,"15min":0.84499999999999997},"min":{"1min":0.64400000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.242,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96399999999999997,"15min":0.995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1879999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.226}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.85099999999999998,"15min":0.81999999999999995},"min":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.95799999999999996,"15min":0.95699999999999996},"min":{"1min":0.752,"5min":0.627,"15min":0.627},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.0369999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.93799999999999994,"15min":0.91900000000000004},"min":{"1min":0.64000000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.206,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0069999999999999,"15min":1.0189999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.24,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.083}]},{"osd":4,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.96099999999999997,"15min":0.97899999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1950000000000001,"5min":1.383,"15min":1.383},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.103,"5min":1.1439999999999999,"15min":1.163},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.298,"5min":1.544,"15min":1.544},"last":1.528}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.075,"15min":1.093},"min":{"1min":0.751,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.232,"5min":1.427,"15min":1.427},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.113,"15min":1.127},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3280000000000001,"5min":1.456,"15min":1.456},"last":1.663}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1080000000000001,"15min":1.1160000000000001},"min":{"1min":0.83699999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.3700000000000001,"5min":1.399,"15min":1.399},"last":1.296},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1739999999999999,"15min":1.1879999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2889999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.361}]}]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302000,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069840,"statfs":{"total":96636764160,"available":96327516160,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.89200000000000002,"15min":0.90400000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.169,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88,"15min":0.86699999999999999},"min":{"1min":0.64900000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.173,"5min":1.24,"15min":1.24},"last":0.89000000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.85199999999999998,"15min":0.85499999999999998},"min":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.93100000000000005,"15min":0.91200000000000003},"min":{"1min":0.65600000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.246,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.53800000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.86099999999999999,"15min":0.85299999999999998},"min":{"1min":0.60999999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98599999999999999,"15min":1.002},"min":{"1min":0.754,"5min":0.443,"15min":0.443},"max":{"1min":1.234,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.093}]},{"osd":3,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93600000000000005,"15min":0.93400000000000005},"min":{"1min":0.69899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1319999999999999,"5min":1.359,"15min":1.359},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.92000000000000004,"15min":0.91600000000000004},"min":{"1min":0.68200000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.1599999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.79200000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.97199999999999998,"15min":1.012},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1899999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.0569999999999999,"15min":1.075},"min":{"1min":0.67500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2769999999999999,"5min":1.409,"15min":1.409},"last":1.2929999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.998,"15min":1.0129999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1699999999999999,"5min":1.28,"15min":1.28},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.113,"5min":1.1259999999999999,"15min":1.1459999999999999},"min":{"1min":0.83499999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.256,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.4890000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.117,"15min":1.125},"min":{"1min":0.84599999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.3180000000000001,"5min":1.464,"15min":1.464},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.113,"15min":1.127},"min":{"1min":0.754,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.2989999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.1220000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301988,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":479232,"data_stored":198502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.873,"15min":0.88100000000000001},"min":{"1min":0.68300000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.131,"5min":1.47,"15min":1.47},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90900000000000003,"15min":0.90100000000000002},"min":{"1min":0.66700000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2350000000000001,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.99099999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.92200000000000004,"15min":0.93899999999999995},"min":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.1719999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.92000000000000004,"15min":0.90000000000000002},"min":{"1min":0.71099999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":1.0660000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.68799999999999994,"5min":0.626,"15min":0.626},"max":{"1min":1.252,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.018},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.0349999999999999,"15min":1.052},"min":{"1min":0.76500000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.044}]},{"osd":3,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.94399999999999995,"15min":0.95399999999999996},"min":{"1min":0.71799999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.171,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.997,"5min":1.0309999999999999,"15min":1.0549999999999999},"min":{"1min":0.84499999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2050000000000001,"5min":1.863,"15min":1.863},"last":0.878}]},{"osd":5,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.99399999999999999,"15min":1.0189999999999999},"min":{"1min":0.63800000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2649999999999999,"5min":1.401,"15min":1.401},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.98599999999999999,"15min":0.98099999999999998},"min":{"1min":0.69799999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3169999999999999,"5min":1.754,"15min":1.754},"last":0.67600000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.073,"15min":1.1000000000000001},"min":{"1min":0.65800000000000003,"5min":0.63,"15min":0.63},"max":{"1min":1.3,"5min":2.109,"15min":2.109},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1719999999999999,"15min":1.1879999999999999},"min":{"1min":0.91900000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.452,"5min":1.587,"15min":1.587},"last":0.93500000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.2210000000000001,"15min":1.276},"min":{"1min":0.77700000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.371,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.2390000000000001,"15min":1.2709999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.3049999999999999,"5min":2.202,"15min":2.202},"last":1.173}]}]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68000000000000005,"15min":0.68500000000000005},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66800000000000004,"15min":0.63700000000000001},"min":{"1min":0.53300000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92900000000000005,"5min":1.181,"15min":1.181},"last":0.52300000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.65600000000000003,"15min":0.63600000000000001},"min":{"1min":0.54000000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.745},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80400000000000005,"15min":0.79100000000000004},"min":{"1min":0.61899999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0569999999999999,"5min":1.161,"15min":1.161},"last":0.55900000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.82299999999999995,"15min":0.80500000000000005},"min":{"1min":0.748,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1279999999999999,"5min":1.411,"15min":1.411},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.58899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0820000000000001,"5min":1.099,"15min":1.099},"last":0.60099999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.94499999999999995,"15min":0.92600000000000005},"min":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.1870000000000001,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.98699999999999999,"15min":0.97799999999999998},"min":{"1min":0.753,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.97999999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0229999999999999,"15min":1.0209999999999999},"min":{"1min":0.749,"5min":0.624,"15min":0.624},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.099,"5min":1.101,"15min":1.099},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.3200000000000001,"5min":1.423,"15min":1.423},"last":1.006}]},{"osd":6,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1279999999999999,"15min":1.1120000000000001},"min":{"1min":0.88200000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0700000000000001,"15min":1.0580000000000001},"min":{"1min":0.89500000000000002,"5min":0.753,"15min":0.753},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.84099999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1279999999999999,"15min":1.1339999999999999},"min":{"1min":0.83099999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.319,"5min":1.913,"15min":1.913},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1459999999999999,"15min":1.1240000000000001},"min":{"1min":0.97399999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.5049999999999999,"5min":1.698,"15min":1.698},"last":1.1180000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542188,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297824,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074016,"statfs":{"total":96636764160,"available":96331792384,"internally_reserved":0,"allocated":479232,"data_stored":193953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.51700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.90100000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71399999999999997,"15min":0.70199999999999996},"min":{"1min":0.57399999999999995,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0840000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.99399999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78800000000000003,"15min":0.79700000000000004},"min":{"1min":0.63300000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1100000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.78500000000000003},"min":{"1min":0.59499999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95899999999999996,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.59999999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.90500000000000003,"15min":0.90700000000000003},"min":{"1min":0.65100000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.0880000000000001,"5min":1.258,"15min":1.258},"last":0.78500000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0760000000000001,"15min":1.1060000000000001},"min":{"1min":0.80500000000000005,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.236,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.02,"15min":1.0169999999999999},"min":{"1min":0.79400000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.256,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.202}]},{"osd":5,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.109,"15min":1.1160000000000001},"min":{"1min":0.83199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.375,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.222},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.105,"15min":1.1299999999999999},"min":{"1min":0.90300000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.2370000000000001,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.143}]},{"osd":6,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.091,"15min":1.1140000000000001},"min":{"1min":0.79600000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.1990000000000001,"5min":1.615,"15min":1.615},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2070000000000001,"15min":1.224},"min":{"1min":0.93700000000000006,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.403,"5min":1.681,"15min":1.681},"last":1.0620000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1819999999999999,"15min":1.198},"min":{"1min":0.94999999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.3979999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1539999999999999,"15min":1.1639999999999999},"min":{"1min":1.01,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3680000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.0900000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302000,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069840,"statfs":{"total":96636764160,"available":96327516160,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.76100000000000001},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1919999999999999,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77100000000000002,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99099999999999999,"5min":3.5209999999999999,"15min":3.5209999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.96999999999999997,"15min":1.0680000000000001},"min":{"1min":0.58399999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.302,"5min":9.1709999999999994,"15min":9.1709999999999994},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.90600000000000003,"15min":0.95699999999999996},"min":{"1min":0.58999999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.139,"5min":7.4320000000000004,"15min":7.4320000000000004},"last":0.72399999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":1.008,"15min":1.0860000000000001},"min":{"1min":0.70899999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.087,"5min":10.305,"15min":10.305},"last":0.88},{"interface":"front","average":{"1min":0.78200000000000003,"5min":1.0069999999999999,"15min":1.101},"min":{"1min":0.59199999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0549999999999999,"5min":10.105,"15min":10.105},"last":0.86099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.1259999999999999,"15min":1.1919999999999999},"min":{"1min":0.68200000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.861,"5min":6,"15min":6},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0629999999999999,"15min":1.0820000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.171,"5min":4.0209999999999999,"15min":4.0209999999999999},"last":1.1439999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.1499999999999999,"15min":1.204},"min":{"1min":0.79900000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.27,"5min":5.6459999999999999,"15min":5.6459999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.1910000000000001,"15min":1.2470000000000001},"min":{"1min":0.81299999999999994,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.986,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":1.367}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.2,"15min":1.242},"min":{"1min":0.84499999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.2509999999999999,"5min":6.7750000000000004,"15min":6.7750000000000004},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.2230000000000001,"15min":1.2729999999999999},"min":{"1min":0.93000000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.3129999999999999,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":1.113}]},{"osd":7,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.2490000000000001,"15min":1.3009999999999999},"min":{"1min":0.84399999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.3700000000000001,"5min":5.758,"15min":5.758},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.272,"15min":1.3220000000000001},"min":{"1min":0.96999999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":2.044,"5min":4.875,"15min":4.875},"last":1.3140000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298424,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073416,"statfs":{"total":96636764160,"available":96331177984,"internally_reserved":0,"allocated":1089536,"data_stored":794518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67000000000000004,"15min":0.67700000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.85399999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":1.351},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.72299999999999998,"15min":0.71199999999999997},"min":{"1min":0.56299999999999994,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.02,"5min":1.375,"15min":1.375},"last":0.89500000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.747,"15min":0.745},"min":{"1min":0.55900000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.02,"5min":1.214,"15min":1.214},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72899999999999998,"15min":0.70699999999999996},"min":{"1min":0.61599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0049999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.64400000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.70399999999999996,"15min":0.66800000000000004},"min":{"1min":0.621,"5min":0.436,"15min":0.436},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86699999999999999,"15min":0.85599999999999998},"min":{"1min":0.69899999999999995,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.071,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.2729999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0529999999999999,"15min":1.069},"min":{"1min":0.83099999999999996,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2130000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0329999999999999,"15min":1.042},"min":{"1min":0.82399999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.373,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0880000000000001,"15min":1.083},"min":{"1min":0.80700000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.278,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.042,"15min":1.0409999999999999},"min":{"1min":0.84399999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.2769999999999999,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.226}]},{"osd":6,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.99199999999999999,"15min":0.99099999999999999},"min":{"1min":0.71199999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.486,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.109,"5min":1.1659999999999999,"15min":1.1759999999999999},"min":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.4099999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.3879999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.214,"15min":1.26},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.385,"5min":3.9350000000000001,"15min":3.9350000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.097,"15min":1.093},"min":{"1min":0.94299999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.302}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:16.130 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:16.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f9043fff700 1 Processor -- start 2024-08-17T02:29:16.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f9043fff700 1 -- start start 2024-08-17T02:29:16.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f9043fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9044155d20 0x7f90440b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f9043fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90440ad7c0 0x7f90440aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f9043fff700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90440af2b0 con 0x7f904406df10 2024-08-17T02:29:16.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f9043fff700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90440adc10 con 0x7f9044155d20 2024-08-17T02:29:16.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f9043fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90440af590 con 0x7f90440ad7c0 2024-08-17T02:29:16.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f9042ffd700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9044155d20 0x7f90440b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f903a7fc700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90440ad7c0 0x7f90440aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f90437fe700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f904406df10 0x7f90441599c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:60750/0 (socket says 172.21.15.102:60750) 2024-08-17T02:29:16.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f90437fe700 1 -- 172.21.15.102:0/1027083355 learned_addr learned my addr 172.21.15.102:0/1027083355 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:16.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f903a7fc700 1 -- 172.21.15.102:0/1027083355 >> v2:172.21.15.121:3300/0 conn(0x7f9044155d20 msgr2=0x7f90440b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:16.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f903a7fc700 1 --2- 172.21.15.102:0/1027083355 >> v2:172.21.15.121:3300/0 conn(0x7f9044155d20 0x7f90440b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f90427fc700 1 -- 172.21.15.102:0/1027083355 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637200590 0 0) 0x7f90440af2b0 con 0x7f904406df10 2024-08-17T02:29:16.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f903a7fc700 1 -- 172.21.15.102:0/1027083355 >> v1:172.21.15.121:6789/0 conn(0x7f904406df10 legacy=0x7f90441599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f903a7fc700 1 -- 172.21.15.102:0/1027083355 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90440af870 con 0x7f90440ad7c0 2024-08-17T02:29:16.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.233+0000 7f9042ffd700 1 --2- 172.21.15.102:0/1027083355 >> v2:172.21.15.121:3300/0 conn(0x7f9044155d20 0x7f90440b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:16.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f903a7fc700 1 --2- 172.21.15.102:0/1027083355 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90440ad7c0 0x7f90440aea80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f902c0098e0 tx=0x7f902c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=861e3d683e2e9c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:16.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f90427fc700 1 -- 172.21.15.102:0/1027083355 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c00b640 con 0x7f90440ad7c0 2024-08-17T02:29:16.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f90427fc700 1 -- 172.21.15.102:0/1027083355 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c00b7a0 con 0x7f90440ad7c0 2024-08-17T02:29:16.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f90427fc700 1 -- 172.21.15.102:0/1027083355 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c00bb40 con 0x7f90440ad7c0 2024-08-17T02:29:16.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9043fff700 1 -- 172.21.15.102:0/1027083355 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90440ad7c0 msgr2=0x7f90440aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9043fff700 1 --2- 172.21.15.102:0/1027083355 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90440ad7c0 0x7f90440aea80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f902c0098e0 tx=0x7f902c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9043fff700 1 -- 172.21.15.102:0/1027083355 shutdown_connections 2024-08-17T02:29:16.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9043fff700 1 --2- 172.21.15.102:0/1027083355 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90440ad7c0 0x7f90440aea80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9043fff700 1 --2- 172.21.15.102:0/1027083355 >> v2:172.21.15.121:3300/0 conn(0x7f9044155d20 0x7f90440b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9043fff700 1 -- 172.21.15.102:0/1027083355 >> 172.21.15.102:0/1027083355 conn(0x7f90440678d0 msgr2=0x7f9044067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9043fff700 1 -- 172.21.15.102:0/1027083355 shutdown_connections 2024-08-17T02:29:16.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9043fff700 1 -- 172.21.15.102:0/1027083355 wait complete. 2024-08-17T02:29:16.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9043fff700 1 Processor -- start 2024-08-17T02:29:16.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9043fff700 1 -- start start 2024-08-17T02:29:16.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9043fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f904406df10 0x7f904414c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9043fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90440ad7c0 0x7f904413a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9043fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9044155d20 0x7f904414fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9043fff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904414e440 con 0x7f904406df10 2024-08-17T02:29:16.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9043fff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904414db10 con 0x7f9044155d20 2024-08-17T02:29:16.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9043fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904414ddf0 con 0x7f90440ad7c0 2024-08-17T02:29:16.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9042ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f904406df10 0x7f904414c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9042ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f904406df10 0x7f904414c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33970/0 (socket says 172.21.15.102:33970) 2024-08-17T02:29:16.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f903a7fc700 1 --2- 172.21.15.102:0/3956306466 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90440ad7c0 0x7f904413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f9042ffd700 1 -- 172.21.15.102:0/3956306466 learned_addr learned my addr 172.21.15.102:0/3956306466 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.237+0000 7f90437fe700 1 --2- 172.21.15.102:0/3956306466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9044155d20 0x7f904414fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.241+0000 7f903a7fc700 1 -- 172.21.15.102:0/3956306466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9044155d20 msgr2=0x7f904414fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.241+0000 7f903a7fc700 1 --2- 172.21.15.102:0/3956306466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9044155d20 0x7f904414fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.241+0000 7f903a7fc700 1 -- 172.21.15.102:0/3956306466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f904406df10 msgr2=0x7f904414c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.241+0000 7f903a7fc700 1 --2- 172.21.15.102:0/3956306466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f904406df10 0x7f904414c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.241+0000 7f903a7fc700 1 -- 172.21.15.102:0/3956306466 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9034009420 con 0x7f90440ad7c0 2024-08-17T02:29:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.241+0000 7f903a7fc700 1 --2- 172.21.15.102:0/3956306466 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90440ad7c0 0x7f904413a730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f902c016000 tx=0x7f902c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:16.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.241+0000 7f903b7fe700 1 -- 172.21.15.102:0/3956306466 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c00bb20 con 0x7f90440ad7c0 2024-08-17T02:29:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.241+0000 7f903b7fe700 1 -- 172.21.15.102:0/3956306466 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c000c90 con 0x7f90440ad7c0 2024-08-17T02:29:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.241+0000 7f9043fff700 1 -- 172.21.15.102:0/3956306466 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902c009420 con 0x7f90440ad7c0 2024-08-17T02:29:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.241+0000 7f903b7fe700 1 -- 172.21.15.102:0/3956306466 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c011650 con 0x7f90440ad7c0 2024-08-17T02:29:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.241+0000 7f9043fff700 1 -- 172.21.15.102:0/3956306466 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9044151280 con 0x7f90440ad7c0 2024-08-17T02:29:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.241+0000 7f9043fff700 1 -- 172.21.15.102:0/3956306466 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904414e5f0 con 0x7f90440ad7c0 2024-08-17T02:29:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.241+0000 7f903b7fe700 1 -- 172.21.15.102:0/3956306466 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f902c011a40 con 0x7f90440ad7c0 2024-08-17T02:29:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.245+0000 7f903b7fe700 1 --2- 172.21.15.102:0/3956306466 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9024060860 0x7f9024062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.245+0000 7f9042ffd700 1 --2- 172.21.15.102:0/3956306466 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9024060860 0x7f9024062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.245+0000 7f903b7fe700 1 -- 172.21.15.102:0/3956306466 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f902c07e290 con 0x7f90440ad7c0 2024-08-17T02:29:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.245+0000 7f9042ffd700 1 --2- 172.21.15.102:0/3956306466 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9024060860 0x7f9024062d10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9034011310 tx=0x7f90340091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.257+0000 7f903b7fe700 1 -- 172.21.15.102:0/3956306466 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f904414e5f0 con 0x7f90440ad7c0 2024-08-17T02:29:16.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.417+0000 7f9043fff700 1 -- 172.21.15.102:0/3956306466 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f904414df30 con 0x7f90440ad7c0 2024-08-17T02:29:16.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.421+0000 7f903b7fe700 1 -- 172.21.15.102:0/3956306466 <== mon.2 v2:172.21.15.121:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+12445 (secure 0 0 0) 0x7f904414df30 con 0x7f90440ad7c0 2024-08-17T02:29:16.424 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:16.424 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":42,"fsid":"0c0c2578-b641-472b-9b35-bef011c543fd","created":"2024-08-17T02:25:38.799004+0000","modified":"2024-08-17T02:29:13.112003+0000","last_up_change":"2024-08-17T02:25:48.850102+0000","last_in_change":"2024-08-17T02:25:40.883633+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:49.236728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bed1e6fe-ed38-4057-97f1-799671550db1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":24227},{"type":"v1","addr":"172.21.15.102:6817","nonce":24227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":24227},{"type":"v1","addr":"172.21.15.102:6819","nonce":24227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":24227},{"type":"v1","addr":"172.21.15.102:6823","nonce":24227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":24227},{"type":"v1","addr":"172.21.15.102:6821","nonce":24227}]},"public_addr":"172.21.15.102:6817/24227","cluster_addr":"172.21.15.102:6819/24227","heartbeat_back_addr":"172.21.15.102:6823/24227","heartbeat_front_addr":"172.21.15.102:6821/24227","state":["exists","up"]},{"osd":1,"uuid":"5b60245e-40dc-4087-a008-f34e239e965a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":24224},{"type":"v1","addr":"172.21.15.102:6825","nonce":24224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":24224},{"type":"v1","addr":"172.21.15.102:6827","nonce":24224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":24224},{"type":"v1","addr":"172.21.15.102:6831","nonce":24224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":24224},{"type":"v1","addr":"172.21.15.102:6829","nonce":24224}]},"public_addr":"172.21.15.102:6825/24224","cluster_addr":"172.21.15.102:6827/24224","heartbeat_back_addr":"172.21.15.102:6831/24224","heartbeat_front_addr":"172.21.15.102:6829/24224","state":["exists","up"]},{"osd":2,"uuid":"f0966f43-b54a-4b11-b537-f7e93820381f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":24226},{"type":"v1","addr":"172.21.15.102:6809","nonce":24226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":24226},{"type":"v1","addr":"172.21.15.102:6811","nonce":24226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":24226},{"type":"v1","addr":"172.21.15.102:6815","nonce":24226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":24226},{"type":"v1","addr":"172.21.15.102:6813","nonce":24226}]},"public_addr":"172.21.15.102:6809/24226","cluster_addr":"172.21.15.102:6811/24226","heartbeat_back_addr":"172.21.15.102:6815/24226","heartbeat_front_addr":"172.21.15.102:6813/24226","state":["exists","up"]},{"osd":3,"uuid":"9ad2af3c-bdff-438b-8d29-1cdd17af3599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":24225},{"type":"v1","addr":"172.21.15.102:6801","nonce":24225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":24225},{"type":"v1","addr":"172.21.15.102:6803","nonce":24225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":24225},{"type":"v1","addr":"172.21.15.102:6807","nonce":24225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":24225},{"type":"v1","addr":"172.21.15.102:6805","nonce":24225}]},"public_addr":"172.21.15.102:6801/24225","cluster_addr":"172.21.15.102:6803/24225","heartbeat_back_addr":"172.21.15.102:6807/24225","heartbeat_front_addr":"172.21.15.102:6805/24225","state":["exists","up"]},{"osd":4,"uuid":"2c1f8841-af06-4ba3-94c9-128a175af9ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":24414},{"type":"v1","addr":"172.21.15.121:6825","nonce":24414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":24414},{"type":"v1","addr":"172.21.15.121:6827","nonce":24414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":24414},{"type":"v1","addr":"172.21.15.121:6831","nonce":24414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":24414},{"type":"v1","addr":"172.21.15.121:6829","nonce":24414}]},"public_addr":"172.21.15.121:6825/24414","cluster_addr":"172.21.15.121:6827/24414","heartbeat_back_addr":"172.21.15.121:6831/24414","heartbeat_front_addr":"172.21.15.121:6829/24414","state":["exists","up"]},{"osd":5,"uuid":"a2428838-ec97-4b61-8f22-ad9fc1ce9771","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":24413},{"type":"v1","addr":"172.21.15.121:6809","nonce":24413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":24413},{"type":"v1","addr":"172.21.15.121:6811","nonce":24413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":24413},{"type":"v1","addr":"172.21.15.121:6815","nonce":24413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":24413},{"type":"v1","addr":"172.21.15.121:6813","nonce":24413}]},"public_addr":"172.21.15.121:6809/24413","cluster_addr":"172.21.15.121:6811/24413","heartbeat_back_addr":"172.21.15.121:6815/24413","heartbeat_front_addr":"172.21.15.121:6813/24413","state":["exists","up"]},{"osd":6,"uuid":"b8c70c26-5b75-4054-aca3-628720883022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":24418},{"type":"v1","addr":"172.21.15.121:6817","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":24418},{"type":"v1","addr":"172.21.15.121:6819","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":24418},{"type":"v1","addr":"172.21.15.121:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":24418},{"type":"v1","addr":"172.21.15.121:6821","nonce":24418}]},"public_addr":"172.21.15.121:6817/24418","cluster_addr":"172.21.15.121:6819/24418","heartbeat_back_addr":"172.21.15.121:6823/24418","heartbeat_front_addr":"172.21.15.121:6821/24418","state":["exists","up"]},{"osd":7,"uuid":"492af925-add4-465d-9bc5-e01a7ebff78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":24415},{"type":"v1","addr":"172.21.15.121:6801","nonce":24415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":24415},{"type":"v1","addr":"172.21.15.121:6803","nonce":24415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":24415},{"type":"v1","addr":"172.21.15.121:6807","nonce":24415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":24415},{"type":"v1","addr":"172.21.15.121:6805","nonce":24415}]},"public_addr":"172.21.15.121:6801/24415","cluster_addr":"172.21.15.121:6803/24415","heartbeat_back_addr":"172.21.15.121:6807/24415","heartbeat_front_addr":"172.21.15.121:6805/24415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.121851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.350087+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.152568+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.132856+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.397183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.260530+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.170506+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.038863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6835/2189006578":"2024-08-18T02:29:10.097147+0000","172.21.15.121:6834/2189006578":"2024-08-18T02:29:10.097147+0000","172.21.15.102:6837/1340437033":"2024-08-18T02:29:03.879648+0000","172.21.15.102:6836/1340437033":"2024-08-18T02:29:03.879648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:16.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.421+0000 7f9043fff700 1 -- 172.21.15.102:0/3956306466 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9024060860 msgr2=0x7f9024062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.421+0000 7f9043fff700 1 --2- 172.21.15.102:0/3956306466 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9024060860 0x7f9024062d10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9034011310 tx=0x7f90340091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.421+0000 7f9043fff700 1 -- 172.21.15.102:0/3956306466 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90440ad7c0 msgr2=0x7f904413a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.421+0000 7f9043fff700 1 --2- 172.21.15.102:0/3956306466 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90440ad7c0 0x7f904413a730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f902c016000 tx=0x7f902c017000 comp rx=0 tx=0).stop 2024-08-17T02:29:16.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.421+0000 7f9043fff700 1 -- 172.21.15.102:0/3956306466 shutdown_connections 2024-08-17T02:29:16.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.421+0000 7f9043fff700 1 --2- 172.21.15.102:0/3956306466 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9024060860 0x7f9024062d10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.421+0000 7f9043fff700 1 --2- 172.21.15.102:0/3956306466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9044155d20 0x7f904414fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.421+0000 7f9043fff700 1 --2- 172.21.15.102:0/3956306466 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f90440ad7c0 0x7f904413a730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.421+0000 7f9043fff700 1 --2- 172.21.15.102:0/3956306466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f904406df10 0x7f904414c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.421+0000 7f9043fff700 1 -- 172.21.15.102:0/3956306466 >> 172.21.15.102:0/3956306466 conn(0x7f90440678d0 msgr2=0x7f904415d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.425+0000 7f9043fff700 1 -- 172.21.15.102:0/3956306466 shutdown_connections 2024-08-17T02:29:16.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:16.425+0000 7f9043fff700 1 -- 172.21.15.102:0/3956306466 wait complete. 2024-08-17T02:29:17.437 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:29:17.438 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:17.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642ed4b700 1 Processor -- start 2024-08-17T02:29:17.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642ed4b700 1 -- start start 2024-08-17T02:29:17.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642ed4b700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64280b26d0 0x7f64280b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642ed4b700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f64280cded0 0x7f64280ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642ed4b700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64280c5b40 con 0x7f64280c5fd0 2024-08-17T02:29:17.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642ed4b700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64280b2aa0 con 0x7f64280cded0 2024-08-17T02:29:17.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642ed4b700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6428159820 con 0x7f64280b26d0 2024-08-17T02:29:17.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642d548700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f64280c5fd0 0x7f64280c6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55934/0 (socket says 172.21.15.102:55934) 2024-08-17T02:29:17.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642d548700 1 -- 172.21.15.102:0/2597242659 learned_addr learned my addr 172.21.15.102:0/2597242659 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:17.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642dd49700 1 --2- 172.21.15.102:0/2597242659 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64280b26d0 0x7f64280b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642e54a700 1 --2- 172.21.15.102:0/2597242659 >> v2:172.21.15.121:3300/0 conn(0x7f64280cded0 0x7f64280ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642cd47700 1 -- 172.21.15.102:0/2597242659 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578267129 0 0) 0x7f64280c5b40 con 0x7f64280c5fd0 2024-08-17T02:29:17.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642cd47700 1 -- 172.21.15.102:0/2597242659 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6414003570 con 0x7f64280c5fd0 2024-08-17T02:29:17.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642e54a700 1 -- 172.21.15.102:0/2597242659 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64280b26d0 msgr2=0x7f64280b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:17.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642e54a700 1 --2- 172.21.15.102:0/2597242659 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64280b26d0 0x7f64280b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642e54a700 1 -- 172.21.15.102:0/2597242659 >> v1:172.21.15.102:6789/0 conn(0x7f64280c5fd0 legacy=0x7f64280c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642cd47700 1 -- 172.21.15.102:0/2597242659 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1676515173 0 0) 0x7f6414003570 con 0x7f64280c5fd0 2024-08-17T02:29:17.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642e54a700 1 -- 172.21.15.102:0/2597242659 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64280c4f30 con 0x7f64280cded0 2024-08-17T02:29:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642dd49700 1 --2- 172.21.15.102:0/2597242659 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64280b26d0 0x7f64280b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642e54a700 1 --2- 172.21.15.102:0/2597242659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64280cded0 0x7f64280ce350 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6420009e60 tx=0x7f6420009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d04804b40f3cde2a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642cd47700 1 -- 172.21.15.102:0/2597242659 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642000e070 con 0x7f64280cded0 2024-08-17T02:29:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642cd47700 1 -- 172.21.15.102:0/2597242659 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642000bab0 con 0x7f64280cded0 2024-08-17T02:29:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.561+0000 7f642cd47700 1 -- 172.21.15.102:0/2597242659 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642000be70 con 0x7f64280cded0 2024-08-17T02:29:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.565+0000 7f642ed4b700 1 -- 172.21.15.102:0/2597242659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64280cded0 msgr2=0x7f64280ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.565+0000 7f642ed4b700 1 --2- 172.21.15.102:0/2597242659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64280cded0 0x7f64280ce350 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6420009e60 tx=0x7f6420009780 comp rx=0 tx=0).stop 2024-08-17T02:29:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.565+0000 7f642ed4b700 1 -- 172.21.15.102:0/2597242659 shutdown_connections 2024-08-17T02:29:17.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.565+0000 7f642ed4b700 1 --2- 172.21.15.102:0/2597242659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64280cded0 0x7f64280ce350 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.565+0000 7f642ed4b700 1 --2- 172.21.15.102:0/2597242659 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64280b26d0 0x7f64280b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.565+0000 7f642ed4b700 1 -- 172.21.15.102:0/2597242659 >> 172.21.15.102:0/2597242659 conn(0x7f6428067590 msgr2=0x7f64280d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.565+0000 7f642ed4b700 1 -- 172.21.15.102:0/2597242659 shutdown_connections 2024-08-17T02:29:17.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.565+0000 7f642ed4b700 1 -- 172.21.15.102:0/2597242659 wait complete. 2024-08-17T02:29:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.565+0000 7f642ed4b700 1 Processor -- start 2024-08-17T02:29:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.565+0000 7f642ed4b700 1 -- start start 2024-08-17T02:29:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.565+0000 7f642ed4b700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64280b26d0 0x7f64280c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.565+0000 7f642ed4b700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64280c5fd0 0x7f642815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.565+0000 7f642ed4b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64280cded0 0x7f6428154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.565+0000 7f642ed4b700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64280c8b50 con 0x7f64280cded0 2024-08-17T02:29:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f642ed4b700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642815b210 con 0x7f64280c5fd0 2024-08-17T02:29:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f642ed4b700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642815c050 con 0x7f64280b26d0 2024-08-17T02:29:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f642e54a700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64280cded0 0x7f6428154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f642d548700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64280c5fd0 0x7f642815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f642dd49700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64280b26d0 0x7f64280c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f642e54a700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64280cded0 0x7f6428154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33976/0 (socket says 172.21.15.102:33976) 2024-08-17T02:29:17.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f642e54a700 1 -- 172.21.15.102:0/1718396802 learned_addr learned my addr 172.21.15.102:0/1718396802 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:17.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f642e54a700 1 -- 172.21.15.102:0/1718396802 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64280b26d0 msgr2=0x7f64280c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f642e54a700 1 --2- 172.21.15.102:0/1718396802 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f64280b26d0 0x7f64280c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f642e54a700 1 -- 172.21.15.102:0/1718396802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64280c5fd0 msgr2=0x7f642815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f642e54a700 1 --2- 172.21.15.102:0/1718396802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64280c5fd0 0x7f642815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f642e54a700 1 -- 172.21.15.102:0/1718396802 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6418009420 con 0x7f64280cded0 2024-08-17T02:29:17.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f642e54a700 1 --2- 172.21.15.102:0/1718396802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64280cded0 0x7f6428154c40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6428089170 tx=0x7f6420019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f641dffb700 1 -- 172.21.15.102:0/1718396802 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420012dd0 con 0x7f64280cded0 2024-08-17T02:29:17.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f641dffb700 1 -- 172.21.15.102:0/1718396802 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6420026480 con 0x7f64280cded0 2024-08-17T02:29:17.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f642ed4b700 1 -- 172.21.15.102:0/1718396802 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6420009a20 con 0x7f64280cded0 2024-08-17T02:29:17.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f641dffb700 1 -- 172.21.15.102:0/1718396802 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420026840 con 0x7f64280cded0 2024-08-17T02:29:17.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f642ed4b700 1 -- 172.21.15.102:0/1718396802 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642815b7a0 con 0x7f64280cded0 2024-08-17T02:29:17.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.569+0000 7f642ed4b700 1 -- 172.21.15.102:0/1718396802 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64280644b0 con 0x7f64280cded0 2024-08-17T02:29:17.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.573+0000 7f641dffb700 1 -- 172.21.15.102:0/1718396802 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f642001c400 con 0x7f64280cded0 2024-08-17T02:29:17.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.573+0000 7f641dffb700 1 --2- 172.21.15.102:0/1718396802 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f640c060860 0x7f640c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.573+0000 7f641dffb700 1 -- 172.21.15.102:0/1718396802 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f642007e780 con 0x7f64280cded0 2024-08-17T02:29:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.573+0000 7f642dd49700 1 --2- 172.21.15.102:0/1718396802 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f640c060860 0x7f640c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.573+0000 7f641dffb700 1 --2- 172.21.15.102:0/1718396802 >> [v2:172.21.15.102:6816/24227,v1:172.21.15.102:6817/24227] conn(0x7f640c066750 0x7f640c068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.573+0000 7f641dffb700 1 -- 172.21.15.102:0/1718396802 --> [v2:172.21.15.102:6816/24227,v1:172.21.15.102:6817/24227] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f640c069210 con 0x7f640c066750 2024-08-17T02:29:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.573+0000 7f641dffb700 1 -- 172.21.15.102:0/1718396802 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6420080dc0 con 0x7f64280cded0 2024-08-17T02:29:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.573+0000 7f642d548700 1 --2- 172.21.15.102:0/1718396802 >> [v2:172.21.15.102:6816/24227,v1:172.21.15.102:6817/24227] conn(0x7f640c066750 0x7f640c068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.573+0000 7f642d548700 1 --2- 172.21.15.102:0/1718396802 >> [v2:172.21.15.102:6816/24227,v1:172.21.15.102:6817/24227] conn(0x7f640c066750 0x7f640c068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.573+0000 7f642dd49700 1 --2- 172.21.15.102:0/1718396802 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f640c060860 0x7f640c062d10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6418009ea0 tx=0x7f64180091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.573+0000 7f641dffb700 1 -- 172.21.15.102:0/1718396802 <== osd.0 v2:172.21.15.102:6816/24227 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f640c069210 con 0x7f640c066750 2024-08-17T02:29:17.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.589+0000 7f642ed4b700 1 -- 172.21.15.102:0/1718396802 --> [v2:172.21.15.102:6816/24227,v1:172.21.15.102:6817/24227] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f64280cb4e0 con 0x7f640c066750 2024-08-17T02:29:17.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.589+0000 7f641dffb700 1 -- 172.21.15.102:0/1718396802 <== osd.0 v2:172.21.15.102:6816/24227 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f64280cb4e0 con 0x7f640c066750 2024-08-17T02:29:17.593 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-08-17T02:29:17.593 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:17.594 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-08-17T02:29:17.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.589+0000 7f642ed4b700 1 -- 172.21.15.102:0/1718396802 >> [v2:172.21.15.102:6816/24227,v1:172.21.15.102:6817/24227] conn(0x7f640c066750 msgr2=0x7f640c068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.589+0000 7f642ed4b700 1 --2- 172.21.15.102:0/1718396802 >> [v2:172.21.15.102:6816/24227,v1:172.21.15.102:6817/24227] conn(0x7f640c066750 0x7f640c068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.589+0000 7f642ed4b700 1 -- 172.21.15.102:0/1718396802 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f640c060860 msgr2=0x7f640c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.589+0000 7f642ed4b700 1 --2- 172.21.15.102:0/1718396802 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f640c060860 0x7f640c062d10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6418009ea0 tx=0x7f64180091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.589+0000 7f642ed4b700 1 -- 172.21.15.102:0/1718396802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64280cded0 msgr2=0x7f6428154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.589+0000 7f642ed4b700 1 --2- 172.21.15.102:0/1718396802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64280cded0 0x7f6428154c40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6428089170 tx=0x7f6420019000 comp rx=0 tx=0).stop 2024-08-17T02:29:17.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.589+0000 7f642e54a700 1 -- 172.21.15.102:0/1718396802 reap_dead start 2024-08-17T02:29:17.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.589+0000 7f642ed4b700 1 -- 172.21.15.102:0/1718396802 shutdown_connections 2024-08-17T02:29:17.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.589+0000 7f642ed4b700 1 -- 172.21.15.102:0/1718396802 >> 172.21.15.102:0/1718396802 conn(0x7f6428067590 msgr2=0x7f6428068320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.593+0000 7f642ed4b700 1 -- 172.21.15.102:0/1718396802 shutdown_connections 2024-08-17T02:29:17.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.593+0000 7f642ed4b700 1 -- 172.21.15.102:0/1718396802 wait complete. 2024-08-17T02:29:17.606 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:29:17.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.717+0000 7f8b93fff700 1 Processor -- start 2024-08-17T02:29:17.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.717+0000 7f8b93fff700 1 -- start start 2024-08-17T02:29:17.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.717+0000 7f8b93fff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8b94159040 0x7f8b940cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.717+0000 7f8b93fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8b9415d5b0 0x7f8b940d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.717+0000 7f8b93fff700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b940cf190 con 0x7f8b940d0010 2024-08-17T02:29:17.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.717+0000 7f8b93fff700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b940d09a0 con 0x7f8b94159040 2024-08-17T02:29:17.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.717+0000 7f8b93fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940ce5e0 con 0x7f8b9415d5b0 2024-08-17T02:29:17.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.717+0000 7f8b8bfff700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f8b940d0010 0x7f8b9415cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55938/0 (socket says 172.21.15.102:55938) 2024-08-17T02:29:17.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.717+0000 7f8b8bfff700 1 -- 172.21.15.102:0/3821020639 learned_addr learned my addr 172.21.15.102:0/3821020639 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:17.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.717+0000 7f8b937fe700 1 --2- 172.21.15.102:0/3821020639 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8b9415d5b0 0x7f8b940d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.717+0000 7f8b92ffd700 1 --2- 172.21.15.102:0/3821020639 >> v2:172.21.15.121:3300/0 conn(0x7f8b94159040 0x7f8b940cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b927fc700 1 -- 172.21.15.102:0/3821020639 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244659694 0 0) 0x7f8b940cf190 con 0x7f8b940d0010 2024-08-17T02:29:17.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b927fc700 1 -- 172.21.15.102:0/3821020639 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b80003570 con 0x7f8b940d0010 2024-08-17T02:29:17.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b937fe700 1 -- 172.21.15.102:0/3821020639 >> v2:172.21.15.121:3300/0 conn(0x7f8b94159040 msgr2=0x7f8b940cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:17.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b937fe700 1 --2- 172.21.15.102:0/3821020639 >> v2:172.21.15.121:3300/0 conn(0x7f8b94159040 0x7f8b940cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b937fe700 1 -- 172.21.15.102:0/3821020639 >> v1:172.21.15.102:6789/0 conn(0x7f8b940d0010 legacy=0x7f8b9415cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b937fe700 1 -- 172.21.15.102:0/3821020639 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b940ce860 con 0x7f8b9415d5b0 2024-08-17T02:29:17.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b92ffd700 1 --2- 172.21.15.102:0/3821020639 >> v2:172.21.15.121:3300/0 conn(0x7f8b94159040 0x7f8b940cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:17.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b937fe700 1 --2- 172.21.15.102:0/3821020639 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8b9415d5b0 0x7f8b940d0460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009e60 tx=0x7f8b8c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cd393f819e25526 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b927fc700 1 -- 172.21.15.102:0/3821020639 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00e070 con 0x7f8b9415d5b0 2024-08-17T02:29:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b927fc700 1 -- 172.21.15.102:0/3821020639 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c00bab0 con 0x7f8b9415d5b0 2024-08-17T02:29:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b927fc700 1 -- 172.21.15.102:0/3821020639 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00be70 con 0x7f8b9415d5b0 2024-08-17T02:29:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b93fff700 1 -- 172.21.15.102:0/3821020639 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8b9415d5b0 msgr2=0x7f8b940d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b93fff700 1 --2- 172.21.15.102:0/3821020639 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8b9415d5b0 0x7f8b940d0460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009e60 tx=0x7f8b8c009780 comp rx=0 tx=0).stop 2024-08-17T02:29:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b93fff700 1 -- 172.21.15.102:0/3821020639 shutdown_connections 2024-08-17T02:29:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b93fff700 1 --2- 172.21.15.102:0/3821020639 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8b9415d5b0 0x7f8b940d0460 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b93fff700 1 --2- 172.21.15.102:0/3821020639 >> v2:172.21.15.121:3300/0 conn(0x7f8b94159040 0x7f8b940cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b93fff700 1 -- 172.21.15.102:0/3821020639 >> 172.21.15.102:0/3821020639 conn(0x7f8b94068250 msgr2=0x7f8b94068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b93fff700 1 -- 172.21.15.102:0/3821020639 shutdown_connections 2024-08-17T02:29:17.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.721+0000 7f8b93fff700 1 -- 172.21.15.102:0/3821020639 wait complete. 2024-08-17T02:29:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b93fff700 1 Processor -- start 2024-08-17T02:29:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b93fff700 1 -- start start 2024-08-17T02:29:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b93fff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b940d0010 0x7f8b94169380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b93fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b94159040 0x7f8b940b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b93fff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8b9415d5b0 0x7f8b94155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b93fff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940a6d00 con 0x7f8b940d0010 2024-08-17T02:29:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b93fff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940a69b0 con 0x7f8b94159040 2024-08-17T02:29:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b93fff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b94169bd0 con 0x7f8b9415d5b0 2024-08-17T02:29:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b92ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b940d0010 0x7f8b94169380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b92ffd700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b940d0010 0x7f8b94169380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33980/0 (socket says 172.21.15.102:33980) 2024-08-17T02:29:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b92ffd700 1 -- 172.21.15.102:0/1340389 learned_addr learned my addr 172.21.15.102:0/1340389 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b8bfff700 1 --2- 172.21.15.102:0/1340389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b94159040 0x7f8b940b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b937fe700 1 --2- 172.21.15.102:0/1340389 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8b9415d5b0 0x7f8b94155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b92ffd700 1 -- 172.21.15.102:0/1340389 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8b9415d5b0 msgr2=0x7f8b94155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b92ffd700 1 --2- 172.21.15.102:0/1340389 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8b9415d5b0 0x7f8b94155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b92ffd700 1 -- 172.21.15.102:0/1340389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b94159040 msgr2=0x7f8b940b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b92ffd700 1 --2- 172.21.15.102:0/1340389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b94159040 0x7f8b940b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b92ffd700 1 -- 172.21.15.102:0/1340389 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b84009420 con 0x7f8b940d0010 2024-08-17T02:29:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b8bfff700 1 --2- 172.21.15.102:0/1340389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b94159040 0x7f8b940b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b92ffd700 1 --2- 172.21.15.102:0/1340389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b940d0010 0x7f8b94169380 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400ec80 tx=0x7f8b840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b8affd700 1 -- 172.21.15.102:0/1340389 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8400c920 con 0x7f8b940d0010 2024-08-17T02:29:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b8affd700 1 -- 172.21.15.102:0/1340389 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8400ca80 con 0x7f8b940d0010 2024-08-17T02:29:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b93fff700 1 -- 172.21.15.102:0/1340389 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8c009a20 con 0x7f8b940d0010 2024-08-17T02:29:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b8affd700 1 -- 172.21.15.102:0/1340389 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8400ce00 con 0x7f8b940d0010 2024-08-17T02:29:17.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.725+0000 7f8b93fff700 1 -- 172.21.15.102:0/1340389 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9416a190 con 0x7f8b940d0010 2024-08-17T02:29:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.729+0000 7f8b93fff700 1 -- 172.21.15.102:0/1340389 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b940a6b20 con 0x7f8b940d0010 2024-08-17T02:29:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.729+0000 7f8b8affd700 1 -- 172.21.15.102:0/1340389 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8b84013680 con 0x7f8b940d0010 2024-08-17T02:29:17.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.729+0000 7f8b8affd700 1 --2- 172.21.15.102:0/1340389 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8b74060860 0x7f8b74062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.729+0000 7f8b8affd700 1 -- 172.21.15.102:0/1340389 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f8b8407cc90 con 0x7f8b940d0010 2024-08-17T02:29:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.729+0000 7f8b8bfff700 1 --2- 172.21.15.102:0/1340389 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8b74060860 0x7f8b74062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.733+0000 7f8b8bfff700 1 --2- 172.21.15.102:0/1340389 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8b74060860 0x7f8b74062d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8b9415c920 tx=0x7f8b7c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.737+0000 7f8b8affd700 1 -- 172.21.15.102:0/1340389 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8b8404d380 con 0x7f8b940d0010 2024-08-17T02:29:17.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.897+0000 7f8b93fff700 1 -- 172.21.15.102:0/1340389 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b940a6e40 con 0x7f8b74060860 2024-08-17T02:29:17.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.897+0000 7f8b8affd700 1 -- 172.21.15.102:0/1340389 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8b7c00fa30 con 0x7f8b74060860 2024-08-17T02:29:17.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.901+0000 7f8b93fff700 1 -- 172.21.15.102:0/1340389 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8b74060860 msgr2=0x7f8b74062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.901+0000 7f8b93fff700 1 --2- 172.21.15.102:0/1340389 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8b74060860 0x7f8b74062d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8b9415c920 tx=0x7f8b7c009040 comp rx=0 tx=0).stop 2024-08-17T02:29:17.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.901+0000 7f8b93fff700 1 -- 172.21.15.102:0/1340389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b940d0010 msgr2=0x7f8b94169380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.901+0000 7f8b93fff700 1 --2- 172.21.15.102:0/1340389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b940d0010 0x7f8b94169380 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400ec80 tx=0x7f8b840091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.901+0000 7f8b93fff700 1 -- 172.21.15.102:0/1340389 shutdown_connections 2024-08-17T02:29:17.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.901+0000 7f8b93fff700 1 --2- 172.21.15.102:0/1340389 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f8b74060860 0x7f8b74062d10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.901+0000 7f8b93fff700 1 --2- 172.21.15.102:0/1340389 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f8b9415d5b0 0x7f8b94155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.901+0000 7f8b93fff700 1 --2- 172.21.15.102:0/1340389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b94159040 0x7f8b940b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.901+0000 7f8b93fff700 1 --2- 172.21.15.102:0/1340389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b940d0010 0x7f8b94169380 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.901+0000 7f8b93fff700 1 -- 172.21.15.102:0/1340389 >> 172.21.15.102:0/1340389 conn(0x7f8b94068250 msgr2=0x7f8b94156ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.901+0000 7f8b93fff700 1 -- 172.21.15.102:0/1340389 shutdown_connections 2024-08-17T02:29:17.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:17.901+0000 7f8b93fff700 1 -- 172.21.15.102:0/1340389 wait complete. 2024-08-17T02:29:17.906 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:29:17.915 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:29:17.915 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:18.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.025+0000 7fe231e02700 1 Processor -- start 2024-08-17T02:29:18.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe231e02700 1 -- start start 2024-08-17T02:29:18.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe231e02700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe22c0b26d0 0x7fe22c0b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe231e02700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c0c5b40 con 0x7fe22c0cded0 2024-08-17T02:29:18.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe231e02700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c0b2aa0 con 0x7fe22c0c5fd0 2024-08-17T02:29:18.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe231e02700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22c159820 con 0x7fe22c0b26d0 2024-08-17T02:29:18.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe230e00700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe22c0b26d0 0x7fe22c0b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe231601700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe22c0cded0 0x7fe22c0ce330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55954/0 (socket says 172.21.15.102:55954) 2024-08-17T02:29:18.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe231601700 1 -- 172.21.15.102:0/1448086968 learned_addr learned my addr 172.21.15.102:0/1448086968 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:18.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe230e00700 1 -- 172.21.15.102:0/1448086968 >> v1:172.21.15.121:6789/0 conn(0x7fe22c0c5fd0 legacy=0x7fe22c0c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:18.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe230e00700 1 -- 172.21.15.102:0/1448086968 >> v1:172.21.15.102:6789/0 conn(0x7fe22c0cded0 legacy=0x7fe22c0ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe230e00700 1 -- 172.21.15.102:0/1448086968 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c0c4f30 con 0x7fe22c0b26d0 2024-08-17T02:29:18.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe230e00700 1 --2- 172.21.15.102:0/1448086968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe22c0b26d0 0x7fe22c0b2e90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009910 tx=0x7fe21c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9149d170c741a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe22b7fe700 1 -- 172.21.15.102:0/1448086968 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c00b820 con 0x7fe22c0b26d0 2024-08-17T02:29:18.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe22b7fe700 1 -- 172.21.15.102:0/1448086968 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c00b980 con 0x7fe22c0b26d0 2024-08-17T02:29:18.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe22b7fe700 1 -- 172.21.15.102:0/1448086968 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c00bd20 con 0x7fe22c0b26d0 2024-08-17T02:29:18.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe231e02700 1 -- 172.21.15.102:0/1448086968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe22c0b26d0 msgr2=0x7fe22c0b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe231e02700 1 --2- 172.21.15.102:0/1448086968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe22c0b26d0 0x7fe22c0b2e90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009910 tx=0x7fe21c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe231e02700 1 -- 172.21.15.102:0/1448086968 shutdown_connections 2024-08-17T02:29:18.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe231e02700 1 --2- 172.21.15.102:0/1448086968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe22c0b26d0 0x7fe22c0b2e90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe231e02700 1 -- 172.21.15.102:0/1448086968 >> 172.21.15.102:0/1448086968 conn(0x7fe22c067590 msgr2=0x7fe22c0d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe231e02700 1 -- 172.21.15.102:0/1448086968 shutdown_connections 2024-08-17T02:29:18.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.029+0000 7fe231e02700 1 -- 172.21.15.102:0/1448086968 wait complete. 2024-08-17T02:29:18.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe231e02700 1 Processor -- start 2024-08-17T02:29:18.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe231e02700 1 -- start start 2024-08-17T02:29:18.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe231e02700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe22c0b26d0 0x7fe22c16ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe231e02700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe22c0c5fd0 0x7fe22c0b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe231e02700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe22c0cded0 0x7fe22c155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe231e02700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c154bd0 con 0x7fe22c0b26d0 2024-08-17T02:29:18.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe231e02700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c1548c0 con 0x7fe22c0cded0 2024-08-17T02:29:18.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe231e02700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c16d100 con 0x7fe22c0c5fd0 2024-08-17T02:29:18.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe230e00700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe22c0b26d0 0x7fe22c16ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe230e00700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe22c0b26d0 0x7fe22c16ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33994/0 (socket says 172.21.15.102:33994) 2024-08-17T02:29:18.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe230e00700 1 -- 172.21.15.102:0/3624928655 learned_addr learned my addr 172.21.15.102:0/3624928655 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:18.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe231601700 1 --2- 172.21.15.102:0/3624928655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe22c0cded0 0x7fe22c155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe22bfff700 1 --2- 172.21.15.102:0/3624928655 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe22c0c5fd0 0x7fe22c0b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe230e00700 1 -- 172.21.15.102:0/3624928655 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe22c0c5fd0 msgr2=0x7fe22c0b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe230e00700 1 --2- 172.21.15.102:0/3624928655 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe22c0c5fd0 0x7fe22c0b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe230e00700 1 -- 172.21.15.102:0/3624928655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe22c0cded0 msgr2=0x7fe22c155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.033+0000 7fe230e00700 1 --2- 172.21.15.102:0/3624928655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe22c0cded0 0x7fe22c155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.037+0000 7fe230e00700 1 -- 172.21.15.102:0/3624928655 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c009420 con 0x7fe22c0b26d0 2024-08-17T02:29:18.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.037+0000 7fe22bfff700 1 --2- 172.21.15.102:0/3624928655 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fe22c0c5fd0 0x7fe22c0b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:18.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.037+0000 7fe230e00700 1 --2- 172.21.15.102:0/3624928655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe22c0b26d0 0x7fe22c16ca20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00b3c0 tx=0x7fe21c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.037+0000 7fe228ff9700 1 -- 172.21.15.102:0/3624928655 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c024440 con 0x7fe22c0b26d0 2024-08-17T02:29:18.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.037+0000 7fe228ff9700 1 -- 172.21.15.102:0/3624928655 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c0245c0 con 0x7fe22c0b26d0 2024-08-17T02:29:18.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.037+0000 7fe231e02700 1 -- 172.21.15.102:0/3624928655 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c16d3e0 con 0x7fe22c0b26d0 2024-08-17T02:29:18.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.037+0000 7fe228ff9700 1 -- 172.21.15.102:0/3624928655 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c024980 con 0x7fe22c0b26d0 2024-08-17T02:29:18.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.037+0000 7fe231e02700 1 -- 172.21.15.102:0/3624928655 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c0b4d50 con 0x7fe22c0b26d0 2024-08-17T02:29:18.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.037+0000 7fe231e02700 1 -- 172.21.15.102:0/3624928655 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe22c0b4f40 con 0x7fe22c0b26d0 2024-08-17T02:29:18.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.037+0000 7fe228ff9700 1 -- 172.21.15.102:0/3624928655 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe21c01a420 con 0x7fe22c0b26d0 2024-08-17T02:29:18.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.041+0000 7fe228ff9700 1 --2- 172.21.15.102:0/3624928655 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe20c060860 0x7fe20c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.041+0000 7fe22bfff700 1 --2- 172.21.15.102:0/3624928655 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe20c060860 0x7fe20c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.041+0000 7fe228ff9700 1 -- 172.21.15.102:0/3624928655 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe21c07ed10 con 0x7fe22c0b26d0 2024-08-17T02:29:18.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.041+0000 7fe228ff9700 1 --2- 172.21.15.102:0/3624928655 >> [v2:172.21.15.102:6824/24224,v1:172.21.15.102:6825/24224] conn(0x7fe20c066750 0x7fe20c068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.041+0000 7fe228ff9700 1 -- 172.21.15.102:0/3624928655 --> [v2:172.21.15.102:6824/24224,v1:172.21.15.102:6825/24224] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe20c069210 con 0x7fe20c066750 2024-08-17T02:29:18.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.041+0000 7fe228ff9700 1 -- 172.21.15.102:0/3624928655 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe21c07f0b0 con 0x7fe22c0b26d0 2024-08-17T02:29:18.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.041+0000 7fe231601700 1 --2- 172.21.15.102:0/3624928655 >> [v2:172.21.15.102:6824/24224,v1:172.21.15.102:6825/24224] conn(0x7fe20c066750 0x7fe20c068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.041+0000 7fe22bfff700 1 --2- 172.21.15.102:0/3624928655 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe20c060860 0x7fe20c062d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0cde40 tx=0x7fe214009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.041+0000 7fe231601700 1 --2- 172.21.15.102:0/3624928655 >> [v2:172.21.15.102:6824/24224,v1:172.21.15.102:6825/24224] conn(0x7fe20c066750 0x7fe20c068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.041+0000 7fe228ff9700 1 -- 172.21.15.102:0/3624928655 <== osd.1 v2:172.21.15.102:6824/24224 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe20c069210 con 0x7fe20c066750 2024-08-17T02:29:18.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.057+0000 7fe231e02700 1 -- 172.21.15.102:0/3624928655 --> [v2:172.21.15.102:6824/24224,v1:172.21.15.102:6825/24224] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe22c0644b0 con 0x7fe20c066750 2024-08-17T02:29:18.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.057+0000 7fe228ff9700 1 -- 172.21.15.102:0/3624928655 <== osd.1 v2:172.21.15.102:6824/24224 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe22c0644b0 con 0x7fe20c066750 2024-08-17T02:29:18.060 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-08-17T02:29:18.060 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:18.060 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-08-17T02:29:18.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.057+0000 7fe231e02700 1 -- 172.21.15.102:0/3624928655 >> [v2:172.21.15.102:6824/24224,v1:172.21.15.102:6825/24224] conn(0x7fe20c066750 msgr2=0x7fe20c068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.057+0000 7fe231e02700 1 --2- 172.21.15.102:0/3624928655 >> [v2:172.21.15.102:6824/24224,v1:172.21.15.102:6825/24224] conn(0x7fe20c066750 0x7fe20c068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.057+0000 7fe231e02700 1 -- 172.21.15.102:0/3624928655 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe20c060860 msgr2=0x7fe20c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.057+0000 7fe231e02700 1 --2- 172.21.15.102:0/3624928655 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fe20c060860 0x7fe20c062d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0cde40 tx=0x7fe214009040 comp rx=0 tx=0).stop 2024-08-17T02:29:18.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.057+0000 7fe231e02700 1 -- 172.21.15.102:0/3624928655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe22c0b26d0 msgr2=0x7fe22c16ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.057+0000 7fe231e02700 1 --2- 172.21.15.102:0/3624928655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe22c0b26d0 0x7fe22c16ca20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00b3c0 tx=0x7fe21c017000 comp rx=0 tx=0).stop 2024-08-17T02:29:18.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.057+0000 7fe231601700 1 -- 172.21.15.102:0/3624928655 reap_dead start 2024-08-17T02:29:18.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.057+0000 7fe231e02700 1 -- 172.21.15.102:0/3624928655 shutdown_connections 2024-08-17T02:29:18.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.057+0000 7fe231e02700 1 -- 172.21.15.102:0/3624928655 >> 172.21.15.102:0/3624928655 conn(0x7fe22c067590 msgr2=0x7fe22c0cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.057+0000 7fe231e02700 1 -- 172.21.15.102:0/3624928655 shutdown_connections 2024-08-17T02:29:18.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.057+0000 7fe231e02700 1 -- 172.21.15.102:0/3624928655 wait complete. 2024-08-17T02:29:18.072 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:29:18.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1e35700 1 Processor -- start 2024-08-17T02:29:18.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1e35700 1 -- start start 2024-08-17T02:29:18.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1e35700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35bc0b14a0 0x7f35bc0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1e35700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f35bc0cb390 0x7f35bc160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1e35700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35bc0cbaa0 con 0x7f35bc154900 2024-08-17T02:29:18.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1e35700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35bc068790 con 0x7f35bc0cb390 2024-08-17T02:29:18.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1e35700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc1583f0 con 0x7f35bc0b14a0 2024-08-17T02:29:18.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35bbfff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35bc0b14a0 0x7f35bc0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1634700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f35bc0cb390 0x7f35bc160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c0e33700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f35bc154900 0x7f35bc0b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:60772/0 (socket says 172.21.15.102:60772) 2024-08-17T02:29:18.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1634700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f35bc0cb390 0x7f35bc160ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:55896/0 (socket says 172.21.15.102:55896) 2024-08-17T02:29:18.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35bbfff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35bc0b14a0 0x7f35bc0cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:37462/0 (socket says 172.21.15.102:37462) 2024-08-17T02:29:18.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c0e33700 1 -- 172.21.15.102:0/2770083201 learned_addr learned my addr 172.21.15.102:0/2770083201 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:18.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1634700 1 -- 172.21.15.102:0/2770083201 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35bc0b14a0 msgr2=0x7f35bc0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:18.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1634700 1 --2- 172.21.15.102:0/2770083201 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35bc0b14a0 0x7f35bc0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1634700 1 -- 172.21.15.102:0/2770083201 >> v1:172.21.15.121:6789/0 conn(0x7f35bc154900 legacy=0x7f35bc0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1634700 1 -- 172.21.15.102:0/2770083201 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc157630 con 0x7f35bc0cb390 2024-08-17T02:29:18.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1634700 1 --2- 172.21.15.102:0/2770083201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35bc0cb390 0x7f35bc160ac0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009e60 tx=0x7f35b4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42d3138cd405d741 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35bb7fe700 1 -- 172.21.15.102:0/2770083201 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400e070 con 0x7f35bc0cb390 2024-08-17T02:29:18.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35bb7fe700 1 -- 172.21.15.102:0/2770083201 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b400bb60 con 0x7f35bc0cb390 2024-08-17T02:29:18.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35bb7fe700 1 -- 172.21.15.102:0/2770083201 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4012430 con 0x7f35bc0cb390 2024-08-17T02:29:18.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1e35700 1 -- 172.21.15.102:0/2770083201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35bc0cb390 msgr2=0x7f35bc160ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1e35700 1 --2- 172.21.15.102:0/2770083201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35bc0cb390 0x7f35bc160ac0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009e60 tx=0x7f35b4009780 comp rx=0 tx=0).stop 2024-08-17T02:29:18.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1e35700 1 -- 172.21.15.102:0/2770083201 shutdown_connections 2024-08-17T02:29:18.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1e35700 1 --2- 172.21.15.102:0/2770083201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35bc0cb390 0x7f35bc160ac0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1e35700 1 --2- 172.21.15.102:0/2770083201 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35bc0b14a0 0x7f35bc0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1e35700 1 -- 172.21.15.102:0/2770083201 >> 172.21.15.102:0/2770083201 conn(0x7f35bc0678d0 msgr2=0x7f35bc067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1e35700 1 -- 172.21.15.102:0/2770083201 shutdown_connections 2024-08-17T02:29:18.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.181+0000 7f35c1e35700 1 -- 172.21.15.102:0/2770083201 wait complete. 2024-08-17T02:29:18.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35c1e35700 1 Processor -- start 2024-08-17T02:29:18.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35c1e35700 1 -- start start 2024-08-17T02:29:18.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35c1e35700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35bc0b14a0 0x7f35bc0c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35c1e35700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35bc0cb390 0x7f35bc14f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35c1e35700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35bc154900 0x7f35bc06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35c1e35700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0aadc0 con 0x7f35bc0cb390 2024-08-17T02:29:18.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35c1e35700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0aa1f0 con 0x7f35bc154900 2024-08-17T02:29:18.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35c1e35700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0aa490 con 0x7f35bc0b14a0 2024-08-17T02:29:18.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35bbfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35bc0cb390 0x7f35bc14f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35c0e33700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35bc0b14a0 0x7f35bc0c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35bbfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35bc0cb390 0x7f35bc14f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34002/0 (socket says 172.21.15.102:34002) 2024-08-17T02:29:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35c1634700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35bc154900 0x7f35bc06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35c0e33700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35bc0b14a0 0x7f35bc0c7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:37476/0 (socket says 172.21.15.102:37476) 2024-08-17T02:29:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35bbfff700 1 -- 172.21.15.102:0/664467383 learned_addr learned my addr 172.21.15.102:0/664467383 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35bbfff700 1 -- 172.21.15.102:0/664467383 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35bc0b14a0 msgr2=0x7f35bc0c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35bbfff700 1 --2- 172.21.15.102:0/664467383 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35bc0b14a0 0x7f35bc0c7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35bbfff700 1 -- 172.21.15.102:0/664467383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35bc154900 msgr2=0x7f35bc06e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35bbfff700 1 --2- 172.21.15.102:0/664467383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35bc154900 0x7f35bc06e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35bbfff700 1 -- 172.21.15.102:0/664467383 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b4009a20 con 0x7f35bc0cb390 2024-08-17T02:29:18.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35c0e33700 1 --2- 172.21.15.102:0/664467383 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35bc0b14a0 0x7f35bc0c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:18.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.185+0000 7f35bbfff700 1 --2- 172.21.15.102:0/664467383 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35bc0cb390 0x7f35bc14f8d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f35b000e930 tx=0x7f35b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.189+0000 7f35b8ff9700 1 -- 172.21.15.102:0/664467383 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0013680 con 0x7f35bc0cb390 2024-08-17T02:29:18.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.189+0000 7f35b8ff9700 1 -- 172.21.15.102:0/664467383 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b00137e0 con 0x7f35bc0cb390 2024-08-17T02:29:18.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.189+0000 7f35c1e35700 1 -- 172.21.15.102:0/664467383 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35bc0aa770 con 0x7f35bc0cb390 2024-08-17T02:29:18.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.189+0000 7f35b8ff9700 1 -- 172.21.15.102:0/664467383 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0013ba0 con 0x7f35bc0cb390 2024-08-17T02:29:18.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.189+0000 7f35c1e35700 1 -- 172.21.15.102:0/664467383 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35bc14fe10 con 0x7f35bc0cb390 2024-08-17T02:29:18.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.189+0000 7f35c1e35700 1 -- 172.21.15.102:0/664467383 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35bc0643a0 con 0x7f35bc0cb390 2024-08-17T02:29:18.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.189+0000 7f35b8ff9700 1 -- 172.21.15.102:0/664467383 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f35b000c3e0 con 0x7f35bc0cb390 2024-08-17T02:29:18.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.189+0000 7f35b8ff9700 1 --2- 172.21.15.102:0/664467383 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f35a8060860 0x7f35a8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.189+0000 7f35b8ff9700 1 -- 172.21.15.102:0/664467383 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f35b007c8f0 con 0x7f35bc0cb390 2024-08-17T02:29:18.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.189+0000 7f35c0e33700 1 --2- 172.21.15.102:0/664467383 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f35a8060860 0x7f35a8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.189+0000 7f35c0e33700 1 --2- 172.21.15.102:0/664467383 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f35a8060860 0x7f35a8062d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35ac000c00 tx=0x7f35ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.193+0000 7f35b8ff9700 1 -- 172.21.15.102:0/664467383 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f35b004cfe0 con 0x7f35bc0cb390 2024-08-17T02:29:18.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.353+0000 7f35c1e35700 1 -- 172.21.15.102:0/664467383 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f35bc06f5f0 con 0x7f35a8060860 2024-08-17T02:29:18.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.357+0000 7f35b8ff9700 1 -- 172.21.15.102:0/664467383 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f35bc06f5f0 con 0x7f35a8060860 2024-08-17T02:29:18.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.357+0000 7f35c1e35700 1 -- 172.21.15.102:0/664467383 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f35a8060860 msgr2=0x7f35a8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.357+0000 7f35c1e35700 1 --2- 172.21.15.102:0/664467383 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f35a8060860 0x7f35a8062d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35ac000c00 tx=0x7f35ac009040 comp rx=0 tx=0).stop 2024-08-17T02:29:18.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.357+0000 7f35c1e35700 1 -- 172.21.15.102:0/664467383 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35bc0cb390 msgr2=0x7f35bc14f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.357+0000 7f35c1e35700 1 --2- 172.21.15.102:0/664467383 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35bc0cb390 0x7f35bc14f8d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f35b000e930 tx=0x7f35b00091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.357+0000 7f35c1e35700 1 -- 172.21.15.102:0/664467383 shutdown_connections 2024-08-17T02:29:18.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.357+0000 7f35c1e35700 1 --2- 172.21.15.102:0/664467383 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f35a8060860 0x7f35a8062d10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.357+0000 7f35c1e35700 1 --2- 172.21.15.102:0/664467383 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35bc0cb390 0x7f35bc14f8d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.357+0000 7f35c1e35700 1 --2- 172.21.15.102:0/664467383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35bc154900 0x7f35bc06e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.357+0000 7f35c1e35700 1 --2- 172.21.15.102:0/664467383 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f35bc0b14a0 0x7f35bc0c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.357+0000 7f35c1e35700 1 -- 172.21.15.102:0/664467383 >> 172.21.15.102:0/664467383 conn(0x7f35bc0678d0 msgr2=0x7f35bc152620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.357+0000 7f35c1e35700 1 -- 172.21.15.102:0/664467383 shutdown_connections 2024-08-17T02:29:18.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.357+0000 7f35c1e35700 1 -- 172.21.15.102:0/664467383 wait complete. 2024-08-17T02:29:18.363 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:29:18.372 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:29:18.372 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:18.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.489+0000 7fad0359e700 1 Processor -- start 2024-08-17T02:29:18.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.489+0000 7fad0359e700 1 -- start start 2024-08-17T02:29:18.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.489+0000 7fad0359e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fad040b26d0 0x7fad040b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.489+0000 7fad0359e700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fad040c5fd0 0x7fad040c6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.489+0000 7fad0359e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad040c5b40 con 0x7fad040c6960 2024-08-17T02:29:18.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad0359e700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad040b2aa0 con 0x7fad040c5fd0 2024-08-17T02:29:18.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad0359e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad04159820 con 0x7fad040b26d0 2024-08-17T02:29:18.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad01d9b700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fad040c5fd0 0x7fad040c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad01d9b700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fad040c5fd0 0x7fad040c6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34004/0 (socket says 172.21.15.102:34004) 2024-08-17T02:29:18.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad01d9b700 1 -- 172.21.15.102:0/1334184032 learned_addr learned my addr 172.21.15.102:0/1334184032 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:18.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad0259c700 1 --2- 172.21.15.102:0/1334184032 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fad040b26d0 0x7fad040b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad01d9b700 1 -- 172.21.15.102:0/1334184032 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fad040b26d0 msgr2=0x7fad040b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:18.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad01d9b700 1 --2- 172.21.15.102:0/1334184032 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fad040b26d0 0x7fad040b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad01d9b700 1 -- 172.21.15.102:0/1334184032 >> v1:172.21.15.121:6789/0 conn(0x7fad040c6960 legacy=0x7fad040cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad01d9b700 1 -- 172.21.15.102:0/1334184032 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040c4f30 con 0x7fad040c5fd0 2024-08-17T02:29:18.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad01d9b700 1 --2- 172.21.15.102:0/1334184032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad040c5fd0 0x7fad040c6420 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7facec009990 tx=0x7facec009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfde0401323d10ff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad0159a700 1 -- 172.21.15.102:0/1334184032 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec005c10 con 0x7fad040c5fd0 2024-08-17T02:29:18.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad0159a700 1 -- 172.21.15.102:0/1334184032 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facec005d70 con 0x7fad040c5fd0 2024-08-17T02:29:18.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad0159a700 1 -- 172.21.15.102:0/1334184032 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec00b880 con 0x7fad040c5fd0 2024-08-17T02:29:18.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad0359e700 1 -- 172.21.15.102:0/1334184032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad040c5fd0 msgr2=0x7fad040c6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad0359e700 1 --2- 172.21.15.102:0/1334184032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad040c5fd0 0x7fad040c6420 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7facec009990 tx=0x7facec009220 comp rx=0 tx=0).stop 2024-08-17T02:29:18.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad0359e700 1 -- 172.21.15.102:0/1334184032 shutdown_connections 2024-08-17T02:29:18.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad0359e700 1 --2- 172.21.15.102:0/1334184032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad040c5fd0 0x7fad040c6420 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad0359e700 1 --2- 172.21.15.102:0/1334184032 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fad040b26d0 0x7fad040b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad0359e700 1 -- 172.21.15.102:0/1334184032 >> 172.21.15.102:0/1334184032 conn(0x7fad04067590 msgr2=0x7fad040d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad0359e700 1 -- 172.21.15.102:0/1334184032 shutdown_connections 2024-08-17T02:29:18.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad0359e700 1 -- 172.21.15.102:0/1334184032 wait complete. 2024-08-17T02:29:18.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad0359e700 1 Processor -- start 2024-08-17T02:29:18.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.493+0000 7fad0359e700 1 -- start start 2024-08-17T02:29:18.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad0359e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad040b26d0 0x7fad04156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad0359e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad040c5fd0 0x7fad0415f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad0359e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fad040c6960 0x7fad0415ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad0359e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad041572a0 con 0x7fad040c5fd0 2024-08-17T02:29:18.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad0359e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad040c8710 con 0x7fad040b26d0 2024-08-17T02:29:18.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad0359e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad040c89f0 con 0x7fad040c6960 2024-08-17T02:29:18.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad01d9b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad040c5fd0 0x7fad0415f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad01d9b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad040c5fd0 0x7fad0415f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34012/0 (socket says 172.21.15.102:34012) 2024-08-17T02:29:18.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad01d9b700 1 -- 172.21.15.102:0/3984909057 learned_addr learned my addr 172.21.15.102:0/3984909057 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:18.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad0259c700 1 --2- 172.21.15.102:0/3984909057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad040b26d0 0x7fad04156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad02d9d700 1 --2- 172.21.15.102:0/3984909057 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fad040c6960 0x7fad0415ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad01d9b700 1 -- 172.21.15.102:0/3984909057 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fad040c6960 msgr2=0x7fad0415ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad01d9b700 1 --2- 172.21.15.102:0/3984909057 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fad040c6960 0x7fad0415ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad01d9b700 1 -- 172.21.15.102:0/3984909057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad040b26d0 msgr2=0x7fad04156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad01d9b700 1 --2- 172.21.15.102:0/3984909057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad040b26d0 0x7fad04156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad01d9b700 1 -- 172.21.15.102:0/3984909057 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec009480 con 0x7fad040c5fd0 2024-08-17T02:29:18.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad02d9d700 1 --2- 172.21.15.102:0/3984909057 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fad040c6960 0x7fad0415ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:18.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad01d9b700 1 --2- 172.21.15.102:0/3984909057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad040c5fd0 0x7fad0415f8a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7facec005d40 tx=0x7facec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7facfa7fc700 1 -- 172.21.15.102:0/3984909057 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec011a60 con 0x7fad040c5fd0 2024-08-17T02:29:18.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7facfa7fc700 1 -- 172.21.15.102:0/3984909057 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facec011bc0 con 0x7fad040c5fd0 2024-08-17T02:29:18.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad0359e700 1 -- 172.21.15.102:0/3984909057 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad040c8cd0 con 0x7fad040c5fd0 2024-08-17T02:29:18.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7facfa7fc700 1 -- 172.21.15.102:0/3984909057 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec01b430 con 0x7fad040c5fd0 2024-08-17T02:29:18.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad0359e700 1 -- 172.21.15.102:0/3984909057 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad040c9290 con 0x7fad040c5fd0 2024-08-17T02:29:18.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7fad0359e700 1 -- 172.21.15.102:0/3984909057 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad040644b0 con 0x7fad040c5fd0 2024-08-17T02:29:18.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.497+0000 7facfa7fc700 1 -- 172.21.15.102:0/3984909057 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7facec01b860 con 0x7fad040c5fd0 2024-08-17T02:29:18.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.501+0000 7facfa7fc700 1 --2- 172.21.15.102:0/3984909057 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7face4060860 0x7face4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.501+0000 7facfa7fc700 1 -- 172.21.15.102:0/3984909057 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7facec07e400 con 0x7fad040c5fd0 2024-08-17T02:29:18.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.501+0000 7fad0259c700 1 --2- 172.21.15.102:0/3984909057 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7face4060860 0x7face4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.501+0000 7facfa7fc700 1 --2- 172.21.15.102:0/3984909057 >> [v2:172.21.15.102:6808/24226,v1:172.21.15.102:6809/24226] conn(0x7face4066750 0x7face4068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.501+0000 7facfa7fc700 1 -- 172.21.15.102:0/3984909057 --> [v2:172.21.15.102:6808/24226,v1:172.21.15.102:6809/24226] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7face4069210 con 0x7face4066750 2024-08-17T02:29:18.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.501+0000 7facfa7fc700 1 -- 172.21.15.102:0/3984909057 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7facec080a40 con 0x7fad040c5fd0 2024-08-17T02:29:18.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.501+0000 7fad02d9d700 1 --2- 172.21.15.102:0/3984909057 >> [v2:172.21.15.102:6808/24226,v1:172.21.15.102:6809/24226] conn(0x7face4066750 0x7face4068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.501+0000 7fad0259c700 1 --2- 172.21.15.102:0/3984909057 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7face4060860 0x7face4062d10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7facf4006fd0 tx=0x7facf4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.501+0000 7fad02d9d700 1 --2- 172.21.15.102:0/3984909057 >> [v2:172.21.15.102:6808/24226,v1:172.21.15.102:6809/24226] conn(0x7face4066750 0x7face4068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.501+0000 7facfa7fc700 1 -- 172.21.15.102:0/3984909057 <== osd.2 v2:172.21.15.102:6808/24226 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7face4069210 con 0x7face4066750 2024-08-17T02:29:18.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.517+0000 7fad0359e700 1 -- 172.21.15.102:0/3984909057 --> [v2:172.21.15.102:6808/24226,v1:172.21.15.102:6809/24226] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fad04070560 con 0x7face4066750 2024-08-17T02:29:18.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.521+0000 7facfa7fc700 1 -- 172.21.15.102:0/3984909057 <== osd.2 v2:172.21.15.102:6808/24226 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fad04070560 con 0x7face4066750 2024-08-17T02:29:18.522 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-08-17T02:29:18.522 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:18.523 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-08-17T02:29:18.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.521+0000 7fad0359e700 1 -- 172.21.15.102:0/3984909057 >> [v2:172.21.15.102:6808/24226,v1:172.21.15.102:6809/24226] conn(0x7face4066750 msgr2=0x7face4068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.521+0000 7fad0359e700 1 --2- 172.21.15.102:0/3984909057 >> [v2:172.21.15.102:6808/24226,v1:172.21.15.102:6809/24226] conn(0x7face4066750 0x7face4068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.521+0000 7fad0359e700 1 -- 172.21.15.102:0/3984909057 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7face4060860 msgr2=0x7face4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.521+0000 7fad0359e700 1 --2- 172.21.15.102:0/3984909057 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7face4060860 0x7face4062d10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7facf4006fd0 tx=0x7facf4008040 comp rx=0 tx=0).stop 2024-08-17T02:29:18.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.521+0000 7fad0359e700 1 -- 172.21.15.102:0/3984909057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad040c5fd0 msgr2=0x7fad0415f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.521+0000 7fad0359e700 1 --2- 172.21.15.102:0/3984909057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad040c5fd0 0x7fad0415f8a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7facec005d40 tx=0x7facec016000 comp rx=0 tx=0).stop 2024-08-17T02:29:18.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.521+0000 7fad02d9d700 1 -- 172.21.15.102:0/3984909057 reap_dead start 2024-08-17T02:29:18.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.521+0000 7fad0359e700 1 -- 172.21.15.102:0/3984909057 shutdown_connections 2024-08-17T02:29:18.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.521+0000 7fad0359e700 1 -- 172.21.15.102:0/3984909057 >> 172.21.15.102:0/3984909057 conn(0x7fad04067590 msgr2=0x7fad040cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.521+0000 7fad0359e700 1 -- 172.21.15.102:0/3984909057 shutdown_connections 2024-08-17T02:29:18.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.521+0000 7fad0359e700 1 -- 172.21.15.102:0/3984909057 wait complete. 2024-08-17T02:29:18.534 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:29:18.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8f59e700 1 Processor -- start 2024-08-17T02:29:18.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8f59e700 1 -- start start 2024-08-17T02:29:18.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8f59e700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3d900d0010 0x7f3d900d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8f59e700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3d9015cea0 0x7f3d9015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8f59e700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d900cf190 con 0x7f3d90159040 2024-08-17T02:29:18.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8f59e700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d900d09a0 con 0x7f3d9015cea0 2024-08-17T02:29:18.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8f59e700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d900ce5e0 con 0x7f3d900d0010 2024-08-17T02:29:18.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8ed9d700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3d9015cea0 0x7f3d9015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8ed9d700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3d9015cea0 0x7f3d9015d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34026/0 (socket says 172.21.15.102:34026) 2024-08-17T02:29:18.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8e59c700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f3d90159040 0x7f3d900cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55970/0 (socket says 172.21.15.102:55970) 2024-08-17T02:29:18.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8ed9d700 1 -- 172.21.15.102:0/4172193158 learned_addr learned my addr 172.21.15.102:0/4172193158 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:18.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8dd9b700 1 --2- 172.21.15.102:0/4172193158 >> v2:172.21.15.121:3300/0 conn(0x7f3d900d0010 0x7f3d900d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8ed9d700 1 -- 172.21.15.102:0/4172193158 >> v2:172.21.15.121:3300/0 conn(0x7f3d900d0010 msgr2=0x7f3d900d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:18.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8ed9d700 1 --2- 172.21.15.102:0/4172193158 >> v2:172.21.15.121:3300/0 conn(0x7f3d900d0010 0x7f3d900d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8ed9d700 1 -- 172.21.15.102:0/4172193158 >> v1:172.21.15.102:6789/0 conn(0x7f3d90159040 legacy=0x7f3d900cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8ed9d700 1 -- 172.21.15.102:0/4172193158 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d900ce860 con 0x7f3d9015cea0 2024-08-17T02:29:18.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8ed9d700 1 --2- 172.21.15.102:0/4172193158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d9015cea0 0x7f3d9015d2e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3d90067ef0 tx=0x7f3d88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ecfb0b8efad163 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8d59a700 1 -- 172.21.15.102:0/4172193158 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88009e70 con 0x7f3d9015cea0 2024-08-17T02:29:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8d59a700 1 -- 172.21.15.102:0/4172193158 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8800b860 con 0x7f3d9015cea0 2024-08-17T02:29:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.641+0000 7f3d8d59a700 1 -- 172.21.15.102:0/4172193158 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8800bc20 con 0x7f3d9015cea0 2024-08-17T02:29:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.645+0000 7f3d8f59e700 1 -- 172.21.15.102:0/4172193158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d9015cea0 msgr2=0x7f3d9015d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.645+0000 7f3d8f59e700 1 --2- 172.21.15.102:0/4172193158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d9015cea0 0x7f3d9015d2e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3d90067ef0 tx=0x7f3d88009250 comp rx=0 tx=0).stop 2024-08-17T02:29:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.645+0000 7f3d8f59e700 1 -- 172.21.15.102:0/4172193158 shutdown_connections 2024-08-17T02:29:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.645+0000 7f3d8f59e700 1 --2- 172.21.15.102:0/4172193158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d9015cea0 0x7f3d9015d2e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.645+0000 7f3d8f59e700 1 --2- 172.21.15.102:0/4172193158 >> v2:172.21.15.121:3300/0 conn(0x7f3d900d0010 0x7f3d900d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.645+0000 7f3d8f59e700 1 -- 172.21.15.102:0/4172193158 >> 172.21.15.102:0/4172193158 conn(0x7f3d90068250 msgr2=0x7f3d90068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.645+0000 7f3d8f59e700 1 -- 172.21.15.102:0/4172193158 shutdown_connections 2024-08-17T02:29:18.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.645+0000 7f3d8f59e700 1 -- 172.21.15.102:0/4172193158 wait complete. 2024-08-17T02:29:18.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.645+0000 7f3d8f59e700 1 Processor -- start 2024-08-17T02:29:18.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.645+0000 7f3d8f59e700 1 -- start start 2024-08-17T02:29:18.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.645+0000 7f3d8f59e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d900d0010 0x7f3d90151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.645+0000 7f3d8f59e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d90159040 0x7f3d900a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8f59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d9015cea0 0x7f3d90154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8f59e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d90169690 con 0x7f3d90159040 2024-08-17T02:29:18.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8f59e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d900a7e60 con 0x7f3d900d0010 2024-08-17T02:29:18.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8f59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d90169950 con 0x7f3d9015cea0 2024-08-17T02:29:18.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8dd9b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d90159040 0x7f3d900a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8dd9b700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d90159040 0x7f3d900a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34028/0 (socket says 172.21.15.102:34028) 2024-08-17T02:29:18.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8dd9b700 1 -- 172.21.15.102:0/2887092486 learned_addr learned my addr 172.21.15.102:0/2887092486 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:18.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8e59c700 1 --2- 172.21.15.102:0/2887092486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d900d0010 0x7f3d90151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8ed9d700 1 --2- 172.21.15.102:0/2887092486 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d9015cea0 0x7f3d90154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8dd9b700 1 -- 172.21.15.102:0/2887092486 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d9015cea0 msgr2=0x7f3d90154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8dd9b700 1 --2- 172.21.15.102:0/2887092486 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d9015cea0 0x7f3d90154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8dd9b700 1 -- 172.21.15.102:0/2887092486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d900d0010 msgr2=0x7f3d90151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8dd9b700 1 --2- 172.21.15.102:0/2887092486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d900d0010 0x7f3d90151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8dd9b700 1 -- 172.21.15.102:0/2887092486 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d880094f0 con 0x7f3d90159040 2024-08-17T02:29:18.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8dd9b700 1 --2- 172.21.15.102:0/2887092486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d90159040 0x7f3d900a74f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009e50 tx=0x7f3d7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d867fc700 1 -- 172.21.15.102:0/2887092486 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7800caa0 con 0x7f3d90159040 2024-08-17T02:29:18.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d867fc700 1 -- 172.21.15.102:0/2887092486 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7800f040 con 0x7f3d90159040 2024-08-17T02:29:18.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d867fc700 1 -- 172.21.15.102:0/2887092486 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7800ce30 con 0x7f3d90159040 2024-08-17T02:29:18.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8f59e700 1 -- 172.21.15.102:0/2887092486 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d90169c30 con 0x7f3d90159040 2024-08-17T02:29:18.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8f59e700 1 -- 172.21.15.102:0/2887092486 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d90152150 con 0x7f3d90159040 2024-08-17T02:29:18.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8f59e700 1 -- 172.21.15.102:0/2887092486 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d900643a0 con 0x7f3d90159040 2024-08-17T02:29:18.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d867fc700 1 -- 172.21.15.102:0/2887092486 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3d78014690 con 0x7f3d90159040 2024-08-17T02:29:18.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d867fc700 1 --2- 172.21.15.102:0/2887092486 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3d74060860 0x7f3d74062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d867fc700 1 -- 172.21.15.102:0/2887092486 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f3d7807d1c0 con 0x7f3d90159040 2024-08-17T02:29:18.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.649+0000 7f3d8e59c700 1 --2- 172.21.15.102:0/2887092486 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3d74060860 0x7f3d74062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.653+0000 7f3d8e59c700 1 --2- 172.21.15.102:0/2887092486 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3d74060860 0x7f3d74062d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3d901556a0 tx=0x7f3d80007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.657+0000 7f3d867fc700 1 -- 172.21.15.102:0/2887092486 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3d7804d8b0 con 0x7f3d90159040 2024-08-17T02:29:18.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.821+0000 7f3d8f59e700 1 -- 172.21.15.102:0/2887092486 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d901697d0 con 0x7f3d74060860 2024-08-17T02:29:18.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.825+0000 7f3d867fc700 1 -- 172.21.15.102:0/2887092486 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3d80004c60 con 0x7f3d74060860 2024-08-17T02:29:18.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.825+0000 7f3d8f59e700 1 -- 172.21.15.102:0/2887092486 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3d74060860 msgr2=0x7f3d74062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.825+0000 7f3d8f59e700 1 --2- 172.21.15.102:0/2887092486 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3d74060860 0x7f3d74062d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3d901556a0 tx=0x7f3d80007eb0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.825+0000 7f3d8f59e700 1 -- 172.21.15.102:0/2887092486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d90159040 msgr2=0x7f3d900a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.825+0000 7f3d8f59e700 1 --2- 172.21.15.102:0/2887092486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d90159040 0x7f3d900a74f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009e50 tx=0x7f3d7800b040 comp rx=0 tx=0).stop 2024-08-17T02:29:18.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.825+0000 7f3d8f59e700 1 -- 172.21.15.102:0/2887092486 shutdown_connections 2024-08-17T02:29:18.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.825+0000 7f3d8f59e700 1 --2- 172.21.15.102:0/2887092486 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3d74060860 0x7f3d74062d10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.825+0000 7f3d8f59e700 1 --2- 172.21.15.102:0/2887092486 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d90159040 0x7f3d900a74f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.825+0000 7f3d8f59e700 1 --2- 172.21.15.102:0/2887092486 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3d9015cea0 0x7f3d90154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.825+0000 7f3d8f59e700 1 --2- 172.21.15.102:0/2887092486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d900d0010 0x7f3d90151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.825+0000 7f3d8f59e700 1 -- 172.21.15.102:0/2887092486 >> 172.21.15.102:0/2887092486 conn(0x7f3d90068250 msgr2=0x7f3d90152c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.825+0000 7f3d8f59e700 1 -- 172.21.15.102:0/2887092486 shutdown_connections 2024-08-17T02:29:18.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.825+0000 7f3d8f59e700 1 -- 172.21.15.102:0/2887092486 wait complete. 2024-08-17T02:29:18.831 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:29:18.840 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:29:18.841 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:18.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.957+0000 7fd3c53f7700 1 Processor -- start 2024-08-17T02:29:18.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.957+0000 7fd3c53f7700 1 -- start start 2024-08-17T02:29:18.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.957+0000 7fd3c53f7700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd3c00b2e70 0x7fd3c00cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.957+0000 7fd3c53f7700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c00c5bb0 con 0x7fd3c00cc230 2024-08-17T02:29:18.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.957+0000 7fd3c53f7700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c00b32f0 con 0x7fd3c00ce640 2024-08-17T02:29:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.957+0000 7fd3c53f7700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c00c4fa0 con 0x7fd3c00b2e70 2024-08-17T02:29:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.957+0000 7fd3c4bf6700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd3c00cc230 0x7fd3c00c6040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55974/0 (socket says 172.21.15.102:55974) 2024-08-17T02:29:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.957+0000 7fd3c4bf6700 1 -- 172.21.15.102:0/445106613 learned_addr learned my addr 172.21.15.102:0/445106613 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.957+0000 7fd3bf7fe700 1 --2- 172.21.15.102:0/445106613 >> v2:172.21.15.121:3300/0 conn(0x7fd3c00b2e70 0x7fd3c00cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.961+0000 7fd3beffd700 1 -- 172.21.15.102:0/445106613 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640067767 0 0) 0x7fd3c00c5bb0 con 0x7fd3c00cc230 2024-08-17T02:29:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.961+0000 7fd3beffd700 1 -- 172.21.15.102:0/445106613 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3a8003570 con 0x7fd3c00cc230 2024-08-17T02:29:18.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.961+0000 7fd3bf7fe700 1 -- 172.21.15.102:0/445106613 >> v1:172.21.15.121:6789/0 conn(0x7fd3c00ce640 legacy=0x7fd3c00cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.961+0000 7fd3bf7fe700 1 -- 172.21.15.102:0/445106613 >> v1:172.21.15.102:6789/0 conn(0x7fd3c00cc230 legacy=0x7fd3c00c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.961+0000 7fd3bf7fe700 1 -- 172.21.15.102:0/445106613 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c00c5280 con 0x7fd3c00b2e70 2024-08-17T02:29:18.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.961+0000 7fd3bf7fe700 1 --2- 172.21.15.102:0/445106613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c00b2e70 0x7fd3c00cbcf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00098e0 tx=0x7fd3b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2317db555a8921 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.961+0000 7fd3beffd700 1 -- 172.21.15.102:0/445106613 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b000b640 con 0x7fd3c00b2e70 2024-08-17T02:29:18.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.961+0000 7fd3beffd700 1 -- 172.21.15.102:0/445106613 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b000b7a0 con 0x7fd3c00b2e70 2024-08-17T02:29:18.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.961+0000 7fd3beffd700 1 -- 172.21.15.102:0/445106613 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b000bb40 con 0x7fd3c00b2e70 2024-08-17T02:29:18.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.961+0000 7fd3c53f7700 1 -- 172.21.15.102:0/445106613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c00b2e70 msgr2=0x7fd3c00cbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.961+0000 7fd3c53f7700 1 --2- 172.21.15.102:0/445106613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c00b2e70 0x7fd3c00cbcf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00098e0 tx=0x7fd3b00091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.961+0000 7fd3c53f7700 1 -- 172.21.15.102:0/445106613 shutdown_connections 2024-08-17T02:29:18.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.961+0000 7fd3c53f7700 1 --2- 172.21.15.102:0/445106613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c00b2e70 0x7fd3c00cbcf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.961+0000 7fd3c53f7700 1 -- 172.21.15.102:0/445106613 >> 172.21.15.102:0/445106613 conn(0x7fd3c0099410 msgr2=0x7fd3c00675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.961+0000 7fd3c53f7700 1 -- 172.21.15.102:0/445106613 shutdown_connections 2024-08-17T02:29:18.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.961+0000 7fd3c53f7700 1 -- 172.21.15.102:0/445106613 wait complete. 2024-08-17T02:29:18.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c53f7700 1 Processor -- start 2024-08-17T02:29:18.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c53f7700 1 -- start start 2024-08-17T02:29:18.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c53f7700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3c00b2e70 0x7fd3c01581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c53f7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c00cc230 0x7fd3c00c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c53f7700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c00ce640 0x7fd3c0158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c53f7700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c01586e0 con 0x7fd3c00ce640 2024-08-17T02:29:18.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c53f7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00c8650 con 0x7fd3c00cc230 2024-08-17T02:29:18.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c53f7700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00c8930 con 0x7fd3c00b2e70 2024-08-17T02:29:18.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c4bf6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c00ce640 0x7fd3c0158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c4bf6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c00ce640 0x7fd3c0158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34040/0 (socket says 172.21.15.102:34040) 2024-08-17T02:29:18.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c4bf6700 1 -- 172.21.15.102:0/463414784 learned_addr learned my addr 172.21.15.102:0/463414784 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:18.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3bffff700 1 --2- 172.21.15.102:0/463414784 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3c00b2e70 0x7fd3c01581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3bf7fe700 1 --2- 172.21.15.102:0/463414784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c00cc230 0x7fd3c00c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c4bf6700 1 -- 172.21.15.102:0/463414784 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3c00b2e70 msgr2=0x7fd3c01581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c4bf6700 1 --2- 172.21.15.102:0/463414784 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7fd3c00b2e70 0x7fd3c01581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c4bf6700 1 -- 172.21.15.102:0/463414784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c00cc230 msgr2=0x7fd3c00c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c4bf6700 1 --2- 172.21.15.102:0/463414784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3c00cc230 0x7fd3c00c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c4bf6700 1 -- 172.21.15.102:0/463414784 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b0009420 con 0x7fd3c00ce640 2024-08-17T02:29:18.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c4bf6700 1 --2- 172.21.15.102:0/463414784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c00ce640 0x7fd3c0158a00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8001460 tx=0x7fd3b8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3a7fff700 1 -- 172.21.15.102:0/463414784 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b800a890 con 0x7fd3c00ce640 2024-08-17T02:29:18.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3a7fff700 1 -- 172.21.15.102:0/463414784 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b800a9f0 con 0x7fd3c00ce640 2024-08-17T02:29:18.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c53f7700 1 -- 172.21.15.102:0/463414784 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c00c8c10 con 0x7fd3c00ce640 2024-08-17T02:29:18.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3a7fff700 1 -- 172.21.15.102:0/463414784 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b800ad70 con 0x7fd3c00ce640 2024-08-17T02:29:18.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c53f7700 1 -- 172.21.15.102:0/463414784 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c00ca3e0 con 0x7fd3c00ce640 2024-08-17T02:29:18.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.965+0000 7fd3c53f7700 1 -- 172.21.15.102:0/463414784 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd3c009dde0 con 0x7fd3c00ce640 2024-08-17T02:29:18.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.969+0000 7fd3a7fff700 1 -- 172.21.15.102:0/463414784 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd3b8007300 con 0x7fd3c00ce640 2024-08-17T02:29:18.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.969+0000 7fd3a7fff700 1 --2- 172.21.15.102:0/463414784 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd3ac060860 0x7fd3ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.969+0000 7fd3a7fff700 1 -- 172.21.15.102:0/463414784 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd3b807cc70 con 0x7fd3c00ce640 2024-08-17T02:29:18.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.969+0000 7fd3a7fff700 1 --2- 172.21.15.102:0/463414784 >> [v2:172.21.15.102:6800/24225,v1:172.21.15.102:6801/24225] conn(0x7fd3ac066750 0x7fd3ac068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.969+0000 7fd3a7fff700 1 -- 172.21.15.102:0/463414784 --> [v2:172.21.15.102:6800/24225,v1:172.21.15.102:6801/24225] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd3ac069210 con 0x7fd3ac066750 2024-08-17T02:29:18.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.969+0000 7fd3a7fff700 1 -- 172.21.15.102:0/463414784 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3b807f2b0 con 0x7fd3c00ce640 2024-08-17T02:29:18.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.969+0000 7fd3bffff700 1 --2- 172.21.15.102:0/463414784 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd3ac060860 0x7fd3ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.969+0000 7fd3bf7fe700 1 --2- 172.21.15.102:0/463414784 >> [v2:172.21.15.102:6800/24225,v1:172.21.15.102:6801/24225] conn(0x7fd3ac066750 0x7fd3ac068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.969+0000 7fd3bf7fe700 1 --2- 172.21.15.102:0/463414784 >> [v2:172.21.15.102:6800/24225,v1:172.21.15.102:6801/24225] conn(0x7fd3ac066750 0x7fd3ac068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.969+0000 7fd3bffff700 1 --2- 172.21.15.102:0/463414784 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd3ac060860 0x7fd3ac062d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4003a80 tx=0x7fd3b4007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.969+0000 7fd3a7fff700 1 -- 172.21.15.102:0/463414784 <== osd.3 v2:172.21.15.102:6800/24225 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd3ac069210 con 0x7fd3ac066750 2024-08-17T02:29:18.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.985+0000 7fd3c53f7700 1 -- 172.21.15.102:0/463414784 --> [v2:172.21.15.102:6800/24225,v1:172.21.15.102:6801/24225] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd3c00644b0 con 0x7fd3ac066750 2024-08-17T02:29:18.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.985+0000 7fd3a7fff700 1 -- 172.21.15.102:0/463414784 <== osd.3 v2:172.21.15.102:6800/24225 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd3c00644b0 con 0x7fd3ac066750 2024-08-17T02:29:18.987 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-08-17T02:29:18.987 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:18.987 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-08-17T02:29:18.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.985+0000 7fd3c53f7700 1 -- 172.21.15.102:0/463414784 >> [v2:172.21.15.102:6800/24225,v1:172.21.15.102:6801/24225] conn(0x7fd3ac066750 msgr2=0x7fd3ac068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.985+0000 7fd3c53f7700 1 --2- 172.21.15.102:0/463414784 >> [v2:172.21.15.102:6800/24225,v1:172.21.15.102:6801/24225] conn(0x7fd3ac066750 0x7fd3ac068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.985+0000 7fd3c53f7700 1 -- 172.21.15.102:0/463414784 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd3ac060860 msgr2=0x7fd3ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.985+0000 7fd3c53f7700 1 --2- 172.21.15.102:0/463414784 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7fd3ac060860 0x7fd3ac062d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4003a80 tx=0x7fd3b4007ec0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.985+0000 7fd3c53f7700 1 -- 172.21.15.102:0/463414784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c00ce640 msgr2=0x7fd3c0158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.985+0000 7fd3c53f7700 1 --2- 172.21.15.102:0/463414784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c00ce640 0x7fd3c0158a00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8001460 tx=0x7fd3b8001ae0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.985+0000 7fd3c4bf6700 1 -- 172.21.15.102:0/463414784 reap_dead start 2024-08-17T02:29:18.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.985+0000 7fd3c53f7700 1 -- 172.21.15.102:0/463414784 shutdown_connections 2024-08-17T02:29:18.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.985+0000 7fd3c53f7700 1 -- 172.21.15.102:0/463414784 >> 172.21.15.102:0/463414784 conn(0x7fd3c0099410 msgr2=0x7fd3c0069250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.985+0000 7fd3c53f7700 1 -- 172.21.15.102:0/463414784 shutdown_connections 2024-08-17T02:29:18.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:18.985+0000 7fd3c53f7700 1 -- 172.21.15.102:0/463414784 wait complete. 2024-08-17T02:29:18.998 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:29:19.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.105+0000 7f39983b6700 1 Processor -- start 2024-08-17T02:29:19.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.105+0000 7f39983b6700 1 -- start start 2024-08-17T02:29:19.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f39983b6700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3990156fb0 0x7f39900caa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f39983b6700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f399015d6b0 0x7f399015b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f39983b6700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399015ada0 con 0x7f39900cafa0 2024-08-17T02:29:19.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f39983b6700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39900cbce0 con 0x7f3990156fb0 2024-08-17T02:29:19.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f39983b6700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3990157380 con 0x7f399015d6b0 2024-08-17T02:29:19.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f3996152700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3990156fb0 0x7f39900caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f3996953700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f399015d6b0 0x7f399015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f3995951700 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f39900cafa0 0x7f399015cfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.102:60792/0 (socket says 172.21.15.102:60792) 2024-08-17T02:29:19.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f3995951700 1 -- 172.21.15.102:0/1643671163 learned_addr learned my addr 172.21.15.102:0/1643671163 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:19.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f3995150700 1 -- 172.21.15.102:0/1643671163 <== mon.1 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857638191 0 0) 0x7f399015ada0 con 0x7f39900cafa0 2024-08-17T02:29:19.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f3995150700 1 -- 172.21.15.102:0/1643671163 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f397c003570 con 0x7f39900cafa0 2024-08-17T02:29:19.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f3996953700 1 -- 172.21.15.102:0/1643671163 >> v2:172.21.15.121:3300/0 conn(0x7f3990156fb0 msgr2=0x7f39900caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:19.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f3996953700 1 --2- 172.21.15.102:0/1643671163 >> v2:172.21.15.121:3300/0 conn(0x7f3990156fb0 0x7f39900caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f3996953700 1 -- 172.21.15.102:0/1643671163 >> v1:172.21.15.121:6789/0 conn(0x7f39900cafa0 legacy=0x7f399015cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f3996953700 1 -- 172.21.15.102:0/1643671163 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39900cb440 con 0x7f399015d6b0 2024-08-17T02:29:19.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f3996152700 1 --2- 172.21.15.102:0/1643671163 >> v2:172.21.15.121:3300/0 conn(0x7f3990156fb0 0x7f39900caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:19.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f3996953700 1 --2- 172.21.15.102:0/1643671163 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f399015d6b0 0x7f399015b230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3988009e60 tx=0x7f3988009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdd683ad2567af2a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f3995150700 1 -- 172.21.15.102:0/1643671163 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398800e070 con 0x7f399015d6b0 2024-08-17T02:29:19.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f3995150700 1 -- 172.21.15.102:0/1643671163 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398800bab0 con 0x7f399015d6b0 2024-08-17T02:29:19.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f3995150700 1 -- 172.21.15.102:0/1643671163 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398800be70 con 0x7f399015d6b0 2024-08-17T02:29:19.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f39983b6700 1 -- 172.21.15.102:0/1643671163 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f399015d6b0 msgr2=0x7f399015b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f39983b6700 1 --2- 172.21.15.102:0/1643671163 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f399015d6b0 0x7f399015b230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3988009e60 tx=0x7f3988009780 comp rx=0 tx=0).stop 2024-08-17T02:29:19.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f39983b6700 1 -- 172.21.15.102:0/1643671163 shutdown_connections 2024-08-17T02:29:19.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f39983b6700 1 --2- 172.21.15.102:0/1643671163 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f399015d6b0 0x7f399015b230 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f39983b6700 1 --2- 172.21.15.102:0/1643671163 >> v2:172.21.15.121:3300/0 conn(0x7f3990156fb0 0x7f39900caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.109+0000 7f39983b6700 1 -- 172.21.15.102:0/1643671163 >> 172.21.15.102:0/1643671163 conn(0x7f3990099500 msgr2=0x7f39900675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.113+0000 7f39983b6700 1 -- 172.21.15.102:0/1643671163 shutdown_connections 2024-08-17T02:29:19.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.113+0000 7f39983b6700 1 -- 172.21.15.102:0/1643671163 wait complete. 2024-08-17T02:29:19.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.113+0000 7f39983b6700 1 Processor -- start 2024-08-17T02:29:19.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.113+0000 7f39983b6700 1 -- start start 2024-08-17T02:29:19.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.113+0000 7f39983b6700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f39900cafa0 0x7f39900b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.113+0000 7f39983b6700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3990156fb0 0x7f3990169060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.113+0000 7f39983b6700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f399015d6b0 0x7f399016ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.113+0000 7f39983b6700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39900b27b0 con 0x7f3990156fb0 2024-08-17T02:29:19.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.113+0000 7f39983b6700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39900b04a0 con 0x7f399015d6b0 2024-08-17T02:29:19.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.113+0000 7f39983b6700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39900b0760 con 0x7f39900cafa0 2024-08-17T02:29:19.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.113+0000 7f3995951700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3990156fb0 0x7f3990169060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.113+0000 7f3995951700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3990156fb0 0x7f3990169060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34044/0 (socket says 172.21.15.102:34044) 2024-08-17T02:29:19.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.113+0000 7f3995951700 1 -- 172.21.15.102:0/4033899417 learned_addr learned my addr 172.21.15.102:0/4033899417 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:19.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.113+0000 7f3996152700 1 --2- 172.21.15.102:0/4033899417 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f39900cafa0 0x7f39900b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.113+0000 7f3996953700 1 --2- 172.21.15.102:0/4033899417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f399015d6b0 0x7f399016ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.117+0000 7f3995951700 1 -- 172.21.15.102:0/4033899417 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f39900cafa0 msgr2=0x7f39900b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.117+0000 7f3995951700 1 --2- 172.21.15.102:0/4033899417 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f39900cafa0 0x7f39900b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.117+0000 7f3995951700 1 -- 172.21.15.102:0/4033899417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f399015d6b0 msgr2=0x7f399016ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.117+0000 7f3995951700 1 --2- 172.21.15.102:0/4033899417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f399015d6b0 0x7f399016ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.117+0000 7f3995951700 1 -- 172.21.15.102:0/4033899417 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c009420 con 0x7f3990156fb0 2024-08-17T02:29:19.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.117+0000 7f3995951700 1 --2- 172.21.15.102:0/4033899417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3990156fb0 0x7f3990169060 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f398000c560 tx=0x7f3980007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.117+0000 7f39867fc700 1 -- 172.21.15.102:0/4033899417 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980005c00 con 0x7f3990156fb0 2024-08-17T02:29:19.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.117+0000 7f39867fc700 1 -- 172.21.15.102:0/4033899417 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3980005d60 con 0x7f3990156fb0 2024-08-17T02:29:19.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.117+0000 7f39983b6700 1 -- 172.21.15.102:0/4033899417 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3988009a20 con 0x7f3990156fb0 2024-08-17T02:29:19.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.117+0000 7f39867fc700 1 -- 172.21.15.102:0/4033899417 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980007300 con 0x7f3990156fb0 2024-08-17T02:29:19.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.117+0000 7f39983b6700 1 -- 172.21.15.102:0/4033899417 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39900b0d20 con 0x7f3990156fb0 2024-08-17T02:29:19.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.117+0000 7f39983b6700 1 -- 172.21.15.102:0/4033899417 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39900b0f40 con 0x7f3990156fb0 2024-08-17T02:29:19.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.117+0000 7f39867fc700 1 -- 172.21.15.102:0/4033899417 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f39800076b0 con 0x7f3990156fb0 2024-08-17T02:29:19.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.117+0000 7f39867fc700 1 --2- 172.21.15.102:0/4033899417 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3974060860 0x7f3974062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.121+0000 7f3996152700 1 --2- 172.21.15.102:0/4033899417 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3974060860 0x7f3974062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.121+0000 7f39867fc700 1 -- 172.21.15.102:0/4033899417 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f398007bdd0 con 0x7f3990156fb0 2024-08-17T02:29:19.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.121+0000 7f3996152700 1 --2- 172.21.15.102:0/4033899417 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3974060860 0x7f3974062d10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f398c009f40 tx=0x7f398c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.121+0000 7f39867fc700 1 -- 172.21.15.102:0/4033899417 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f398004c4c0 con 0x7f3990156fb0 2024-08-17T02:29:19.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.289+0000 7f39983b6700 1 -- 172.21.15.102:0/4033899417 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f39900645c0 con 0x7f3974060860 2024-08-17T02:29:19.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.289+0000 7f39867fc700 1 -- 172.21.15.102:0/4033899417 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f39900645c0 con 0x7f3974060860 2024-08-17T02:29:19.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.293+0000 7f39983b6700 1 -- 172.21.15.102:0/4033899417 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3974060860 msgr2=0x7f3974062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.293+0000 7f39983b6700 1 --2- 172.21.15.102:0/4033899417 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3974060860 0x7f3974062d10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f398c009f40 tx=0x7f398c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.293+0000 7f39983b6700 1 -- 172.21.15.102:0/4033899417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3990156fb0 msgr2=0x7f3990169060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.293+0000 7f39983b6700 1 --2- 172.21.15.102:0/4033899417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3990156fb0 0x7f3990169060 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f398000c560 tx=0x7f3980007dd0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.293+0000 7f39983b6700 1 -- 172.21.15.102:0/4033899417 shutdown_connections 2024-08-17T02:29:19.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.293+0000 7f39983b6700 1 --2- 172.21.15.102:0/4033899417 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f3974060860 0x7f3974062d10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.293+0000 7f39983b6700 1 --2- 172.21.15.102:0/4033899417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3990156fb0 0x7f3990169060 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.293+0000 7f39983b6700 1 --2- 172.21.15.102:0/4033899417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f399015d6b0 0x7f399016ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.293+0000 7f39983b6700 1 --2- 172.21.15.102:0/4033899417 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f39900cafa0 0x7f39900b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.293+0000 7f39983b6700 1 -- 172.21.15.102:0/4033899417 >> 172.21.15.102:0/4033899417 conn(0x7f3990099500 msgr2=0x7f3990151a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.293+0000 7f39983b6700 1 -- 172.21.15.102:0/4033899417 shutdown_connections 2024-08-17T02:29:19.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.293+0000 7f39983b6700 1 -- 172.21.15.102:0/4033899417 wait complete. 2024-08-17T02:29:19.298 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:29:19.307 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:29:19.308 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:19.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.421+0000 7f740bb25700 1 Processor -- start 2024-08-17T02:29:19.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.421+0000 7f740bb25700 1 -- start start 2024-08-17T02:29:19.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740bb25700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7404067990 0x7f74040b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740bb25700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f74040b5e30 0x7f740409a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740bb25700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74040b2970 con 0x7f74040b34b0 2024-08-17T02:29:19.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740bb25700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74040b5380 con 0x7f74040b5e30 2024-08-17T02:29:19.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740bb25700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74040b2040 con 0x7f7404067990 2024-08-17T02:29:19.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740a0c2700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f74040b5e30 0x7f740409a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740a0c2700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f74040b5e30 0x7f740409a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34054/0 (socket says 172.21.15.102:34054) 2024-08-17T02:29:19.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740a0c2700 1 -- 172.21.15.102:0/1320430087 learned_addr learned my addr 172.21.15.102:0/1320430087 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:19.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f74090c0700 1 --2- 172.21.15.102:0/1320430087 >> v2:172.21.15.121:3300/0 conn(0x7f7404067990 0x7f74040b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740a0c2700 1 -- 172.21.15.102:0/1320430087 >> v2:172.21.15.121:3300/0 conn(0x7f7404067990 msgr2=0x7f74040b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:19.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740a0c2700 1 --2- 172.21.15.102:0/1320430087 >> v2:172.21.15.121:3300/0 conn(0x7f7404067990 0x7f74040b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740a0c2700 1 -- 172.21.15.102:0/1320430087 >> v1:172.21.15.121:6789/0 conn(0x7f74040b34b0 legacy=0x7f74040aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740a0c2700 1 -- 172.21.15.102:0/1320430087 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74040b2320 con 0x7f74040b5e30 2024-08-17T02:29:19.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740a0c2700 1 --2- 172.21.15.102:0/1320430087 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74040b5e30 0x7f740409a190 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f740408a6c0 tx=0x7f73fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a4ca64eb36a49f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f74088bf700 1 -- 172.21.15.102:0/1320430087 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00e070 con 0x7f74040b5e30 2024-08-17T02:29:19.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f74088bf700 1 -- 172.21.15.102:0/1320430087 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc00ba20 con 0x7f74040b5e30 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f74088bf700 1 -- 172.21.15.102:0/1320430087 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc0092e0 con 0x7f74040b5e30 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740bb25700 1 -- 172.21.15.102:0/1320430087 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74040b5e30 msgr2=0x7f740409a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740bb25700 1 --2- 172.21.15.102:0/1320430087 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74040b5e30 0x7f740409a190 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f740408a6c0 tx=0x7f73fc009840 comp rx=0 tx=0).stop 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740bb25700 1 -- 172.21.15.102:0/1320430087 shutdown_connections 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740bb25700 1 --2- 172.21.15.102:0/1320430087 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74040b5e30 0x7f740409a190 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740bb25700 1 --2- 172.21.15.102:0/1320430087 >> v2:172.21.15.121:3300/0 conn(0x7f7404067990 0x7f74040b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740bb25700 1 -- 172.21.15.102:0/1320430087 >> 172.21.15.102:0/1320430087 conn(0x7f7404067590 msgr2=0x7f74040d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740bb25700 1 -- 172.21.15.102:0/1320430087 shutdown_connections 2024-08-17T02:29:19.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.425+0000 7f740bb25700 1 -- 172.21.15.102:0/1320430087 wait complete. 2024-08-17T02:29:19.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f740bb25700 1 Processor -- start 2024-08-17T02:29:19.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f740bb25700 1 -- start start 2024-08-17T02:29:19.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f740bb25700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7404067990 0x7f7404155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f740bb25700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74040b34b0 0x7f740415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f740bb25700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74040b5e30 0x7f740415b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f740bb25700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7404169a90 con 0x7f74040b34b0 2024-08-17T02:29:19.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f740bb25700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74041694c0 con 0x7f74040b5e30 2024-08-17T02:29:19.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f740bb25700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74041582e0 con 0x7f7404067990 2024-08-17T02:29:19.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f74090c0700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74040b34b0 0x7f740415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f74090c0700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74040b34b0 0x7f740415abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34060/0 (socket says 172.21.15.102:34060) 2024-08-17T02:29:19.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f74090c0700 1 -- 172.21.15.102:0/3367351928 learned_addr learned my addr 172.21.15.102:0/3367351928 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:19.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f740a0c2700 1 --2- 172.21.15.102:0/3367351928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74040b5e30 0x7f740415b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f74098c1700 1 --2- 172.21.15.102:0/3367351928 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7404067990 0x7f7404155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f74090c0700 1 -- 172.21.15.102:0/3367351928 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7404067990 msgr2=0x7f7404155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f74090c0700 1 --2- 172.21.15.102:0/3367351928 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7404067990 0x7f7404155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f74090c0700 1 -- 172.21.15.102:0/3367351928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74040b5e30 msgr2=0x7f740415b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f74090c0700 1 --2- 172.21.15.102:0/3367351928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74040b5e30 0x7f740415b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f74090c0700 1 -- 172.21.15.102:0/3367351928 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc009ae0 con 0x7f74040b34b0 2024-08-17T02:29:19.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f740a0c2700 1 --2- 172.21.15.102:0/3367351928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74040b5e30 0x7f740415b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:19.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f74090c0700 1 --2- 172.21.15.102:0/3367351928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74040b34b0 0x7f740415abf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f740000ea70 tx=0x7f74000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f73f9ffb700 1 -- 172.21.15.102:0/3367351928 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740000c920 con 0x7f74040b34b0 2024-08-17T02:29:19.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f73f9ffb700 1 -- 172.21.15.102:0/3367351928 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740000caa0 con 0x7f74040b34b0 2024-08-17T02:29:19.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f73f9ffb700 1 -- 172.21.15.102:0/3367351928 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740000ce60 con 0x7f74040b34b0 2024-08-17T02:29:19.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f740bb25700 1 -- 172.21.15.102:0/3367351928 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7404157d20 con 0x7f74040b34b0 2024-08-17T02:29:19.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.429+0000 7f740bb25700 1 -- 172.21.15.102:0/3367351928 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7404169720 con 0x7f74040b34b0 2024-08-17T02:29:19.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.433+0000 7f740bb25700 1 -- 172.21.15.102:0/3367351928 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74040638f0 con 0x7f74040b34b0 2024-08-17T02:29:19.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.433+0000 7f73f9ffb700 1 -- 172.21.15.102:0/3367351928 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7400013680 con 0x7f74040b34b0 2024-08-17T02:29:19.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.433+0000 7f73f9ffb700 1 --2- 172.21.15.102:0/3367351928 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f73e8060860 0x7f73e8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.433+0000 7f74098c1700 1 --2- 172.21.15.102:0/3367351928 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f73e8060860 0x7f73e8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.433+0000 7f73f9ffb700 1 -- 172.21.15.102:0/3367351928 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f740007d0d0 con 0x7f74040b34b0 2024-08-17T02:29:19.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.433+0000 7f73f9ffb700 1 --2- 172.21.15.102:0/3367351928 >> [v2:172.21.15.121:6824/24414,v1:172.21.15.121:6825/24414] conn(0x7f73e8066750 0x7f73e8068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.433+0000 7f73f9ffb700 1 -- 172.21.15.102:0/3367351928 --> [v2:172.21.15.121:6824/24414,v1:172.21.15.121:6825/24414] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f73e8069210 con 0x7f73e8066750 2024-08-17T02:29:19.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.433+0000 7f73f9ffb700 1 -- 172.21.15.102:0/3367351928 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f740007d4a0 con 0x7f74040b34b0 2024-08-17T02:29:19.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.433+0000 7f74098c1700 1 --2- 172.21.15.102:0/3367351928 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f73e8060860 0x7f73e8062d10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f73f4003840 tx=0x7f73f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.433+0000 7f740a0c2700 1 --2- 172.21.15.102:0/3367351928 >> [v2:172.21.15.121:6824/24414,v1:172.21.15.121:6825/24414] conn(0x7f73e8066750 0x7f73e8068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.433+0000 7f740a0c2700 1 --2- 172.21.15.102:0/3367351928 >> [v2:172.21.15.121:6824/24414,v1:172.21.15.121:6825/24414] conn(0x7f73e8066750 0x7f73e8068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.437+0000 7f73f9ffb700 1 -- 172.21.15.102:0/3367351928 <== osd.4 v2:172.21.15.121:6824/24414 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f73e8069210 con 0x7f73e8066750 2024-08-17T02:29:19.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.453+0000 7f740bb25700 1 -- 172.21.15.102:0/3367351928 --> [v2:172.21.15.121:6824/24414,v1:172.21.15.121:6825/24414] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7404071590 con 0x7f73e8066750 2024-08-17T02:29:19.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.457+0000 7f73f9ffb700 1 -- 172.21.15.102:0/3367351928 <== osd.4 v2:172.21.15.121:6824/24414 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7404071590 con 0x7f73e8066750 2024-08-17T02:29:19.459 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-08-17T02:29:19.459 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:19.459 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-08-17T02:29:19.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.457+0000 7f740bb25700 1 -- 172.21.15.102:0/3367351928 >> [v2:172.21.15.121:6824/24414,v1:172.21.15.121:6825/24414] conn(0x7f73e8066750 msgr2=0x7f73e8068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.457+0000 7f740bb25700 1 --2- 172.21.15.102:0/3367351928 >> [v2:172.21.15.121:6824/24414,v1:172.21.15.121:6825/24414] conn(0x7f73e8066750 0x7f73e8068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.457+0000 7f740bb25700 1 -- 172.21.15.102:0/3367351928 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f73e8060860 msgr2=0x7f73e8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.457+0000 7f740bb25700 1 --2- 172.21.15.102:0/3367351928 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f73e8060860 0x7f73e8062d10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f73f4003840 tx=0x7f73f4009040 comp rx=0 tx=0).stop 2024-08-17T02:29:19.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.457+0000 7f740bb25700 1 -- 172.21.15.102:0/3367351928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74040b34b0 msgr2=0x7f740415abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.457+0000 7f740bb25700 1 --2- 172.21.15.102:0/3367351928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74040b34b0 0x7f740415abf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f740000ea70 tx=0x7f74000091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.457+0000 7f740a0c2700 1 -- 172.21.15.102:0/3367351928 reap_dead start 2024-08-17T02:29:19.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.457+0000 7f740bb25700 1 -- 172.21.15.102:0/3367351928 shutdown_connections 2024-08-17T02:29:19.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.457+0000 7f740bb25700 1 -- 172.21.15.102:0/3367351928 >> 172.21.15.102:0/3367351928 conn(0x7f7404067590 msgr2=0x7f740415baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.457+0000 7f740bb25700 1 -- 172.21.15.102:0/3367351928 shutdown_connections 2024-08-17T02:29:19.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.457+0000 7f740bb25700 1 -- 172.21.15.102:0/3367351928 wait complete. 2024-08-17T02:29:19.471 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:29:19.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.581+0000 7f4c7f59e700 1 Processor -- start 2024-08-17T02:29:19.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.581+0000 7f4c7f59e700 1 -- start start 2024-08-17T02:29:19.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.581+0000 7f4c7f59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c800ad1b0 0x7f4c800b0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.581+0000 7f4c7f59e700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4c8015cd90 0x7f4c800c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.581+0000 7f4c7f59e700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c800c86e0 con 0x7f4c8015c620 2024-08-17T02:29:19.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.581+0000 7f4c7f59e700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c800cb850 con 0x7f4c8015cd90 2024-08-17T02:29:19.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.581+0000 7f4c7f59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8015d1c0 con 0x7f4c800ad1b0 2024-08-17T02:29:19.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.581+0000 7f4c7ed9d700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4c8015cd90 0x7f4c800c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.581+0000 7f4c7ed9d700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4c8015cd90 0x7f4c800c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34068/0 (socket says 172.21.15.102:34068) 2024-08-17T02:29:19.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.581+0000 7f4c7ed9d700 1 -- 172.21.15.102:0/1933927631 learned_addr learned my addr 172.21.15.102:0/1933927631 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:19.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.581+0000 7f4c7dd9b700 1 --2- 172.21.15.102:0/1933927631 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c800ad1b0 0x7f4c800b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7ed9d700 1 -- 172.21.15.102:0/1933927631 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c800ad1b0 msgr2=0x7f4c800b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:19.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7ed9d700 1 --2- 172.21.15.102:0/1933927631 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c800ad1b0 0x7f4c800b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7ed9d700 1 -- 172.21.15.102:0/1933927631 >> v1:172.21.15.121:6789/0 conn(0x7f4c8015c620 legacy=0x7f4c800acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7ed9d700 1 -- 172.21.15.102:0/1933927631 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8015d490 con 0x7f4c8015cd90 2024-08-17T02:29:19.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7ed9d700 1 --2- 172.21.15.102:0/1933927631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c8015cd90 0x7f4c800c8b70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4c700099b0 tx=0x7f4c70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203d6ae6bf757e7f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7d59a700 1 -- 172.21.15.102:0/1933927631 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c70009ea0 con 0x7f4c8015cd90 2024-08-17T02:29:19.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7d59a700 1 -- 172.21.15.102:0/1933927631 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7000b860 con 0x7f4c8015cd90 2024-08-17T02:29:19.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7d59a700 1 -- 172.21.15.102:0/1933927631 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7000bc00 con 0x7f4c8015cd90 2024-08-17T02:29:19.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7f59e700 1 -- 172.21.15.102:0/1933927631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c8015cd90 msgr2=0x7f4c800c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7f59e700 1 --2- 172.21.15.102:0/1933927631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c8015cd90 0x7f4c800c8b70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4c700099b0 tx=0x7f4c70009250 comp rx=0 tx=0).stop 2024-08-17T02:29:19.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7f59e700 1 -- 172.21.15.102:0/1933927631 shutdown_connections 2024-08-17T02:29:19.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7f59e700 1 --2- 172.21.15.102:0/1933927631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c8015cd90 0x7f4c800c8b70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7f59e700 1 --2- 172.21.15.102:0/1933927631 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c800ad1b0 0x7f4c800b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7f59e700 1 -- 172.21.15.102:0/1933927631 >> 172.21.15.102:0/1933927631 conn(0x7f4c800ca900 msgr2=0x7f4c800cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7f59e700 1 -- 172.21.15.102:0/1933927631 shutdown_connections 2024-08-17T02:29:19.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7f59e700 1 -- 172.21.15.102:0/1933927631 wait complete. 2024-08-17T02:29:19.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7f59e700 1 Processor -- start 2024-08-17T02:29:19.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7f59e700 1 -- start start 2024-08-17T02:29:19.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7f59e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c800ad1b0 0x7f4c800aa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7f59e700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c8015c620 0x7f4c800ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7f59e700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c8015cd90 0x7f4c801539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7f59e700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c800abf80 con 0x7f4c800ad1b0 2024-08-17T02:29:19.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7f59e700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c800c5b70 con 0x7f4c8015cd90 2024-08-17T02:29:19.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7f59e700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c800c6110 con 0x7f4c8015c620 2024-08-17T02:29:19.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7e59c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c800ad1b0 0x7f4c800aa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7e59c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c800ad1b0 0x7f4c800aa670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34080/0 (socket says 172.21.15.102:34080) 2024-08-17T02:29:19.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7e59c700 1 -- 172.21.15.102:0/3703613180 learned_addr learned my addr 172.21.15.102:0/3703613180 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:19.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7dd9b700 1 --2- 172.21.15.102:0/3703613180 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c8015c620 0x7f4c800ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.585+0000 7f4c7ed9d700 1 --2- 172.21.15.102:0/3703613180 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c8015cd90 0x7f4c801539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.589+0000 7f4c7e59c700 1 -- 172.21.15.102:0/3703613180 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c8015c620 msgr2=0x7f4c800ab2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.589+0000 7f4c7e59c700 1 --2- 172.21.15.102:0/3703613180 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c8015c620 0x7f4c800ab2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.589+0000 7f4c7e59c700 1 -- 172.21.15.102:0/3703613180 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c8015cd90 msgr2=0x7f4c801539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.589+0000 7f4c7e59c700 1 --2- 172.21.15.102:0/3703613180 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c8015cd90 0x7f4c801539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.589+0000 7f4c7e59c700 1 -- 172.21.15.102:0/3703613180 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c700094f0 con 0x7f4c800ad1b0 2024-08-17T02:29:19.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.589+0000 7f4c7e59c700 1 --2- 172.21.15.102:0/3703613180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c800ad1b0 0x7f4c800aa670 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800cb40 tx=0x7f4c780017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.589+0000 7f4c767fc700 1 -- 172.21.15.102:0/3703613180 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7800ce50 con 0x7f4c800ad1b0 2024-08-17T02:29:19.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.589+0000 7f4c767fc700 1 -- 172.21.15.102:0/3703613180 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7800a7a0 con 0x7f4c800ad1b0 2024-08-17T02:29:19.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.589+0000 7f4c7f59e700 1 -- 172.21.15.102:0/3703613180 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c800ab9c0 con 0x7f4c800ad1b0 2024-08-17T02:29:19.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.589+0000 7f4c767fc700 1 -- 172.21.15.102:0/3703613180 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7800ab60 con 0x7f4c800ad1b0 2024-08-17T02:29:19.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.589+0000 7f4c7f59e700 1 -- 172.21.15.102:0/3703613180 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c800c5da0 con 0x7f4c800ad1b0 2024-08-17T02:29:19.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.589+0000 7f4c7f59e700 1 -- 172.21.15.102:0/3703613180 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c800643a0 con 0x7f4c800ad1b0 2024-08-17T02:29:19.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.589+0000 7f4c767fc700 1 -- 172.21.15.102:0/3703613180 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4c78003030 con 0x7f4c800ad1b0 2024-08-17T02:29:19.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.589+0000 7f4c767fc700 1 --2- 172.21.15.102:0/3703613180 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4c64060860 0x7f4c64062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.589+0000 7f4c767fc700 1 -- 172.21.15.102:0/3703613180 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f4c7807c890 con 0x7f4c800ad1b0 2024-08-17T02:29:19.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.589+0000 7f4c7dd9b700 1 --2- 172.21.15.102:0/3703613180 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4c64060860 0x7f4c64062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.593+0000 7f4c7dd9b700 1 --2- 172.21.15.102:0/3703613180 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4c64060860 0x7f4c64062d10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4c80159e80 tx=0x7f4c680091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.597+0000 7f4c767fc700 1 -- 172.21.15.102:0/3703613180 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4c7804cf80 con 0x7f4c800ad1b0 2024-08-17T02:29:19.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.761+0000 7f4c7f59e700 1 -- 172.21.15.102:0/3703613180 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c800c6250 con 0x7f4c64060860 2024-08-17T02:29:19.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.765+0000 7f4c767fc700 1 -- 172.21.15.102:0/3703613180 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4c68011a20 con 0x7f4c64060860 2024-08-17T02:29:19.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.769+0000 7f4c7f59e700 1 -- 172.21.15.102:0/3703613180 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4c64060860 msgr2=0x7f4c64062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.769+0000 7f4c7f59e700 1 --2- 172.21.15.102:0/3703613180 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4c64060860 0x7f4c64062d10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4c80159e80 tx=0x7f4c680091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.769+0000 7f4c7f59e700 1 -- 172.21.15.102:0/3703613180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c800ad1b0 msgr2=0x7f4c800aa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.769+0000 7f4c7f59e700 1 --2- 172.21.15.102:0/3703613180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c800ad1b0 0x7f4c800aa670 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800cb40 tx=0x7f4c780017b0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.769+0000 7f4c7f59e700 1 -- 172.21.15.102:0/3703613180 shutdown_connections 2024-08-17T02:29:19.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.769+0000 7f4c7f59e700 1 --2- 172.21.15.102:0/3703613180 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f4c64060860 0x7f4c64062d10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.769+0000 7f4c7f59e700 1 --2- 172.21.15.102:0/3703613180 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c8015cd90 0x7f4c801539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.769+0000 7f4c7f59e700 1 --2- 172.21.15.102:0/3703613180 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f4c8015c620 0x7f4c800ab2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.769+0000 7f4c7f59e700 1 --2- 172.21.15.102:0/3703613180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c800ad1b0 0x7f4c800aa670 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.769+0000 7f4c7f59e700 1 -- 172.21.15.102:0/3703613180 >> 172.21.15.102:0/3703613180 conn(0x7f4c800ca900 msgr2=0x7f4c800ae0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.769+0000 7f4c7f59e700 1 -- 172.21.15.102:0/3703613180 shutdown_connections 2024-08-17T02:29:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.769+0000 7f4c7f59e700 1 -- 172.21.15.102:0/3703613180 wait complete. 2024-08-17T02:29:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:29:19.787 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:29:19.787 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:19.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.901+0000 7f62e48a2700 1 Processor -- start 2024-08-17T02:29:19.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.901+0000 7f62e48a2700 1 -- start start 2024-08-17T02:29:19.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62e48a2700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f62e00b2e90 0x7f62e00c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62e48a2700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f62e00cded0 0x7f62e00ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62e48a2700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e00c5b40 con 0x7f62e00b26d0 2024-08-17T02:29:19.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62e48a2700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e00b3310 con 0x7f62e00cded0 2024-08-17T02:29:19.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62e48a2700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e00b2aa0 con 0x7f62e00b2e90 2024-08-17T02:29:19.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62dffff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f62e00cded0 0x7f62e00ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62df7fe700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f62e00b26d0 0x7f62e00c5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55976/0 (socket says 172.21.15.102:55976) 2024-08-17T02:29:19.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62df7fe700 1 -- 172.21.15.102:0/1633912351 learned_addr learned my addr 172.21.15.102:0/1633912351 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:19.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62deffd700 1 --2- 172.21.15.102:0/1633912351 >> v2:172.21.15.121:3300/0 conn(0x7f62e00b2e90 0x7f62e00c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62dffff700 1 -- 172.21.15.102:0/1633912351 >> v2:172.21.15.121:3300/0 conn(0x7f62e00b2e90 msgr2=0x7f62e00c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:19.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62dffff700 1 --2- 172.21.15.102:0/1633912351 >> v2:172.21.15.121:3300/0 conn(0x7f62e00b2e90 0x7f62e00c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62dffff700 1 -- 172.21.15.102:0/1633912351 >> v1:172.21.15.102:6789/0 conn(0x7f62e00b26d0 legacy=0x7f62e00c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62dffff700 1 -- 172.21.15.102:0/1633912351 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e0159820 con 0x7f62e00cded0 2024-08-17T02:29:19.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62deffd700 1 --2- 172.21.15.102:0/1633912351 >> v2:172.21.15.121:3300/0 conn(0x7f62e00b2e90 0x7f62e00c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:19.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62dffff700 1 --2- 172.21.15.102:0/1633912351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e00cded0 0x7f62e00ce330 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009e60 tx=0x7f62d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9501a4eeea0c2b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62de7fc700 1 -- 172.21.15.102:0/1633912351 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d800e070 con 0x7f62e00cded0 2024-08-17T02:29:19.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62de7fc700 1 -- 172.21.15.102:0/1633912351 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d800bbf0 con 0x7f62e00cded0 2024-08-17T02:29:19.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62de7fc700 1 -- 172.21.15.102:0/1633912351 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d8012430 con 0x7f62e00cded0 2024-08-17T02:29:19.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62e48a2700 1 -- 172.21.15.102:0/1633912351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e00cded0 msgr2=0x7f62e00ce330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62e48a2700 1 --2- 172.21.15.102:0/1633912351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e00cded0 0x7f62e00ce330 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009e60 tx=0x7f62d8009780 comp rx=0 tx=0).stop 2024-08-17T02:29:19.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62e48a2700 1 -- 172.21.15.102:0/1633912351 shutdown_connections 2024-08-17T02:29:19.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62e48a2700 1 --2- 172.21.15.102:0/1633912351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e00cded0 0x7f62e00ce330 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62e48a2700 1 --2- 172.21.15.102:0/1633912351 >> v2:172.21.15.121:3300/0 conn(0x7f62e00b2e90 0x7f62e00c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62e48a2700 1 -- 172.21.15.102:0/1633912351 >> 172.21.15.102:0/1633912351 conn(0x7f62e0067590 msgr2=0x7f62e00d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62e48a2700 1 -- 172.21.15.102:0/1633912351 shutdown_connections 2024-08-17T02:29:19.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62e48a2700 1 -- 172.21.15.102:0/1633912351 wait complete. 2024-08-17T02:29:19.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62e48a2700 1 Processor -- start 2024-08-17T02:29:19.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.905+0000 7f62e48a2700 1 -- start start 2024-08-17T02:29:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62e48a2700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e00b26d0 0x7f62e00c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62e48a2700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62e00b2e90 0x7f62e009aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62e48a2700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f62e00cded0 0x7f62e0168c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62e48a2700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00acdf0 con 0x7f62e00b26d0 2024-08-17T02:29:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62e48a2700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00c9140 con 0x7f62e00b2e90 2024-08-17T02:29:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62e48a2700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00c9b10 con 0x7f62e00cded0 2024-08-17T02:29:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62df7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e00b26d0 0x7f62e00c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62df7fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e00b26d0 0x7f62e00c95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34088/0 (socket says 172.21.15.102:34088) 2024-08-17T02:29:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62df7fe700 1 -- 172.21.15.102:0/1798141124 learned_addr learned my addr 172.21.15.102:0/1798141124 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62deffd700 1 --2- 172.21.15.102:0/1798141124 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62e00b2e90 0x7f62e009aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62dffff700 1 --2- 172.21.15.102:0/1798141124 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f62e00cded0 0x7f62e0168c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62df7fe700 1 -- 172.21.15.102:0/1798141124 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f62e00cded0 msgr2=0x7f62e0168c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62df7fe700 1 --2- 172.21.15.102:0/1798141124 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f62e00cded0 0x7f62e0168c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62df7fe700 1 -- 172.21.15.102:0/1798141124 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62e00b2e90 msgr2=0x7f62e009aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62df7fe700 1 --2- 172.21.15.102:0/1798141124 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62e00b2e90 0x7f62e009aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62df7fe700 1 -- 172.21.15.102:0/1798141124 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d8009a20 con 0x7f62e00b26d0 2024-08-17T02:29:19.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62df7fe700 1 --2- 172.21.15.102:0/1798141124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e00b26d0 0x7f62e00c95d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f62d400c7c0 tx=0x7f62d4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62c77fe700 1 -- 172.21.15.102:0/1798141124 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d4005b30 con 0x7f62e00b26d0 2024-08-17T02:29:19.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62c77fe700 1 -- 172.21.15.102:0/1798141124 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d4005c90 con 0x7f62e00b26d0 2024-08-17T02:29:19.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62e48a2700 1 -- 172.21.15.102:0/1798141124 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e00c8530 con 0x7f62e00b26d0 2024-08-17T02:29:19.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62c77fe700 1 -- 172.21.15.102:0/1798141124 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d4004a80 con 0x7f62e00b26d0 2024-08-17T02:29:19.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.909+0000 7f62e48a2700 1 -- 172.21.15.102:0/1798141124 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e00c8dd0 con 0x7f62e00b26d0 2024-08-17T02:29:19.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.913+0000 7f62e48a2700 1 -- 172.21.15.102:0/1798141124 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62e00644b0 con 0x7f62e00b26d0 2024-08-17T02:29:19.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.913+0000 7f62c77fe700 1 -- 172.21.15.102:0/1798141124 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f62d40070d0 con 0x7f62e00b26d0 2024-08-17T02:29:19.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.913+0000 7f62c77fe700 1 --2- 172.21.15.102:0/1798141124 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f62cc060860 0x7f62cc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.913+0000 7f62c77fe700 1 -- 172.21.15.102:0/1798141124 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f62d407bc80 con 0x7f62e00b26d0 2024-08-17T02:29:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.913+0000 7f62deffd700 1 --2- 172.21.15.102:0/1798141124 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f62cc060860 0x7f62cc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.913+0000 7f62c77fe700 1 --2- 172.21.15.102:0/1798141124 >> [v2:172.21.15.121:6808/24413,v1:172.21.15.121:6809/24413] conn(0x7f62cc066750 0x7f62cc068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.913+0000 7f62c77fe700 1 -- 172.21.15.102:0/1798141124 --> [v2:172.21.15.121:6808/24413,v1:172.21.15.121:6809/24413] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62cc069210 con 0x7f62cc066750 2024-08-17T02:29:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.913+0000 7f62c77fe700 1 -- 172.21.15.102:0/1798141124 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62d407e2c0 con 0x7f62e00b26d0 2024-08-17T02:29:19.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.913+0000 7f62deffd700 1 --2- 172.21.15.102:0/1798141124 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f62cc060860 0x7f62cc062d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f62e00b2210 tx=0x7f62d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.913+0000 7f62dffff700 1 --2- 172.21.15.102:0/1798141124 >> [v2:172.21.15.121:6808/24413,v1:172.21.15.121:6809/24413] conn(0x7f62cc066750 0x7f62cc068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.917+0000 7f62dffff700 1 --2- 172.21.15.102:0/1798141124 >> [v2:172.21.15.121:6808/24413,v1:172.21.15.121:6809/24413] conn(0x7f62cc066750 0x7f62cc068b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.917+0000 7f62c77fe700 1 -- 172.21.15.102:0/1798141124 <== osd.5 v2:172.21.15.121:6808/24413 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f62cc069210 con 0x7f62cc066750 2024-08-17T02:29:19.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.937+0000 7f62e48a2700 1 -- 172.21.15.102:0/1798141124 --> [v2:172.21.15.121:6808/24413,v1:172.21.15.121:6809/24413] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f62e00c8170 con 0x7f62cc066750 2024-08-17T02:29:19.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.937+0000 7f62c77fe700 1 -- 172.21.15.102:0/1798141124 <== osd.5 v2:172.21.15.121:6808/24413 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f62e00c8170 con 0x7f62cc066750 2024-08-17T02:29:19.941 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-08-17T02:29:19.941 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:19.942 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-08-17T02:29:19.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.941+0000 7f62e48a2700 1 -- 172.21.15.102:0/1798141124 >> [v2:172.21.15.121:6808/24413,v1:172.21.15.121:6809/24413] conn(0x7f62cc066750 msgr2=0x7f62cc068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.941+0000 7f62e48a2700 1 --2- 172.21.15.102:0/1798141124 >> [v2:172.21.15.121:6808/24413,v1:172.21.15.121:6809/24413] conn(0x7f62cc066750 0x7f62cc068b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.941+0000 7f62e48a2700 1 -- 172.21.15.102:0/1798141124 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f62cc060860 msgr2=0x7f62cc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.941+0000 7f62e48a2700 1 --2- 172.21.15.102:0/1798141124 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f62cc060860 0x7f62cc062d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f62e00b2210 tx=0x7f62d0008040 comp rx=0 tx=0).stop 2024-08-17T02:29:19.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.941+0000 7f62e48a2700 1 -- 172.21.15.102:0/1798141124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e00b26d0 msgr2=0x7f62e00c95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.941+0000 7f62e48a2700 1 --2- 172.21.15.102:0/1798141124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e00b26d0 0x7f62e00c95d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f62d400c7c0 tx=0x7f62d4007f70 comp rx=0 tx=0).stop 2024-08-17T02:29:19.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.941+0000 7f62dffff700 1 -- 172.21.15.102:0/1798141124 reap_dead start 2024-08-17T02:29:19.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.941+0000 7f62e48a2700 1 -- 172.21.15.102:0/1798141124 shutdown_connections 2024-08-17T02:29:19.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.941+0000 7f62e48a2700 1 -- 172.21.15.102:0/1798141124 >> 172.21.15.102:0/1798141124 conn(0x7f62e0067590 msgr2=0x7f62e0068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.941+0000 7f62e48a2700 1 -- 172.21.15.102:0/1798141124 shutdown_connections 2024-08-17T02:29:19.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:19.941+0000 7f62e48a2700 1 -- 172.21.15.102:0/1798141124 wait complete. 2024-08-17T02:29:19.960 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:29:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac62f5700 1 Processor -- start 2024-08-17T02:29:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac62f5700 1 -- start start 2024-08-17T02:29:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac62f5700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feac0154900 0x7feac00b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac62f5700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feac00b12d0 0x7feac00cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac62f5700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7feac00cb390 0x7feac006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac62f5700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac0068790 con 0x7feac0154900 2024-08-17T02:29:20.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac62f5700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac01583f0 con 0x7feac00cb390 2024-08-17T02:29:20.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac62f5700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac00cbaa0 con 0x7feac00b12d0 2024-08-17T02:29:20.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac52f3700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feac0154900 0x7feac00b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac52f3700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feac0154900 0x7feac00b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34096/0 (socket says 172.21.15.102:34096) 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac52f3700 1 -- 172.21.15.102:0/1898852761 learned_addr learned my addr 172.21.15.102:0/1898852761 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac5af4700 1 --2- 172.21.15.102:0/1898852761 >> v2:172.21.15.121:3300/0 conn(0x7feac00cb390 0x7feac006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac4af2700 1 --2- 172.21.15.102:0/1898852761 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feac00b12d0 0x7feac00cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac52f3700 1 -- 172.21.15.102:0/1898852761 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feac00b12d0 msgr2=0x7feac00cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac52f3700 1 --2- 172.21.15.102:0/1898852761 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feac00b12d0 0x7feac00cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac52f3700 1 -- 172.21.15.102:0/1898852761 >> v2:172.21.15.121:3300/0 conn(0x7feac00cb390 msgr2=0x7feac006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac52f3700 1 --2- 172.21.15.102:0/1898852761 >> v2:172.21.15.121:3300/0 conn(0x7feac00cb390 0x7feac006df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac52f3700 1 -- 172.21.15.102:0/1898852761 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac00b1700 con 0x7feac0154900 2024-08-17T02:29:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.069+0000 7feac5af4700 1 --2- 172.21.15.102:0/1898852761 >> v2:172.21.15.121:3300/0 conn(0x7feac00cb390 0x7feac006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.073+0000 7feac52f3700 1 --2- 172.21.15.102:0/1898852761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feac0154900 0x7feac00b0d90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7feac0070340 tx=0x7feab0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d18f4fd0e96a468 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.073+0000 7feab7fff700 1 -- 172.21.15.102:0/1898852761 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab0009e70 con 0x7feac0154900 2024-08-17T02:29:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.073+0000 7feab7fff700 1 -- 172.21.15.102:0/1898852761 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab000b860 con 0x7feac0154900 2024-08-17T02:29:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.073+0000 7feab7fff700 1 -- 172.21.15.102:0/1898852761 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab000bc00 con 0x7feac0154900 2024-08-17T02:29:20.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.073+0000 7feac62f5700 1 -- 172.21.15.102:0/1898852761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feac0154900 msgr2=0x7feac00b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.073+0000 7feac62f5700 1 --2- 172.21.15.102:0/1898852761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feac0154900 0x7feac00b0d90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7feac0070340 tx=0x7feab0009250 comp rx=0 tx=0).stop 2024-08-17T02:29:20.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.073+0000 7feac62f5700 1 -- 172.21.15.102:0/1898852761 shutdown_connections 2024-08-17T02:29:20.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.073+0000 7feac62f5700 1 --2- 172.21.15.102:0/1898852761 >> v2:172.21.15.121:3300/0 conn(0x7feac00cb390 0x7feac006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.073+0000 7feac62f5700 1 --2- 172.21.15.102:0/1898852761 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feac00b12d0 0x7feac00cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.073+0000 7feac62f5700 1 --2- 172.21.15.102:0/1898852761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feac0154900 0x7feac00b0d90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.073+0000 7feac62f5700 1 -- 172.21.15.102:0/1898852761 >> 172.21.15.102:0/1898852761 conn(0x7feac00678d0 msgr2=0x7feac0067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.073+0000 7feac62f5700 1 -- 172.21.15.102:0/1898852761 shutdown_connections 2024-08-17T02:29:20.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.073+0000 7feac62f5700 1 -- 172.21.15.102:0/1898852761 wait complete. 2024-08-17T02:29:20.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac62f5700 1 Processor -- start 2024-08-17T02:29:20.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac62f5700 1 -- start start 2024-08-17T02:29:20.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac62f5700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feac00b12d0 0x7feac01424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac62f5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feac00cb390 0x7feac0166c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac62f5700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feac0154900 0x7feac0069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac62f5700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac0143a00 con 0x7feac00cb390 2024-08-17T02:29:20.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac62f5700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac0142df0 con 0x7feac0154900 2024-08-17T02:29:20.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac62f5700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac01430d0 con 0x7feac00b12d0 2024-08-17T02:29:20.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac4af2700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feac00cb390 0x7feac0166c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac4af2700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feac00cb390 0x7feac0166c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34102/0 (socket says 172.21.15.102:34102) 2024-08-17T02:29:20.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac4af2700 1 -- 172.21.15.102:0/1546789961 learned_addr learned my addr 172.21.15.102:0/1546789961 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:20.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac52f3700 1 --2- 172.21.15.102:0/1546789961 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feac00b12d0 0x7feac01424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac5af4700 1 --2- 172.21.15.102:0/1546789961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feac0154900 0x7feac0069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac4af2700 1 -- 172.21.15.102:0/1546789961 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feac00b12d0 msgr2=0x7feac01424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac4af2700 1 --2- 172.21.15.102:0/1546789961 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feac00b12d0 0x7feac01424a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac4af2700 1 -- 172.21.15.102:0/1546789961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feac0154900 msgr2=0x7feac0069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac4af2700 1 --2- 172.21.15.102:0/1546789961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feac0154900 0x7feac0069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac4af2700 1 -- 172.21.15.102:0/1546789961 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab00094f0 con 0x7feac00cb390 2024-08-17T02:29:20.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac4af2700 1 --2- 172.21.15.102:0/1546789961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feac00cb390 0x7feac0166c20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7feabc009e70 tx=0x7feabc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feab57fa700 1 -- 172.21.15.102:0/1546789961 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc00cb50 con 0x7feac00cb390 2024-08-17T02:29:20.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feab57fa700 1 -- 172.21.15.102:0/1546789961 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc00f040 con 0x7feac00cb390 2024-08-17T02:29:20.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac62f5700 1 -- 172.21.15.102:0/1546789961 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac01433b0 con 0x7feac00cb390 2024-08-17T02:29:20.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feab57fa700 1 -- 172.21.15.102:0/1546789961 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc014480 con 0x7feac00cb390 2024-08-17T02:29:20.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.077+0000 7feac62f5700 1 -- 172.21.15.102:0/1546789961 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac01429e0 con 0x7feac00cb390 2024-08-17T02:29:20.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.081+0000 7feac62f5700 1 -- 172.21.15.102:0/1546789961 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac00643a0 con 0x7feac00cb390 2024-08-17T02:29:20.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.081+0000 7feab57fa700 1 -- 172.21.15.102:0/1546789961 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7feabc014830 con 0x7feac00cb390 2024-08-17T02:29:20.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.081+0000 7feab57fa700 1 --2- 172.21.15.102:0/1546789961 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7feaac060890 0x7feaac062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.081+0000 7feac52f3700 1 --2- 172.21.15.102:0/1546789961 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7feaac060890 0x7feaac062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.081+0000 7feab57fa700 1 -- 172.21.15.102:0/1546789961 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7feabc07d570 con 0x7feac00cb390 2024-08-17T02:29:20.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.081+0000 7feac52f3700 1 --2- 172.21.15.102:0/1546789961 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7feaac060890 0x7feaac062d40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7feac0070340 tx=0x7feab0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.085+0000 7feab57fa700 1 -- 172.21.15.102:0/1546789961 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7feabc04dbc0 con 0x7feac00cb390 2024-08-17T02:29:20.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.249+0000 7feac62f5700 1 -- 172.21.15.102:0/1546789961 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7feac00681c0 con 0x7feaac060890 2024-08-17T02:29:20.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.249+0000 7feab57fa700 1 -- 172.21.15.102:0/1546789961 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feac00681c0 con 0x7feaac060890 2024-08-17T02:29:20.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.253+0000 7feac62f5700 1 -- 172.21.15.102:0/1546789961 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7feaac060890 msgr2=0x7feaac062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.253+0000 7feac62f5700 1 --2- 172.21.15.102:0/1546789961 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7feaac060890 0x7feaac062d40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7feac0070340 tx=0x7feab0017000 comp rx=0 tx=0).stop 2024-08-17T02:29:20.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.253+0000 7feac62f5700 1 -- 172.21.15.102:0/1546789961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feac00cb390 msgr2=0x7feac0166c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.253+0000 7feac62f5700 1 --2- 172.21.15.102:0/1546789961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feac00cb390 0x7feac0166c20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7feabc009e70 tx=0x7feabc00b040 comp rx=0 tx=0).stop 2024-08-17T02:29:20.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.253+0000 7feac62f5700 1 -- 172.21.15.102:0/1546789961 shutdown_connections 2024-08-17T02:29:20.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.253+0000 7feac62f5700 1 --2- 172.21.15.102:0/1546789961 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7feaac060890 0x7feaac062d40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.253+0000 7feac62f5700 1 --2- 172.21.15.102:0/1546789961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feac00cb390 0x7feac0166c20 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.253+0000 7feac62f5700 1 --2- 172.21.15.102:0/1546789961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feac0154900 0x7feac0069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.253+0000 7feac62f5700 1 --2- 172.21.15.102:0/1546789961 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7feac00b12d0 0x7feac01424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.253+0000 7feac62f5700 1 -- 172.21.15.102:0/1546789961 >> 172.21.15.102:0/1546789961 conn(0x7feac00678d0 msgr2=0x7feac0152820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.253+0000 7feac62f5700 1 -- 172.21.15.102:0/1546789961 shutdown_connections 2024-08-17T02:29:20.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.253+0000 7feac62f5700 1 -- 172.21.15.102:0/1546789961 wait complete. 2024-08-17T02:29:20.257 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:29:20.271 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:29:20.271 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:20.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.381+0000 7f95d6ad7700 1 Processor -- start 2024-08-17T02:29:20.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d6ad7700 1 -- start start 2024-08-17T02:29:20.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d6ad7700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95d00b26d0 0x7f95d00b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d6ad7700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f95d00c5fd0 0x7f95d00c6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d6ad7700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d00c5b40 con 0x7f95d00c6960 2024-08-17T02:29:20.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d6ad7700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d00b2aa0 con 0x7f95d00c5fd0 2024-08-17T02:29:20.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d6ad7700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d0159820 con 0x7f95d00b26d0 2024-08-17T02:29:20.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d62d6700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f95d00c6960 0x7f95d00cacd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:55980/0 (socket says 172.21.15.102:55980) 2024-08-17T02:29:20.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d62d6700 1 -- 172.21.15.102:0/2029307535 learned_addr learned my addr 172.21.15.102:0/2029307535 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:20.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d5ad5700 1 --2- 172.21.15.102:0/2029307535 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95d00b26d0 0x7f95d00b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d52d4700 1 --2- 172.21.15.102:0/2029307535 >> v2:172.21.15.121:3300/0 conn(0x7f95d00c5fd0 0x7f95d00c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d4ad3700 1 -- 172.21.15.102:0/2029307535 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403827091 0 0) 0x7f95d00c5b40 con 0x7f95d00c6960 2024-08-17T02:29:20.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d4ad3700 1 -- 172.21.15.102:0/2029307535 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95b8003570 con 0x7f95d00c6960 2024-08-17T02:29:20.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d4ad3700 1 -- 172.21.15.102:0/2029307535 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1887778747 0 0) 0x7f95b8003570 con 0x7f95d00c6960 2024-08-17T02:29:20.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d4ad3700 1 -- 172.21.15.102:0/2029307535 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95d00b26d0 msgr2=0x7f95d00b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d4ad3700 1 --2- 172.21.15.102:0/2029307535 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95d00b26d0 0x7f95d00b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d4ad3700 1 -- 172.21.15.102:0/2029307535 >> v2:172.21.15.121:3300/0 conn(0x7f95d00c5fd0 msgr2=0x7f95d00c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d4ad3700 1 --2- 172.21.15.102:0/2029307535 >> v2:172.21.15.121:3300/0 conn(0x7f95d00c5fd0 0x7f95d00c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d4ad3700 1 -- 172.21.15.102:0/2029307535 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d00c4f30 con 0x7f95d00c6960 2024-08-17T02:29:20.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d4ad3700 1 -- 172.21.15.102:0/2029307535 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 261753013 0 0) 0x7f95c00017f0 con 0x7f95d00c6960 2024-08-17T02:29:20.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d4ad3700 1 -- 172.21.15.102:0/2029307535 >> v1:172.21.15.102:6789/0 conn(0x7f95d00c6960 legacy=0x7f95d00cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d4ad3700 1 --2- 172.21.15.102:0/2029307535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95b8003a60 0x7f95b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d4ad3700 1 --2- 172.21.15.102:0/2029307535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95b8004810 0x7f95b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d4ad3700 1 --2- 172.21.15.102:0/2029307535 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95d00b26d0 0x7f95b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d4ad3700 1 -- 172.21.15.102:0/2029307535 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00b2aa0 con 0x7f95b8003a60 2024-08-17T02:29:20.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d4ad3700 1 -- 172.21.15.102:0/2029307535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d0159820 con 0x7f95b8004810 2024-08-17T02:29:20.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d4ad3700 1 -- 172.21.15.102:0/2029307535 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b800ba60 con 0x7f95d00b26d0 2024-08-17T02:29:20.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d5ad5700 1 --2- 172.21.15.102:0/2029307535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95b8003a60 0x7f95b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d62d6700 1 --2- 172.21.15.102:0/2029307535 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95d00b26d0 0x7f95b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d52d4700 1 --2- 172.21.15.102:0/2029307535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95b8004810 0x7f95b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d5ad5700 1 -- 172.21.15.102:0/2029307535 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95d00b26d0 msgr2=0x7f95b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d5ad5700 1 --2- 172.21.15.102:0/2029307535 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95d00b26d0 0x7f95b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d5ad5700 1 -- 172.21.15.102:0/2029307535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95b8004810 msgr2=0x7f95b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d5ad5700 1 --2- 172.21.15.102:0/2029307535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95b8004810 0x7f95b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d5ad5700 1 -- 172.21.15.102:0/2029307535 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b8003570 con 0x7f95b8003a60 2024-08-17T02:29:20.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.385+0000 7f95d52d4700 1 --2- 172.21.15.102:0/2029307535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95b8004810 0x7f95b8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:20.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.389+0000 7f95d5ad5700 1 --2- 172.21.15.102:0/2029307535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95b8003a60 0x7f95b8003e70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009c30 tx=0x7f95c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aad08b7e17b5c43 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.389+0000 7f95d4ad3700 1 -- 172.21.15.102:0/2029307535 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c800e710 con 0x7f95b8003a60 2024-08-17T02:29:20.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.389+0000 7f95d4ad3700 1 -- 172.21.15.102:0/2029307535 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c800e870 con 0x7f95b8003a60 2024-08-17T02:29:20.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.389+0000 7f95d4ad3700 1 -- 172.21.15.102:0/2029307535 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c800ec30 con 0x7f95b8003a60 2024-08-17T02:29:20.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.389+0000 7f95d6ad7700 1 -- 172.21.15.102:0/2029307535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95b8003a60 msgr2=0x7f95b8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.389+0000 7f95d6ad7700 1 --2- 172.21.15.102:0/2029307535 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95b8003a60 0x7f95b8003e70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009c30 tx=0x7f95c80091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.389+0000 7f95d62d6700 1 -- 172.21.15.102:0/2029307535 reap_dead start 2024-08-17T02:29:20.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.389+0000 7f95d6ad7700 1 -- 172.21.15.102:0/2029307535 shutdown_connections 2024-08-17T02:29:20.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.389+0000 7f95d6ad7700 1 -- 172.21.15.102:0/2029307535 >> 172.21.15.102:0/2029307535 conn(0x7f95d0067590 msgr2=0x7f95d00d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.389+0000 7f95d6ad7700 1 -- 172.21.15.102:0/2029307535 shutdown_connections 2024-08-17T02:29:20.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.389+0000 7f95d6ad7700 1 -- 172.21.15.102:0/2029307535 wait complete. 2024-08-17T02:29:20.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.389+0000 7f95d6ad7700 1 Processor -- start 2024-08-17T02:29:20.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.389+0000 7f95d6ad7700 1 -- start start 2024-08-17T02:29:20.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d6ad7700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95d014a8d0 0x7f95d00acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d6ad7700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95d009ce20 0x7f95d009d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d6ad7700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95d014b100 0x7f95d014b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d6ad7700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d009c190 con 0x7f95d014a8d0 2024-08-17T02:29:20.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d6ad7700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d009b540 con 0x7f95d014b100 2024-08-17T02:29:20.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d6ad7700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d009c990 con 0x7f95d009ce20 2024-08-17T02:29:20.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d5ad5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95d014a8d0 0x7f95d00acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d5ad5700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95d014a8d0 0x7f95d00acc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34110/0 (socket says 172.21.15.102:34110) 2024-08-17T02:29:20.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d5ad5700 1 -- 172.21.15.102:0/2803052475 learned_addr learned my addr 172.21.15.102:0/2803052475 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:20.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d52d4700 1 --2- 172.21.15.102:0/2803052475 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95d009ce20 0x7f95d009d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d62d6700 1 --2- 172.21.15.102:0/2803052475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95d014b100 0x7f95d014b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d5ad5700 1 -- 172.21.15.102:0/2803052475 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95d009ce20 msgr2=0x7f95d009d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d5ad5700 1 --2- 172.21.15.102:0/2803052475 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95d009ce20 0x7f95d009d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d5ad5700 1 -- 172.21.15.102:0/2803052475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95d014b100 msgr2=0x7f95d014b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d5ad5700 1 --2- 172.21.15.102:0/2803052475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95d014b100 0x7f95d014b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d5ad5700 1 -- 172.21.15.102:0/2803052475 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d009c380 con 0x7f95d014a8d0 2024-08-17T02:29:20.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d52d4700 1 --2- 172.21.15.102:0/2803052475 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f95d009ce20 0x7f95d009d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:20.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d62d6700 1 --2- 172.21.15.102:0/2803052475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95d014b100 0x7f95d014b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:20.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d5ad5700 1 --2- 172.21.15.102:0/2803052475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95d014a8d0 0x7f95d00acc50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f95c800e4b0 tx=0x7f95c801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95cdffb700 1 -- 172.21.15.102:0/2803052475 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c8022070 con 0x7f95d014a8d0 2024-08-17T02:29:20.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95cdffb700 1 -- 172.21.15.102:0/2803052475 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c800e9e0 con 0x7f95d014a8d0 2024-08-17T02:29:20.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d6ad7700 1 -- 172.21.15.102:0/2803052475 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d009b260 con 0x7f95d014a8d0 2024-08-17T02:29:20.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95cdffb700 1 -- 172.21.15.102:0/2803052475 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c801c450 con 0x7f95d014a8d0 2024-08-17T02:29:20.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.393+0000 7f95d6ad7700 1 -- 172.21.15.102:0/2803052475 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d01588f0 con 0x7f95d014a8d0 2024-08-17T02:29:20.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.397+0000 7f95d6ad7700 1 -- 172.21.15.102:0/2803052475 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95d00644b0 con 0x7f95d014a8d0 2024-08-17T02:29:20.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.397+0000 7f95cdffb700 1 -- 172.21.15.102:0/2803052475 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f95c801c880 con 0x7f95d014a8d0 2024-08-17T02:29:20.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.397+0000 7f95cdffb700 1 --2- 172.21.15.102:0/2803052475 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f95bc060860 0x7f95bc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.397+0000 7f95cdffb700 1 -- 172.21.15.102:0/2803052475 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f95c807e120 con 0x7f95d014a8d0 2024-08-17T02:29:20.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.397+0000 7f95d52d4700 1 --2- 172.21.15.102:0/2803052475 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f95bc060860 0x7f95bc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.397+0000 7f95cdffb700 1 --2- 172.21.15.102:0/2803052475 >> [v2:172.21.15.121:6816/24418,v1:172.21.15.121:6817/24418] conn(0x7f95bc066750 0x7f95bc068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.397+0000 7f95cdffb700 1 -- 172.21.15.102:0/2803052475 --> [v2:172.21.15.121:6816/24418,v1:172.21.15.121:6817/24418] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95bc069210 con 0x7f95bc066750 2024-08-17T02:29:20.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.397+0000 7f95cdffb700 1 -- 172.21.15.102:0/2803052475 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95c8080760 con 0x7f95d014a8d0 2024-08-17T02:29:20.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.397+0000 7f95d52d4700 1 --2- 172.21.15.102:0/2803052475 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f95bc060860 0x7f95bc062d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f95c4006d60 tx=0x7f95c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.397+0000 7f95d62d6700 1 --2- 172.21.15.102:0/2803052475 >> [v2:172.21.15.121:6816/24418,v1:172.21.15.121:6817/24418] conn(0x7f95bc066750 0x7f95bc068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.401+0000 7f95d62d6700 1 --2- 172.21.15.102:0/2803052475 >> [v2:172.21.15.121:6816/24418,v1:172.21.15.121:6817/24418] conn(0x7f95bc066750 0x7f95bc068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.401+0000 7f95cdffb700 1 -- 172.21.15.102:0/2803052475 <== osd.6 v2:172.21.15.121:6816/24418 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f95bc069210 con 0x7f95bc066750 2024-08-17T02:29:20.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.421+0000 7f95d6ad7700 1 -- 172.21.15.102:0/2803052475 --> [v2:172.21.15.121:6816/24418,v1:172.21.15.121:6817/24418] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f95d0069330 con 0x7f95bc066750 2024-08-17T02:29:20.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.421+0000 7f95cdffb700 1 -- 172.21.15.102:0/2803052475 <== osd.6 v2:172.21.15.121:6816/24418 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f95d0069330 con 0x7f95bc066750 2024-08-17T02:29:20.424 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-08-17T02:29:20.424 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:20.424 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-08-17T02:29:20.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.421+0000 7f95d6ad7700 1 -- 172.21.15.102:0/2803052475 >> [v2:172.21.15.121:6816/24418,v1:172.21.15.121:6817/24418] conn(0x7f95bc066750 msgr2=0x7f95bc068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.421+0000 7f95d6ad7700 1 --2- 172.21.15.102:0/2803052475 >> [v2:172.21.15.121:6816/24418,v1:172.21.15.121:6817/24418] conn(0x7f95bc066750 0x7f95bc068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.421+0000 7f95d6ad7700 1 -- 172.21.15.102:0/2803052475 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f95bc060860 msgr2=0x7f95bc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.421+0000 7f95d6ad7700 1 --2- 172.21.15.102:0/2803052475 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f95bc060860 0x7f95bc062d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f95c4006d60 tx=0x7f95c4008040 comp rx=0 tx=0).stop 2024-08-17T02:29:20.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.421+0000 7f95d6ad7700 1 -- 172.21.15.102:0/2803052475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95d014a8d0 msgr2=0x7f95d00acc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.421+0000 7f95d6ad7700 1 --2- 172.21.15.102:0/2803052475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95d014a8d0 0x7f95d00acc50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f95c800e4b0 tx=0x7f95c801a000 comp rx=0 tx=0).stop 2024-08-17T02:29:20.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.421+0000 7f95d62d6700 1 -- 172.21.15.102:0/2803052475 reap_dead start 2024-08-17T02:29:20.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.421+0000 7f95d6ad7700 1 -- 172.21.15.102:0/2803052475 shutdown_connections 2024-08-17T02:29:20.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.421+0000 7f95d6ad7700 1 -- 172.21.15.102:0/2803052475 >> 172.21.15.102:0/2803052475 conn(0x7f95d0067590 msgr2=0x7f95d00cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.421+0000 7f95d6ad7700 1 -- 172.21.15.102:0/2803052475 shutdown_connections 2024-08-17T02:29:20.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.421+0000 7f95d6ad7700 1 -- 172.21.15.102:0/2803052475 wait complete. 2024-08-17T02:29:20.442 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:29:20.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995b053700 1 Processor -- start 2024-08-17T02:29:20.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995b053700 1 -- start start 2024-08-17T02:29:20.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995b053700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f99540af820 0x7f99540afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995b053700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f995415dae0 0x7f99540ae950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995b053700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99540aee90 con 0x7f99540ad270 2024-08-17T02:29:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995b053700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995415df80 con 0x7f995415dae0 2024-08-17T02:29:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995b053700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9954161210 con 0x7f99540af820 2024-08-17T02:29:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f9959850700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f995415dae0 0x7f99540ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f9959850700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f995415dae0 0x7f99540ae950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34122/0 (socket says 172.21.15.102:34122) 2024-08-17T02:29:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f9959850700 1 -- 172.21.15.102:0/3820743709 learned_addr learned my addr 172.21.15.102:0/3820743709 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995a051700 1 --2- 172.21.15.102:0/3820743709 >> v2:172.21.15.121:3300/0 conn(0x7f99540af820 0x7f99540afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f9959850700 1 -- 172.21.15.102:0/3820743709 >> v2:172.21.15.121:3300/0 conn(0x7f99540af820 msgr2=0x7f99540afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f9959850700 1 --2- 172.21.15.102:0/3820743709 >> v2:172.21.15.121:3300/0 conn(0x7f99540af820 0x7f99540afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f9959850700 1 -- 172.21.15.102:0/3820743709 >> v1:172.21.15.102:6789/0 conn(0x7f99540ad270 legacy=0x7f99540686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f9959850700 1 -- 172.21.15.102:0/3820743709 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995415e180 con 0x7f995415dae0 2024-08-17T02:29:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995a051700 1 --2- 172.21.15.102:0/3820743709 >> v2:172.21.15.121:3300/0 conn(0x7f99540af820 0x7f99540afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f9959850700 1 --2- 172.21.15.102:0/3820743709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f995415dae0 0x7f99540ae950 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f995406cf30 tx=0x7f9950009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc308dbabe927748 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995904f700 1 -- 172.21.15.102:0/3820743709 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995000b860 con 0x7f995415dae0 2024-08-17T02:29:20.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995904f700 1 -- 172.21.15.102:0/3820743709 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995000b9c0 con 0x7f995415dae0 2024-08-17T02:29:20.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995904f700 1 -- 172.21.15.102:0/3820743709 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995000bd60 con 0x7f995415dae0 2024-08-17T02:29:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995b053700 1 -- 172.21.15.102:0/3820743709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f995415dae0 msgr2=0x7f99540ae950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995b053700 1 --2- 172.21.15.102:0/3820743709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f995415dae0 0x7f99540ae950 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f995406cf30 tx=0x7f9950009250 comp rx=0 tx=0).stop 2024-08-17T02:29:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995b053700 1 -- 172.21.15.102:0/3820743709 shutdown_connections 2024-08-17T02:29:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995b053700 1 --2- 172.21.15.102:0/3820743709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f995415dae0 0x7f99540ae950 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995b053700 1 --2- 172.21.15.102:0/3820743709 >> v2:172.21.15.121:3300/0 conn(0x7f99540af820 0x7f99540afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.549+0000 7f995b053700 1 -- 172.21.15.102:0/3820743709 >> 172.21.15.102:0/3820743709 conn(0x7f995406d800 msgr2=0x7f995406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.553+0000 7f995b053700 1 -- 172.21.15.102:0/3820743709 shutdown_connections 2024-08-17T02:29:20.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.553+0000 7f995b053700 1 -- 172.21.15.102:0/3820743709 wait complete. 2024-08-17T02:29:20.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.553+0000 7f995b053700 1 Processor -- start 2024-08-17T02:29:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.553+0000 7f995b053700 1 -- start start 2024-08-17T02:29:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f995b053700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99540ad270 0x7f99540c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f995b053700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99540af820 0x7f99540c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f995b053700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f995415dae0 0x7f99540c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f995b053700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99541576c0 con 0x7f99540af820 2024-08-17T02:29:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f995b053700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99540ca160 con 0x7f99540ad270 2024-08-17T02:29:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f995b053700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99540c9550 con 0x7f995415dae0 2024-08-17T02:29:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f9959850700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99540af820 0x7f99540c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f9959850700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99540af820 0x7f99540c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34136/0 (socket says 172.21.15.102:34136) 2024-08-17T02:29:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f9959850700 1 -- 172.21.15.102:0/948580243 learned_addr learned my addr 172.21.15.102:0/948580243 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f995a051700 1 --2- 172.21.15.102:0/948580243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99540ad270 0x7f99540c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f995a852700 1 --2- 172.21.15.102:0/948580243 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f995415dae0 0x7f99540c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f9959850700 1 -- 172.21.15.102:0/948580243 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f995415dae0 msgr2=0x7f99540c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f9959850700 1 --2- 172.21.15.102:0/948580243 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f995415dae0 0x7f99540c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f9959850700 1 -- 172.21.15.102:0/948580243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99540ad270 msgr2=0x7f99540c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f9959850700 1 --2- 172.21.15.102:0/948580243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99540ad270 0x7f99540c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f9959850700 1 -- 172.21.15.102:0/948580243 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99500094f0 con 0x7f99540af820 2024-08-17T02:29:20.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f9959850700 1 --2- 172.21.15.102:0/948580243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99540af820 0x7f99540c8990 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9950009290 tx=0x7f9950017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f994a7fc700 1 -- 172.21.15.102:0/948580243 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950011e40 con 0x7f99540af820 2024-08-17T02:29:20.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f994a7fc700 1 -- 172.21.15.102:0/948580243 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995001a450 con 0x7f99540af820 2024-08-17T02:29:20.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f995b053700 1 -- 172.21.15.102:0/948580243 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99540c9830 con 0x7f99540af820 2024-08-17T02:29:20.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f994a7fc700 1 -- 172.21.15.102:0/948580243 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995001a7f0 con 0x7f99540af820 2024-08-17T02:29:20.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f995b053700 1 -- 172.21.15.102:0/948580243 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99540c9df0 con 0x7f99540af820 2024-08-17T02:29:20.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.557+0000 7f995b053700 1 -- 172.21.15.102:0/948580243 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99540ca2d0 con 0x7f99540af820 2024-08-17T02:29:20.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.561+0000 7f994a7fc700 1 -- 172.21.15.102:0/948580243 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f995001abe0 con 0x7f99540af820 2024-08-17T02:29:20.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.561+0000 7f994a7fc700 1 --2- 172.21.15.102:0/948580243 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9938060890 0x7f9938062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.561+0000 7f994a7fc700 1 -- 172.21.15.102:0/948580243 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f995007e4e0 con 0x7f99540af820 2024-08-17T02:29:20.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.561+0000 7f995a051700 1 --2- 172.21.15.102:0/948580243 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9938060890 0x7f9938062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.561+0000 7f995a051700 1 --2- 172.21.15.102:0/948580243 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9938060890 0x7f9938062d40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f994400adc0 tx=0x7f9944006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.565+0000 7f994a7fc700 1 -- 172.21.15.102:0/948580243 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f995004ebb0 con 0x7f99540af820 2024-08-17T02:29:20.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.729+0000 7f995b053700 1 -- 172.21.15.102:0/948580243 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f99540638f0 con 0x7f9938060890 2024-08-17T02:29:20.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.729+0000 7f994a7fc700 1 -- 172.21.15.102:0/948580243 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f99540638f0 con 0x7f9938060890 2024-08-17T02:29:20.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.733+0000 7f995b053700 1 -- 172.21.15.102:0/948580243 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9938060890 msgr2=0x7f9938062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.733+0000 7f995b053700 1 --2- 172.21.15.102:0/948580243 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9938060890 0x7f9938062d40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f994400adc0 tx=0x7f9944006f90 comp rx=0 tx=0).stop 2024-08-17T02:29:20.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.733+0000 7f995b053700 1 -- 172.21.15.102:0/948580243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99540af820 msgr2=0x7f99540c8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.733+0000 7f995b053700 1 --2- 172.21.15.102:0/948580243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99540af820 0x7f99540c8990 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9950009290 tx=0x7f9950017000 comp rx=0 tx=0).stop 2024-08-17T02:29:20.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.733+0000 7f995b053700 1 -- 172.21.15.102:0/948580243 shutdown_connections 2024-08-17T02:29:20.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.733+0000 7f995b053700 1 --2- 172.21.15.102:0/948580243 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f9938060890 0x7f9938062d40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.733+0000 7f995b053700 1 --2- 172.21.15.102:0/948580243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99540af820 0x7f99540c8990 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.733+0000 7f995b053700 1 --2- 172.21.15.102:0/948580243 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f995415dae0 0x7f99540c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.733+0000 7f995b053700 1 --2- 172.21.15.102:0/948580243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99540ad270 0x7f99540c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.733+0000 7f995b053700 1 -- 172.21.15.102:0/948580243 >> 172.21.15.102:0/948580243 conn(0x7f995406d800 msgr2=0x7f99540ad680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.733+0000 7f995b053700 1 -- 172.21.15.102:0/948580243 shutdown_connections 2024-08-17T02:29:20.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.733+0000 7f995b053700 1 -- 172.21.15.102:0/948580243 wait complete. 2024-08-17T02:29:20.737 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:29:20.747 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:29:20.747 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:20.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.857+0000 7f40d2436700 1 Processor -- start 2024-08-17T02:29:20.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.857+0000 7f40d2436700 1 -- start start 2024-08-17T02:29:20.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.857+0000 7f40d2436700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc0cd2b0 0x7f40cc0cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d2436700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f40cc0caeb0 0x7f40cc0ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d2436700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f40cc0cb300 0x7f40cc0ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d2436700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc0cc480 con 0x7f40cc0cb300 2024-08-17T02:29:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d2436700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc159720 con 0x7f40cc0caeb0 2024-08-17T02:29:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d2436700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0cb870 con 0x7f40cc0cd2b0 2024-08-17T02:29:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d09d3700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f40cc0cb300 0x7f40cc0ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d09d3700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f40cc0cb300 0x7f40cc0ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34142/0 (socket says 172.21.15.102:34142) 2024-08-17T02:29:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d09d3700 1 -- 172.21.15.102:0/3534350315 learned_addr learned my addr 172.21.15.102:0/3534350315 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40cbfff700 1 --2- 172.21.15.102:0/3534350315 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc0cd2b0 0x7f40cc0cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40cb7fe700 1 --2- 172.21.15.102:0/3534350315 >> v2:172.21.15.121:3300/0 conn(0x7f40cc0caeb0 0x7f40cc0ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d09d3700 1 -- 172.21.15.102:0/3534350315 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc0cd2b0 msgr2=0x7f40cc0cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d09d3700 1 --2- 172.21.15.102:0/3534350315 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc0cd2b0 0x7f40cc0cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d09d3700 1 -- 172.21.15.102:0/3534350315 >> v2:172.21.15.121:3300/0 conn(0x7f40cc0caeb0 msgr2=0x7f40cc0ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d09d3700 1 --2- 172.21.15.102:0/3534350315 >> v2:172.21.15.121:3300/0 conn(0x7f40cc0caeb0 0x7f40cc0ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d09d3700 1 -- 172.21.15.102:0/3534350315 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc0cbb50 con 0x7f40cc0cb300 2024-08-17T02:29:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40cbfff700 1 --2- 172.21.15.102:0/3534350315 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc0cd2b0 0x7f40cc0cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d09d3700 1 --2- 172.21.15.102:0/3534350315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40cc0cb300 0x7f40cc0ce9a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0d1320 tx=0x7f40bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e790936eeb402ac0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40caffd700 1 -- 172.21.15.102:0/3534350315 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc00e070 con 0x7f40cc0cb300 2024-08-17T02:29:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40caffd700 1 -- 172.21.15.102:0/3534350315 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc00ba50 con 0x7f40cc0cb300 2024-08-17T02:29:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40caffd700 1 -- 172.21.15.102:0/3534350315 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc0092e0 con 0x7f40cc0cb300 2024-08-17T02:29:20.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d2436700 1 -- 172.21.15.102:0/3534350315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40cc0cb300 msgr2=0x7f40cc0ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d2436700 1 --2- 172.21.15.102:0/3534350315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40cc0cb300 0x7f40cc0ce9a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0d1320 tx=0x7f40bc009840 comp rx=0 tx=0).stop 2024-08-17T02:29:20.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d2436700 1 -- 172.21.15.102:0/3534350315 shutdown_connections 2024-08-17T02:29:20.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d2436700 1 --2- 172.21.15.102:0/3534350315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40cc0cb300 0x7f40cc0ce9a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d2436700 1 --2- 172.21.15.102:0/3534350315 >> v2:172.21.15.121:3300/0 conn(0x7f40cc0caeb0 0x7f40cc0ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d2436700 1 --2- 172.21.15.102:0/3534350315 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc0cd2b0 0x7f40cc0cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d2436700 1 -- 172.21.15.102:0/3534350315 >> 172.21.15.102:0/3534350315 conn(0x7f40cc099550 msgr2=0x7f40cc067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d2436700 1 -- 172.21.15.102:0/3534350315 shutdown_connections 2024-08-17T02:29:20.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.861+0000 7f40d2436700 1 -- 172.21.15.102:0/3534350315 wait complete. 2024-08-17T02:29:20.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40d2436700 1 Processor -- start 2024-08-17T02:29:20.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40d2436700 1 -- start start 2024-08-17T02:29:20.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40d2436700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40cc0caeb0 0x7f40cc1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40d2436700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40cc0cb300 0x7f40cc0b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40d2436700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc0cd2b0 0x7f40cc0b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40d2436700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0c7d60 con 0x7f40cc0caeb0 2024-08-17T02:29:20.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40d2436700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0b5d60 con 0x7f40cc0cb300 2024-08-17T02:29:20.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40d2436700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc069460 con 0x7f40cc0cd2b0 2024-08-17T02:29:20.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40cbfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40cc0caeb0 0x7f40cc1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40cbfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40cc0caeb0 0x7f40cc1569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34146/0 (socket says 172.21.15.102:34146) 2024-08-17T02:29:20.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40cbfff700 1 -- 172.21.15.102:0/4160143272 learned_addr learned my addr 172.21.15.102:0/4160143272 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:20.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40d09d3700 1 --2- 172.21.15.102:0/4160143272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc0cd2b0 0x7f40cc0b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40cb7fe700 1 --2- 172.21.15.102:0/4160143272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40cc0cb300 0x7f40cc0b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40cbfff700 1 -- 172.21.15.102:0/4160143272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc0cd2b0 msgr2=0x7f40cc0b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40cbfff700 1 --2- 172.21.15.102:0/4160143272 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f40cc0cd2b0 0x7f40cc0b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40cbfff700 1 -- 172.21.15.102:0/4160143272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40cc0cb300 msgr2=0x7f40cc0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40cbfff700 1 --2- 172.21.15.102:0/4160143272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40cc0cb300 0x7f40cc0b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40cbfff700 1 -- 172.21.15.102:0/4160143272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc009ae0 con 0x7f40cc0caeb0 2024-08-17T02:29:20.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40cbfff700 1 --2- 172.21.15.102:0/4160143272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40cc0caeb0 0x7f40cc1569c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f40c400e8d0 tx=0x7f40c4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40c3fff700 1 -- 172.21.15.102:0/4160143272 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c40093b0 con 0x7f40cc0caeb0 2024-08-17T02:29:20.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40c3fff700 1 -- 172.21.15.102:0/4160143272 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c4013410 con 0x7f40cc0caeb0 2024-08-17T02:29:20.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40c3fff700 1 -- 172.21.15.102:0/4160143272 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c40137b0 con 0x7f40cc0caeb0 2024-08-17T02:29:20.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40d2436700 1 -- 172.21.15.102:0/4160143272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc069740 con 0x7f40cc0caeb0 2024-08-17T02:29:20.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.865+0000 7f40d2436700 1 -- 172.21.15.102:0/4160143272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc069d00 con 0x7f40cc0caeb0 2024-08-17T02:29:20.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.869+0000 7f40d2436700 1 -- 172.21.15.102:0/4160143272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f40cc0638f0 con 0x7f40cc0caeb0 2024-08-17T02:29:20.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.869+0000 7f40c3fff700 1 -- 172.21.15.102:0/4160143272 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f40c4013be0 con 0x7f40cc0caeb0 2024-08-17T02:29:20.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.869+0000 7f40c3fff700 1 --2- 172.21.15.102:0/4160143272 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f40ac060860 0x7f40ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.869+0000 7f40c3fff700 1 -- 172.21.15.102:0/4160143272 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f40c407c8e0 con 0x7f40cc0caeb0 2024-08-17T02:29:20.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.869+0000 7f40cb7fe700 1 --2- 172.21.15.102:0/4160143272 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f40ac060860 0x7f40ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.869+0000 7f40c3fff700 1 --2- 172.21.15.102:0/4160143272 >> [v2:172.21.15.121:6800/24415,v1:172.21.15.121:6801/24415] conn(0x7f40ac066750 0x7f40ac068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.869+0000 7f40c3fff700 1 -- 172.21.15.102:0/4160143272 --> [v2:172.21.15.121:6800/24415,v1:172.21.15.121:6801/24415] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40ac069210 con 0x7f40ac066750 2024-08-17T02:29:20.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.869+0000 7f40c3fff700 1 -- 172.21.15.102:0/4160143272 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40c4081240 con 0x7f40cc0caeb0 2024-08-17T02:29:20.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.869+0000 7f40d09d3700 1 --2- 172.21.15.102:0/4160143272 >> [v2:172.21.15.121:6800/24415,v1:172.21.15.121:6801/24415] conn(0x7f40ac066750 0x7f40ac068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.869+0000 7f40cb7fe700 1 --2- 172.21.15.102:0/4160143272 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f40ac060860 0x7f40ac062d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f40cc16c670 tx=0x7f40b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.873+0000 7f40d09d3700 1 --2- 172.21.15.102:0/4160143272 >> [v2:172.21.15.121:6800/24415,v1:172.21.15.121:6801/24415] conn(0x7f40ac066750 0x7f40ac068b60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.873+0000 7f40c3fff700 1 -- 172.21.15.102:0/4160143272 <== osd.7 v2:172.21.15.121:6800/24415 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f40ac069210 con 0x7f40ac066750 2024-08-17T02:29:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.889+0000 7f40d2436700 1 -- 172.21.15.102:0/4160143272 --> [v2:172.21.15.121:6800/24415,v1:172.21.15.121:6801/24415] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f40cc068020 con 0x7f40ac066750 2024-08-17T02:29:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.893+0000 7f40c3fff700 1 -- 172.21.15.102:0/4160143272 <== osd.7 v2:172.21.15.121:6800/24415 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f40cc068020 con 0x7f40ac066750 2024-08-17T02:29:20.894 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-08-17T02:29:20.895 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:20.895 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-08-17T02:29:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.893+0000 7f40d2436700 1 -- 172.21.15.102:0/4160143272 >> [v2:172.21.15.121:6800/24415,v1:172.21.15.121:6801/24415] conn(0x7f40ac066750 msgr2=0x7f40ac068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.893+0000 7f40d2436700 1 --2- 172.21.15.102:0/4160143272 >> [v2:172.21.15.121:6800/24415,v1:172.21.15.121:6801/24415] conn(0x7f40ac066750 0x7f40ac068b60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.893+0000 7f40d2436700 1 -- 172.21.15.102:0/4160143272 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f40ac060860 msgr2=0x7f40ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.893+0000 7f40d2436700 1 --2- 172.21.15.102:0/4160143272 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f40ac060860 0x7f40ac062d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f40cc16c670 tx=0x7f40b4008040 comp rx=0 tx=0).stop 2024-08-17T02:29:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.893+0000 7f40d2436700 1 -- 172.21.15.102:0/4160143272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40cc0caeb0 msgr2=0x7f40cc1569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.893+0000 7f40d2436700 1 --2- 172.21.15.102:0/4160143272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40cc0caeb0 0x7f40cc1569c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f40c400e8d0 tx=0x7f40c4008040 comp rx=0 tx=0).stop 2024-08-17T02:29:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.893+0000 7f40d09d3700 1 -- 172.21.15.102:0/4160143272 reap_dead start 2024-08-17T02:29:20.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.893+0000 7f40d2436700 1 -- 172.21.15.102:0/4160143272 shutdown_connections 2024-08-17T02:29:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.893+0000 7f40d2436700 1 -- 172.21.15.102:0/4160143272 >> 172.21.15.102:0/4160143272 conn(0x7f40cc099550 msgr2=0x7f40cc158820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.893+0000 7f40d2436700 1 -- 172.21.15.102:0/4160143272 shutdown_connections 2024-08-17T02:29:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:20.893+0000 7f40d2436700 1 -- 172.21.15.102:0/4160143272 wait complete. 2024-08-17T02:29:20.907 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:29:21.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f301df7d700 1 Processor -- start 2024-08-17T02:29:21.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f301df7d700 1 -- start start 2024-08-17T02:29:21.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f301df7d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30180cd1b0 0x7f30181536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f301df7d700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f301815a190 0x7f301815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f301df7d700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301815a5f0 con 0x7f3018153320 2024-08-17T02:29:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f301df7d700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30180ce430 con 0x7f301815a190 2024-08-17T02:29:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f301df7d700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301815dbd0 con 0x7f30180cd1b0 2024-08-17T02:29:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f301cf7b700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f3018153320 0x7f30180ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56000/0 (socket says 172.21.15.102:56000) 2024-08-17T02:29:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f301cf7b700 1 -- 172.21.15.102:0/2870341931 learned_addr learned my addr 172.21.15.102:0/2870341931 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f3017fff700 1 --2- 172.21.15.102:0/2870341931 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30180cd1b0 0x7f30181536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f301d77c700 1 --2- 172.21.15.102:0/2870341931 >> v2:172.21.15.121:3300/0 conn(0x7f301815a190 0x7f301815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f30177fe700 1 -- 172.21.15.102:0/2870341931 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005729285 0 0) 0x7f301815a5f0 con 0x7f3018153320 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f30177fe700 1 -- 172.21.15.102:0/2870341931 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3004003570 con 0x7f3018153320 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f301d77c700 1 -- 172.21.15.102:0/2870341931 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30180cd1b0 msgr2=0x7f30181536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f301d77c700 1 --2- 172.21.15.102:0/2870341931 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30180cd1b0 0x7f30181536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f301d77c700 1 -- 172.21.15.102:0/2870341931 >> v1:172.21.15.102:6789/0 conn(0x7f3018153320 legacy=0x7f30180ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f301d77c700 1 -- 172.21.15.102:0/2870341931 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301815d370 con 0x7f301815a190 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f301d77c700 1 --2- 172.21.15.102:0/2870341931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f301815a190 0x7f301815cc60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f30080098e0 tx=0x7f30080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2cbafb489cd7ffa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f30177fe700 1 -- 172.21.15.102:0/2870341931 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3008011630 con 0x7f301815a190 2024-08-17T02:29:21.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f30177fe700 1 -- 172.21.15.102:0/2870341931 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3008011790 con 0x7f301815a190 2024-08-17T02:29:21.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.017+0000 7f30177fe700 1 -- 172.21.15.102:0/2870341931 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3008011b10 con 0x7f301815a190 2024-08-17T02:29:21.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301df7d700 1 -- 172.21.15.102:0/2870341931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f301815a190 msgr2=0x7f301815cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301df7d700 1 --2- 172.21.15.102:0/2870341931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f301815a190 0x7f301815cc60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f30080098e0 tx=0x7f30080091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301df7d700 1 -- 172.21.15.102:0/2870341931 shutdown_connections 2024-08-17T02:29:21.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301df7d700 1 --2- 172.21.15.102:0/2870341931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f301815a190 0x7f301815cc60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301df7d700 1 --2- 172.21.15.102:0/2870341931 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f30180cd1b0 0x7f30181536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301df7d700 1 -- 172.21.15.102:0/2870341931 >> 172.21.15.102:0/2870341931 conn(0x7f30180d00a0 msgr2=0x7f30180d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:21.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301df7d700 1 -- 172.21.15.102:0/2870341931 shutdown_connections 2024-08-17T02:29:21.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301df7d700 1 -- 172.21.15.102:0/2870341931 wait complete. 2024-08-17T02:29:21.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301df7d700 1 Processor -- start 2024-08-17T02:29:21.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301df7d700 1 -- start start 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301df7d700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30180cd1b0 0x7f30180b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301df7d700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3018153320 0x7f3018158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301df7d700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f301815a190 0x7f3018160810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301df7d700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3018152e60 con 0x7f301815a190 2024-08-17T02:29:21.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301df7d700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3018157fa0 con 0x7f30180cd1b0 2024-08-17T02:29:21.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301df7d700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3018158940 con 0x7f3018153320 2024-08-17T02:29:21.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301d77c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f301815a190 0x7f3018160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301d77c700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f301815a190 0x7f3018160810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34152/0 (socket says 172.21.15.102:34152) 2024-08-17T02:29:21.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301d77c700 1 -- 172.21.15.102:0/631213263 learned_addr learned my addr 172.21.15.102:0/631213263 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:21.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f3017fff700 1 --2- 172.21.15.102:0/631213263 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3018153320 0x7f3018158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.021+0000 7f301cf7b700 1 --2- 172.21.15.102:0/631213263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30180cd1b0 0x7f30180b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.025+0000 7f301d77c700 1 -- 172.21.15.102:0/631213263 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3018153320 msgr2=0x7f3018158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.025+0000 7f301d77c700 1 --2- 172.21.15.102:0/631213263 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3018153320 0x7f3018158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.025+0000 7f301d77c700 1 -- 172.21.15.102:0/631213263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30180cd1b0 msgr2=0x7f30180b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.025+0000 7f301d77c700 1 --2- 172.21.15.102:0/631213263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30180cd1b0 0x7f30180b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.025+0000 7f301d77c700 1 -- 172.21.15.102:0/631213263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3008009420 con 0x7f301815a190 2024-08-17T02:29:21.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.025+0000 7f301d77c700 1 --2- 172.21.15.102:0/631213263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f301815a190 0x7f3018160810 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3008009ed0 tx=0x7f3008017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.025+0000 7f3014ff9700 1 -- 172.21.15.102:0/631213263 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3008011b10 con 0x7f301815a190 2024-08-17T02:29:21.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.025+0000 7f3014ff9700 1 -- 172.21.15.102:0/631213263 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3008027450 con 0x7f301815a190 2024-08-17T02:29:21.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.025+0000 7f301df7d700 1 -- 172.21.15.102:0/631213263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30180b44b0 con 0x7f301815a190 2024-08-17T02:29:21.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.025+0000 7f3014ff9700 1 -- 172.21.15.102:0/631213263 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3008027810 con 0x7f301815a190 2024-08-17T02:29:21.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.025+0000 7f301df7d700 1 -- 172.21.15.102:0/631213263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30181582f0 con 0x7f301815a190 2024-08-17T02:29:21.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.025+0000 7f301df7d700 1 -- 172.21.15.102:0/631213263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30180638f0 con 0x7f301815a190 2024-08-17T02:29:21.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.029+0000 7f3014ff9700 1 -- 172.21.15.102:0/631213263 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f300801a430 con 0x7f301815a190 2024-08-17T02:29:21.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.029+0000 7f3014ff9700 1 --2- 172.21.15.102:0/631213263 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2ff8060860 0x7f2ff8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.029+0000 7f3014ff9700 1 -- 172.21.15.102:0/631213263 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f300807e7b0 con 0x7f301815a190 2024-08-17T02:29:21.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.029+0000 7f301cf7b700 1 --2- 172.21.15.102:0/631213263 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2ff8060860 0x7f2ff8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.029+0000 7f301cf7b700 1 --2- 172.21.15.102:0/631213263 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2ff8060860 0x7f2ff8062d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3000007fd0 tx=0x7f3000009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.037+0000 7f3014ff9700 1 -- 172.21.15.102:0/631213263 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f300804eea0 con 0x7f301815a190 2024-08-17T02:29:21.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.197+0000 7f301df7d700 1 -- 172.21.15.102:0/631213263 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f3018158a80 con 0x7f2ff8060860 2024-08-17T02:29:21.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.197+0000 7f3014ff9700 1 -- 172.21.15.102:0/631213263 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3018158a80 con 0x7f2ff8060860 2024-08-17T02:29:21.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.201+0000 7f301df7d700 1 -- 172.21.15.102:0/631213263 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2ff8060860 msgr2=0x7f2ff8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.201+0000 7f301df7d700 1 --2- 172.21.15.102:0/631213263 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2ff8060860 0x7f2ff8062d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3000007fd0 tx=0x7f3000009040 comp rx=0 tx=0).stop 2024-08-17T02:29:21.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.201+0000 7f301df7d700 1 -- 172.21.15.102:0/631213263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f301815a190 msgr2=0x7f3018160810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.201+0000 7f301df7d700 1 --2- 172.21.15.102:0/631213263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f301815a190 0x7f3018160810 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3008009ed0 tx=0x7f3008017000 comp rx=0 tx=0).stop 2024-08-17T02:29:21.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.201+0000 7f301df7d700 1 -- 172.21.15.102:0/631213263 shutdown_connections 2024-08-17T02:29:21.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.201+0000 7f301df7d700 1 --2- 172.21.15.102:0/631213263 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f2ff8060860 0x7f2ff8062d10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.201+0000 7f301df7d700 1 --2- 172.21.15.102:0/631213263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f301815a190 0x7f3018160810 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.201+0000 7f301df7d700 1 --2- 172.21.15.102:0/631213263 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f3018153320 0x7f3018158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.201+0000 7f301df7d700 1 --2- 172.21.15.102:0/631213263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30180cd1b0 0x7f30180b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.201+0000 7f301df7d700 1 -- 172.21.15.102:0/631213263 >> 172.21.15.102:0/631213263 conn(0x7f30180d00a0 msgr2=0x7f30180cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:21.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.201+0000 7f301df7d700 1 -- 172.21.15.102:0/631213263 shutdown_connections 2024-08-17T02:29:21.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.201+0000 7f301df7d700 1 -- 172.21.15.102:0/631213263 wait complete. 2024-08-17T02:29:21.205 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:29:21.217 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:21.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85fbfff700 1 Processor -- start 2024-08-17T02:29:21.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85fbfff700 1 -- start start 2024-08-17T02:29:21.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85fbfff700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f85fc06e9d0 0x7f85fc06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85fbfff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f85fc155720 0x7f85fc0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85fbfff700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85fc0aba70 con 0x7f85fc0ab540 2024-08-17T02:29:21.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85fbfff700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85fc0abd50 con 0x7f85fc155720 2024-08-17T02:29:21.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85fbfff700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85fc0ac030 con 0x7f85fc06e9d0 2024-08-17T02:29:21.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85fb7fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f85fc155720 0x7f85fc0b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85fa7fc700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f85fc0ab540 0x7f85fc155010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56010/0 (socket says 172.21.15.102:56010) 2024-08-17T02:29:21.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85fa7fc700 1 -- 172.21.15.102:0/1274376964 learned_addr learned my addr 172.21.15.102:0/1274376964 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:21.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85faffd700 1 --2- 172.21.15.102:0/1274376964 >> v2:172.21.15.121:3300/0 conn(0x7f85fc06e9d0 0x7f85fc06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85f9ffb700 1 -- 172.21.15.102:0/1274376964 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190262530 0 0) 0x7f85fc0aba70 con 0x7f85fc0ab540 2024-08-17T02:29:21.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85fb7fe700 1 -- 172.21.15.102:0/1274376964 >> v2:172.21.15.121:3300/0 conn(0x7f85fc06e9d0 msgr2=0x7f85fc06eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:21.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85fb7fe700 1 --2- 172.21.15.102:0/1274376964 >> v2:172.21.15.121:3300/0 conn(0x7f85fc06e9d0 0x7f85fc06eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85fb7fe700 1 -- 172.21.15.102:0/1274376964 >> v1:172.21.15.102:6789/0 conn(0x7f85fc0ab540 legacy=0x7f85fc155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85fb7fe700 1 -- 172.21.15.102:0/1274376964 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc0ac310 con 0x7f85fc155720 2024-08-17T02:29:21.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85fb7fe700 1 --2- 172.21.15.102:0/1274376964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85fc155720 0x7f85fc0b1320 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f85fc06c910 tx=0x7f85f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e8dfe47de352d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.317+0000 7f85f9ffb700 1 -- 172.21.15.102:0/1274376964 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f400e070 con 0x7f85fc155720 2024-08-17T02:29:21.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.321+0000 7f85f9ffb700 1 -- 172.21.15.102:0/1274376964 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f400bc30 con 0x7f85fc155720 2024-08-17T02:29:21.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.321+0000 7f85f9ffb700 1 -- 172.21.15.102:0/1274376964 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4012430 con 0x7f85fc155720 2024-08-17T02:29:21.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.321+0000 7f85fbfff700 1 -- 172.21.15.102:0/1274376964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85fc155720 msgr2=0x7f85fc0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.321+0000 7f85fbfff700 1 --2- 172.21.15.102:0/1274376964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85fc155720 0x7f85fc0b1320 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f85fc06c910 tx=0x7f85f4009780 comp rx=0 tx=0).stop 2024-08-17T02:29:21.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.321+0000 7f85fbfff700 1 -- 172.21.15.102:0/1274376964 shutdown_connections 2024-08-17T02:29:21.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.321+0000 7f85fbfff700 1 --2- 172.21.15.102:0/1274376964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85fc155720 0x7f85fc0b1320 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.321+0000 7f85fbfff700 1 --2- 172.21.15.102:0/1274376964 >> v2:172.21.15.121:3300/0 conn(0x7f85fc06e9d0 0x7f85fc06eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.321+0000 7f85fbfff700 1 -- 172.21.15.102:0/1274376964 >> 172.21.15.102:0/1274376964 conn(0x7f85fc0678d0 msgr2=0x7f85fc067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:21.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.321+0000 7f85fbfff700 1 -- 172.21.15.102:0/1274376964 shutdown_connections 2024-08-17T02:29:21.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.321+0000 7f85fbfff700 1 -- 172.21.15.102:0/1274376964 wait complete. 2024-08-17T02:29:21.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.321+0000 7f85fbfff700 1 Processor -- start 2024-08-17T02:29:21.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.321+0000 7f85fbfff700 1 -- start start 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fbfff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85fc06e9d0 0x7f85fc0acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fbfff700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85fc0ab540 0x7f85fc140f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fbfff700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f85fc155720 0x7f85fc13f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fbfff700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc1438b0 con 0x7f85fc0ab540 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fbfff700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc1432a0 con 0x7f85fc06e9d0 2024-08-17T02:29:21.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fbfff700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc141980 con 0x7f85fc155720 2024-08-17T02:29:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fa7fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85fc0ab540 0x7f85fc140f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fa7fc700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85fc0ab540 0x7f85fc140f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34182/0 (socket says 172.21.15.102:34182) 2024-08-17T02:29:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fa7fc700 1 -- 172.21.15.102:0/412125745 learned_addr learned my addr 172.21.15.102:0/412125745 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85faffd700 1 --2- 172.21.15.102:0/412125745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85fc06e9d0 0x7f85fc0acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fb7fe700 1 --2- 172.21.15.102:0/412125745 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f85fc155720 0x7f85fc13f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fa7fc700 1 -- 172.21.15.102:0/412125745 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f85fc155720 msgr2=0x7f85fc13f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fa7fc700 1 --2- 172.21.15.102:0/412125745 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f85fc155720 0x7f85fc13f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fa7fc700 1 -- 172.21.15.102:0/412125745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85fc06e9d0 msgr2=0x7f85fc0acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fa7fc700 1 --2- 172.21.15.102:0/412125745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85fc06e9d0 0x7f85fc0acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fa7fc700 1 -- 172.21.15.102:0/412125745 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f4009a20 con 0x7f85fc0ab540 2024-08-17T02:29:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fb7fe700 1 --2- 172.21.15.102:0/412125745 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f85fc155720 0x7f85fc13f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fa7fc700 1 --2- 172.21.15.102:0/412125745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85fc0ab540 0x7f85fc140f30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f85e400c810 tx=0x7f85e4007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85f2ffd700 1 -- 172.21.15.102:0/412125745 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4005c00 con 0x7f85fc0ab540 2024-08-17T02:29:21.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85f2ffd700 1 -- 172.21.15.102:0/412125745 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e4005d60 con 0x7f85fc0ab540 2024-08-17T02:29:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fbfff700 1 -- 172.21.15.102:0/412125745 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85fc143540 con 0x7f85fc0ab540 2024-08-17T02:29:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85f2ffd700 1 -- 172.21.15.102:0/412125745 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e40072e0 con 0x7f85fc0ab540 2024-08-17T02:29:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fbfff700 1 -- 172.21.15.102:0/412125745 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85fc154560 con 0x7f85fc0ab540 2024-08-17T02:29:21.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.325+0000 7f85fbfff700 1 -- 172.21.15.102:0/412125745 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85fc143a20 con 0x7f85fc0ab540 2024-08-17T02:29:21.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.329+0000 7f85f2ffd700 1 -- 172.21.15.102:0/412125745 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f85e4007690 con 0x7f85fc0ab540 2024-08-17T02:29:21.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.329+0000 7f85f2ffd700 1 --2- 172.21.15.102:0/412125745 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f85e0060860 0x7f85e0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.329+0000 7f85f2ffd700 1 -- 172.21.15.102:0/412125745 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f85e407bd50 con 0x7f85fc0ab540 2024-08-17T02:29:21.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.329+0000 7f85faffd700 1 --2- 172.21.15.102:0/412125745 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f85e0060860 0x7f85e0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.329+0000 7f85faffd700 1 --2- 172.21.15.102:0/412125745 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f85e0060860 0x7f85e0062d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f85ec006fd0 tx=0x7f85ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.333+0000 7f85f2ffd700 1 -- 172.21.15.102:0/412125745 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f85e404a480 con 0x7f85fc0ab540 2024-08-17T02:29:21.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.493+0000 7f85fbfff700 1 -- 172.21.15.102:0/412125745 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85fc06f5f0 con 0x7f85e0060860 2024-08-17T02:29:21.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.493+0000 7f85f2ffd700 1 -- 172.21.15.102:0/412125745 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49176 (secure 0 0 0) 0x7f85fc06f5f0 con 0x7f85e0060860 2024-08-17T02:29:21.497 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.497+0000 7f85fbfff700 1 -- 172.21.15.102:0/412125745 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f85e0060860 msgr2=0x7f85e0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.497+0000 7f85fbfff700 1 --2- 172.21.15.102:0/412125745 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f85e0060860 0x7f85e0062d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f85ec006fd0 tx=0x7f85ec008040 comp rx=0 tx=0).stop 2024-08-17T02:29:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.497+0000 7f85fbfff700 1 -- 172.21.15.102:0/412125745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85fc0ab540 msgr2=0x7f85fc140f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.497+0000 7f85fbfff700 1 --2- 172.21.15.102:0/412125745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85fc0ab540 0x7f85fc140f30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f85e400c810 tx=0x7f85e4007db0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.497+0000 7f85fbfff700 1 -- 172.21.15.102:0/412125745 shutdown_connections 2024-08-17T02:29:21.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.497+0000 7f85fbfff700 1 --2- 172.21.15.102:0/412125745 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f85e0060860 0x7f85e0062d10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.497+0000 7f85fbfff700 1 --2- 172.21.15.102:0/412125745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85fc0ab540 0x7f85fc140f30 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.497+0000 7f85fbfff700 1 --2- 172.21.15.102:0/412125745 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f85fc155720 0x7f85fc13f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.497+0000 7f85fbfff700 1 --2- 172.21.15.102:0/412125745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85fc06e9d0 0x7f85fc0acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.497+0000 7f85fbfff700 1 -- 172.21.15.102:0/412125745 >> 172.21.15.102:0/412125745 conn(0x7f85fc0678d0 msgr2=0x7f85fc148400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.497+0000 7f85fbfff700 1 -- 172.21.15.102:0/412125745 shutdown_connections 2024-08-17T02:29:21.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:21.497+0000 7f85fbfff700 1 -- 172.21.15.102:0/412125745 wait complete. 2024-08-17T02:29:21.501 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-08-17T02:29:21.510 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-08-17T02:29:21.254931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2396368,"kb_used_data":5032,"kb_used_omap":13,"kb_used_meta":2391218,"kb_avail":752578352,"statfs":{"total":773094113280,"available":770640232448,"internally_reserved":0,"allocated":5152768,"data_stored":2813936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2448607936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.141652"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-08-17T02:29:10.304381+0000","last_change":"2024-08-17T02:25:51.241912+0000","last_active":"2024-08-17T02:29:10.304381+0000","last_peered":"2024-08-17T02:29:10.304381+0000","last_clean":"2024-08-17T02:29:10.304381+0000","last_became_active":"2024-08-17T02:25:51.239655+0000","last_became_peered":"2024-08-17T02:25:51.239655+0000","last_unstale":"2024-08-17T02:29:10.304381+0000","last_undegraded":"2024-08-17T02:29:10.304381+0000","last_fullsized":"2024-08-17T02:29:10.304381+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:49.863184+0000","last_clean_scrub_stamp":"2024-08-17T02:25:49.863184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:53.845381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298420,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073420,"statfs":{"total":96636764160,"available":96331182080,"internally_reserved":0,"allocated":1089536,"data_stored":794518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94399999999999995,"15min":0.94299999999999995},"min":{"1min":0.64400000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.034,"15min":1.0309999999999999},"min":{"1min":0.78400000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.2450000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.76400000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.90700000000000003,"15min":0.91800000000000004},"min":{"1min":0.66300000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1319999999999999,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.89500000000000002,"15min":0.89800000000000002},"min":{"1min":0.65600000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2090000000000001,"5min":1.514,"15min":1.514},"last":0.72399999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.98299999999999998,"15min":1.0189999999999999},"min":{"1min":0.64100000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2170000000000001,"5min":1.669,"15min":1.669},"last":1.095},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1200000000000001,"15min":1.1299999999999999},"min":{"1min":0.92900000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.258,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.3140000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.026,"15min":1.0600000000000001},"min":{"1min":0.71199999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.3140000000000001,"5min":1.778,"15min":1.778},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.101,"15min":1.1379999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.2330000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.2589999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.98699999999999999,"15min":1.0189999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.1259999999999999,"5min":1.694,"15min":1.694},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.194,"15min":1.244},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.4430000000000001,"5min":1.893,"15min":1.893},"last":1.228}]},{"osd":5,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.165,"15min":1.234},"min":{"1min":0.749,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.238,"5min":1.681,"15min":1.681},"last":1.363},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.1439999999999999,"15min":1.1859999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.2889999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.0049999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.21,"15min":1.264},"min":{"1min":0.84899999999999998,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.2470000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.145},{"interface":"front","average":{"1min":1.169,"5min":1.3100000000000001,"15min":1.3580000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.504,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.335}]}]},{"osd":6,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297840,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85899999999999999,"15min":0.85299999999999998},"min":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2070000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.65000000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1879999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.86799999999999999,"15min":0.84499999999999997},"min":{"1min":0.64400000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.242,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96399999999999997,"15min":0.995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1879999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.93799999999999994}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.85099999999999998,"15min":0.81999999999999995},"min":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.95799999999999996,"15min":0.95699999999999996},"min":{"1min":0.752,"5min":0.627,"15min":0.627},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.0249999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.93799999999999994,"15min":0.91900000000000004},"min":{"1min":0.64000000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.206,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.226},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0069999999999999,"15min":1.0189999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.24,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.004}]},{"osd":4,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.96099999999999997,"15min":0.97899999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1950000000000001,"5min":1.383,"15min":1.383},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.1439999999999999,"15min":1.163},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.298,"5min":1.544,"15min":1.544},"last":1.0960000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.075,"15min":1.093},"min":{"1min":0.751,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.232,"5min":1.427,"15min":1.427},"last":1.375},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.113,"15min":1.127},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3280000000000001,"5min":1.456,"15min":1.456},"last":1.1419999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1080000000000001,"15min":1.1160000000000001},"min":{"1min":0.83699999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.3700000000000001,"5min":1.399,"15min":1.399},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1739999999999999,"15min":1.1879999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2889999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.4430000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302000,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069840,"statfs":{"total":96636764160,"available":96327516160,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.89200000000000002,"15min":0.90400000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.169,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88,"15min":0.86699999999999999},"min":{"1min":0.64900000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.173,"5min":1.24,"15min":1.24},"last":0.66500000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.85199999999999998,"15min":0.85499999999999998},"min":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.93100000000000005,"15min":0.91200000000000003},"min":{"1min":0.65600000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.246,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83299999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.86099999999999999,"15min":0.85299999999999998},"min":{"1min":0.60999999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.878},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98599999999999999,"15min":1.002},"min":{"1min":0.754,"5min":0.443,"15min":0.443},"max":{"1min":1.234,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.087}]},{"osd":3,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93600000000000005,"15min":0.93400000000000005},"min":{"1min":0.69899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1319999999999999,"5min":1.359,"15min":1.359},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.92000000000000004,"15min":0.91600000000000004},"min":{"1min":0.68200000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.1599999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.61099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.97199999999999998,"15min":1.012},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1899999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.0569999999999999,"15min":1.075},"min":{"1min":0.67500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2769999999999999,"5min":1.409,"15min":1.409},"last":0.92600000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.998,"15min":1.0129999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1699999999999999,"5min":1.28,"15min":1.28},"last":1.014},{"interface":"front","average":{"1min":1.113,"5min":1.1259999999999999,"15min":1.1459999999999999},"min":{"1min":0.83499999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.256,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.268}]},{"osd":7,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.117,"15min":1.125},"min":{"1min":0.84599999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.3180000000000001,"5min":1.464,"15min":1.464},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.113,"15min":1.127},"min":{"1min":0.754,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.2989999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.1299999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302000,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069840,"statfs":{"total":96636764160,"available":96327516160,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.873,"15min":0.88100000000000001},"min":{"1min":0.68300000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.131,"5min":1.47,"15min":1.47},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90900000000000003,"15min":0.90100000000000002},"min":{"1min":0.66700000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2350000000000001,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.70299999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.92200000000000004,"15min":0.93899999999999995},"min":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.1719999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.92000000000000004,"15min":0.90000000000000002},"min":{"1min":0.71099999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.753}]},{"osd":2,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.68799999999999994,"5min":0.626,"15min":0.626},"max":{"1min":1.252,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.0349999999999999,"15min":1.052},"min":{"1min":0.76500000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.044}]},{"osd":3,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.94399999999999995,"15min":0.95399999999999996},"min":{"1min":0.71799999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.171,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.997,"5min":1.0309999999999999,"15min":1.0549999999999999},"min":{"1min":0.84499999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2050000000000001,"5min":1.863,"15min":1.863},"last":0.996}]},{"osd":5,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.99399999999999999,"15min":1.0189999999999999},"min":{"1min":0.63800000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2649999999999999,"5min":1.401,"15min":1.401},"last":1.127},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.98599999999999999,"15min":0.98099999999999998},"min":{"1min":0.69799999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3169999999999999,"5min":1.754,"15min":1.754},"last":0.95999999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.073,"15min":1.1000000000000001},"min":{"1min":0.65800000000000003,"5min":0.63,"15min":0.63},"max":{"1min":1.3,"5min":2.109,"15min":2.109},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1719999999999999,"15min":1.1879999999999999},"min":{"1min":0.91900000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.452,"5min":1.587,"15min":1.587},"last":1.234}]},{"osd":7,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.2210000000000001,"15min":1.276},"min":{"1min":0.77700000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.371,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.2390000000000001,"15min":1.2709999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.3049999999999999,"5min":2.202,"15min":2.202},"last":1.206}]}]},{"osd":3,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68000000000000005,"15min":0.68500000000000005},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.5},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66800000000000004,"15min":0.63700000000000001},"min":{"1min":0.53300000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92900000000000005,"5min":1.181,"15min":1.181},"last":0.63300000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.65600000000000003,"15min":0.63600000000000001},"min":{"1min":0.54000000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80400000000000005,"15min":0.79100000000000004},"min":{"1min":0.61899999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0569999999999999,"5min":1.161,"15min":1.161},"last":0.58799999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.82299999999999995,"15min":0.80500000000000005},"min":{"1min":0.748,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1279999999999999,"5min":1.411,"15min":1.411},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.58899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0820000000000001,"5min":1.099,"15min":1.099},"last":0.56200000000000006}]},{"osd":4,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.94499999999999995,"15min":0.92600000000000005},"min":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.1870000000000001,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.98699999999999999,"15min":0.97799999999999998},"min":{"1min":0.753,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.123}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0229999999999999,"15min":1.0209999999999999},"min":{"1min":0.749,"5min":0.624,"15min":0.624},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.101,"15min":1.099},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.3200000000000001,"5min":1.423,"15min":1.423},"last":0.74099999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1279999999999999,"15min":1.1120000000000001},"min":{"1min":0.88200000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0700000000000001,"15min":1.0580000000000001},"min":{"1min":0.89500000000000002,"5min":0.753,"15min":0.753},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.90800000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1279999999999999,"15min":1.1339999999999999},"min":{"1min":0.83099999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.319,"5min":1.913,"15min":1.913},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1459999999999999,"15min":1.1240000000000001},"min":{"1min":0.97399999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.5049999999999999,"5min":1.698,"15min":1.698},"last":1.208}]}]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297840,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.51700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.90100000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71399999999999997,"15min":0.70199999999999996},"min":{"1min":0.57399999999999995,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0840000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.61499999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78800000000000003,"15min":0.79700000000000004},"min":{"1min":0.63300000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1100000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.78500000000000003},"min":{"1min":0.59499999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95899999999999996,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.79500000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.59999999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.90500000000000003,"15min":0.90700000000000003},"min":{"1min":0.65100000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.0880000000000001,"5min":1.258,"15min":1.258},"last":0.82499999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0760000000000001,"15min":1.1060000000000001},"min":{"1min":0.80500000000000005,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.236,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.02,"15min":1.0169999999999999},"min":{"1min":0.79400000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.256,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.89300000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.109,"15min":1.1160000000000001},"min":{"1min":0.83199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.375,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.105,"15min":1.1299999999999999},"min":{"1min":0.90300000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.2370000000000001,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.0529999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.091,"15min":1.1140000000000001},"min":{"1min":0.79600000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.1990000000000001,"5min":1.615,"15min":1.615},"last":1.103},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2070000000000001,"15min":1.224},"min":{"1min":0.93700000000000006,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.403,"5min":1.681,"15min":1.681},"last":1.3220000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1819999999999999,"15min":1.198},"min":{"1min":0.94999999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.3979999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1539999999999999,"15min":1.1639999999999999},"min":{"1min":1.01,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3680000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.02}]}]},{"osd":1,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302000,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069840,"statfs":{"total":96636764160,"available":96327516160,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.76100000000000001},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1919999999999999,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77100000000000002,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99099999999999999,"5min":3.5209999999999999,"15min":3.5209999999999999},"last":0.84499999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.96999999999999997,"15min":1.0680000000000001},"min":{"1min":0.58399999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.302,"5min":9.1709999999999994,"15min":9.1709999999999994},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.90600000000000003,"15min":0.95699999999999996},"min":{"1min":0.58999999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.139,"5min":7.4320000000000004,"15min":7.4320000000000004},"last":0.67500000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":1.008,"15min":1.0860000000000001},"min":{"1min":0.70899999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.087,"5min":10.305,"15min":10.305},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":1.0069999999999999,"15min":1.101},"min":{"1min":0.59199999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0549999999999999,"5min":10.105,"15min":10.105},"last":0.75600000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.1259999999999999,"15min":1.1919999999999999},"min":{"1min":0.68200000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.861,"5min":6,"15min":6},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0629999999999999,"15min":1.0820000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.171,"5min":4.0209999999999999,"15min":4.0209999999999999},"last":0.90400000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.1499999999999999,"15min":1.204},"min":{"1min":0.79900000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.27,"5min":5.6459999999999999,"15min":5.6459999999999999},"last":0.995},{"interface":"front","average":{"1min":1.087,"5min":1.1910000000000001,"15min":1.2470000000000001},"min":{"1min":0.81299999999999994,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.986,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.82399999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.2,"15min":1.242},"min":{"1min":0.84499999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.2509999999999999,"5min":6.7750000000000004,"15min":6.7750000000000004},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.111,"5min":1.2230000000000001,"15min":1.2729999999999999},"min":{"1min":0.93000000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.3129999999999999,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":1.0549999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.2490000000000001,"15min":1.3009999999999999},"min":{"1min":0.84399999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.3700000000000001,"5min":5.758,"15min":5.758},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.216,"5min":1.272,"15min":1.3220000000000001},"min":{"1min":0.96999999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":2.044,"5min":4.875,"15min":4.875},"last":1.1419999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298424,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073416,"statfs":{"total":96636764160,"available":96331177984,"internally_reserved":0,"allocated":1089536,"data_stored":794518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67000000000000004,"15min":0.67700000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.85399999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.72299999999999998,"15min":0.71199999999999997},"min":{"1min":0.56299999999999994,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.02,"5min":1.375,"15min":1.375},"last":0.69499999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.747,"15min":0.745},"min":{"1min":0.55900000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.02,"5min":1.214,"15min":1.214},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72899999999999998,"15min":0.70699999999999996},"min":{"1min":0.61599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0049999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.75600000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.70399999999999996,"15min":0.66800000000000004},"min":{"1min":0.621,"5min":0.436,"15min":0.436},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86699999999999999,"15min":0.85599999999999998},"min":{"1min":0.69899999999999995,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.071,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.77500000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0529999999999999,"15min":1.069},"min":{"1min":0.83099999999999996,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2130000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0329999999999999,"15min":1.042},"min":{"1min":0.82399999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.373,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.0940000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0880000000000001,"15min":1.083},"min":{"1min":0.80700000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.278,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.042,"15min":1.0409999999999999},"min":{"1min":0.84399999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.2769999999999999,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":1.1279999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.99199999999999999,"15min":0.99099999999999999},"min":{"1min":0.71199999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.486,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.1659999999999999,"15min":1.1759999999999999},"min":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.4099999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.298}]},{"osd":7,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.214,"15min":1.26},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.385,"5min":3.9350000000000001,"15min":3.9350000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.097,"15min":1.093},"min":{"1min":0.94299999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.2649999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:21.513 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:25:49.863184+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=25, tm_sec=49, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=29, tm_sec=16, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:29:21.513 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:29:30.845 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:30.848 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:41.515 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:41.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc22c0700 1 Processor -- start 2024-08-17T02:29:41.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc22c0700 1 -- start start 2024-08-17T02:29:41.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc22c0700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7fbc0ace80 0x7f7fbc157350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc22c0700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7fbc157890 0x7f7fbc0aab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc22c0700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fbc0adf50 con 0x7f7fbc156f80 2024-08-17T02:29:41.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc22c0700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fbc0ad340 con 0x7f7fbc0ace80 2024-08-17T02:29:41.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc22c0700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fbc0ad620 con 0x7f7fbc157890 2024-08-17T02:29:41.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fb37fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7fbc0ace80 0x7f7fbc157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fb37fe700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7fbc0ace80 0x7f7fbc157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34872/0 (socket says 172.21.15.102:34872) 2024-08-17T02:29:41.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fb37fe700 1 -- 172.21.15.102:0/3769252333 learned_addr learned my addr 172.21.15.102:0/3769252333 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:41.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc085d700 1 --2- 172.21.15.102:0/3769252333 >> v2:172.21.15.121:3300/0 conn(0x7f7fbc157890 0x7f7fbc0aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fb37fe700 1 -- 172.21.15.102:0/3769252333 >> v2:172.21.15.121:3300/0 conn(0x7f7fbc157890 msgr2=0x7f7fbc0aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fb37fe700 1 --2- 172.21.15.102:0/3769252333 >> v2:172.21.15.121:3300/0 conn(0x7f7fbc157890 0x7f7fbc0aab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fb37fe700 1 -- 172.21.15.102:0/3769252333 >> v1:172.21.15.121:6789/0 conn(0x7f7fbc156f80 legacy=0x7f7fbc0ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fb37fe700 1 -- 172.21.15.102:0/3769252333 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc0ad900 con 0x7f7fbc0ace80 2024-08-17T02:29:41.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc085d700 1 --2- 172.21.15.102:0/3769252333 >> v2:172.21.15.121:3300/0 conn(0x7f7fbc157890 0x7f7fbc0aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:41.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fb37fe700 1 --2- 172.21.15.102:0/3769252333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fbc0ace80 0x7f7fbc157350 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40099b0 tx=0x7f7fa4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5126e8f65ea7cf8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fbb7fe700 1 -- 172.21.15.102:0/3769252333 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400b820 con 0x7f7fbc0ace80 2024-08-17T02:29:41.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fbb7fe700 1 -- 172.21.15.102:0/3769252333 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa400b980 con 0x7f7fbc0ace80 2024-08-17T02:29:41.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fbb7fe700 1 -- 172.21.15.102:0/3769252333 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400bd20 con 0x7f7fbc0ace80 2024-08-17T02:29:41.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc22c0700 1 -- 172.21.15.102:0/3769252333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fbc0ace80 msgr2=0x7f7fbc157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc22c0700 1 --2- 172.21.15.102:0/3769252333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fbc0ace80 0x7f7fbc157350 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40099b0 tx=0x7f7fa4009250 comp rx=0 tx=0).stop 2024-08-17T02:29:41.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc22c0700 1 -- 172.21.15.102:0/3769252333 shutdown_connections 2024-08-17T02:29:41.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc22c0700 1 --2- 172.21.15.102:0/3769252333 >> v2:172.21.15.121:3300/0 conn(0x7f7fbc157890 0x7f7fbc0aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc22c0700 1 --2- 172.21.15.102:0/3769252333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fbc0ace80 0x7f7fbc157350 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc22c0700 1 -- 172.21.15.102:0/3769252333 >> 172.21.15.102:0/3769252333 conn(0x7f7fbc066e00 msgr2=0x7f7fbc067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc22c0700 1 -- 172.21.15.102:0/3769252333 shutdown_connections 2024-08-17T02:29:41.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.629+0000 7f7fc22c0700 1 -- 172.21.15.102:0/3769252333 wait complete. 2024-08-17T02:29:41.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.633+0000 7f7fc22c0700 1 Processor -- start 2024-08-17T02:29:41.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.633+0000 7f7fc22c0700 1 -- start start 2024-08-17T02:29:41.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.633+0000 7f7fc22c0700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7fbc0ace80 0x7f7fbc0993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.633+0000 7f7fc22c0700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fbc156f80 0x7f7fbc14bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.633+0000 7f7fc22c0700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fbc157890 0x7f7fbc14f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.633+0000 7f7fc22c0700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc098f20 con 0x7f7fbc156f80 2024-08-17T02:29:41.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.633+0000 7f7fc22c0700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0998f0 con 0x7f7fbc157890 2024-08-17T02:29:41.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.633+0000 7f7fc22c0700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc098310 con 0x7f7fbc0ace80 2024-08-17T02:29:41.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.633+0000 7f7fb37fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fbc156f80 0x7f7fbc14bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.633+0000 7f7fb37fe700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fbc156f80 0x7f7fbc14bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34886/0 (socket says 172.21.15.102:34886) 2024-08-17T02:29:41.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.633+0000 7f7fb37fe700 1 -- 172.21.15.102:0/3196367027 learned_addr learned my addr 172.21.15.102:0/3196367027 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:41.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.633+0000 7f7fc085d700 1 --2- 172.21.15.102:0/3196367027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fbc157890 0x7f7fbc14f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.633+0000 7f7fbbfff700 1 --2- 172.21.15.102:0/3196367027 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7fbc0ace80 0x7f7fbc0993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.637+0000 7f7fb37fe700 1 -- 172.21.15.102:0/3196367027 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7fbc0ace80 msgr2=0x7f7fbc0993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.637+0000 7f7fb37fe700 1 --2- 172.21.15.102:0/3196367027 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7fbc0ace80 0x7f7fbc0993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.637+0000 7f7fb37fe700 1 -- 172.21.15.102:0/3196367027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fbc157890 msgr2=0x7f7fbc14f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.637+0000 7f7fb37fe700 1 --2- 172.21.15.102:0/3196367027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fbc157890 0x7f7fbc14f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.637+0000 7f7fb37fe700 1 -- 172.21.15.102:0/3196367027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa40094f0 con 0x7f7fbc156f80 2024-08-17T02:29:41.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.637+0000 7f7fb37fe700 1 --2- 172.21.15.102:0/3196367027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fbc156f80 0x7f7fbc14bd30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40094c0 tx=0x7f7fa4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.637+0000 7f7fb8ff9700 1 -- 172.21.15.102:0/3196367027 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400bd00 con 0x7f7fbc156f80 2024-08-17T02:29:41.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.637+0000 7f7fb8ff9700 1 -- 172.21.15.102:0/3196367027 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa401a450 con 0x7f7fbc156f80 2024-08-17T02:29:41.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.637+0000 7f7fc22c0700 1 -- 172.21.15.102:0/3196367027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fbc0985f0 con 0x7f7fbc156f80 2024-08-17T02:29:41.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.637+0000 7f7fb8ff9700 1 -- 172.21.15.102:0/3196367027 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa401a7d0 con 0x7f7fbc156f80 2024-08-17T02:29:41.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.637+0000 7f7fc22c0700 1 -- 172.21.15.102:0/3196367027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fbc098bb0 con 0x7f7fbc156f80 2024-08-17T02:29:41.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.637+0000 7f7fb8ff9700 1 -- 172.21.15.102:0/3196367027 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7fa401ab80 con 0x7f7fbc156f80 2024-08-17T02:29:41.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.637+0000 7f7fc22c0700 1 -- 172.21.15.102:0/3196367027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fbc099090 con 0x7f7fbc156f80 2024-08-17T02:29:41.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.637+0000 7f7fb8ff9700 1 --2- 172.21.15.102:0/3196367027 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7f9c060890 0x7f7f9c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.637+0000 7f7fb8ff9700 1 -- 172.21.15.102:0/3196367027 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7fa407dd70 con 0x7f7fbc156f80 2024-08-17T02:29:41.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.637+0000 7f7fbbfff700 1 --2- 172.21.15.102:0/3196367027 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7f9c060890 0x7f7f9c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.641+0000 7f7fbbfff700 1 --2- 172.21.15.102:0/3196367027 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7f9c060890 0x7f7f9c062d40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0039f0 tx=0x7f7fac007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.645+0000 7f7fb8ff9700 1 -- 172.21.15.102:0/3196367027 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7fa404e460 con 0x7f7fbc156f80 2024-08-17T02:29:41.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.805+0000 7f7fc22c0700 1 -- 172.21.15.102:0/3196367027 --> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7fbc0645c0 con 0x7f7f9c060890 2024-08-17T02:29:41.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.809+0000 7f7fb8ff9700 1 -- 172.21.15.102:0/3196367027 <== mgr.4102 v2:172.21.15.102:6832/24139 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49215 (secure 0 0 0) 0x7f7fbc0645c0 con 0x7f7f9c060890 2024-08-17T02:29:41.814 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:41.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.813+0000 7f7fc22c0700 1 -- 172.21.15.102:0/3196367027 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7f9c060890 msgr2=0x7f7f9c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.813+0000 7f7fc22c0700 1 --2- 172.21.15.102:0/3196367027 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7f9c060890 0x7f7f9c062d40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0039f0 tx=0x7f7fac007ec0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.813+0000 7f7fc22c0700 1 -- 172.21.15.102:0/3196367027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fbc156f80 msgr2=0x7f7fbc14bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.813+0000 7f7fc22c0700 1 --2- 172.21.15.102:0/3196367027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fbc156f80 0x7f7fbc14bd30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40094c0 tx=0x7f7fa4017000 comp rx=0 tx=0).stop 2024-08-17T02:29:41.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.813+0000 7f7fc22c0700 1 -- 172.21.15.102:0/3196367027 shutdown_connections 2024-08-17T02:29:41.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.813+0000 7f7fc22c0700 1 --2- 172.21.15.102:0/3196367027 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f7f9c060890 0x7f7f9c062d40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.813+0000 7f7fc22c0700 1 --2- 172.21.15.102:0/3196367027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fbc156f80 0x7f7fbc14bd30 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.813+0000 7f7fc22c0700 1 --2- 172.21.15.102:0/3196367027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fbc157890 0x7f7fbc14f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.813+0000 7f7fc22c0700 1 --2- 172.21.15.102:0/3196367027 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f7fbc0ace80 0x7f7fbc0993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.813+0000 7f7fc22c0700 1 -- 172.21.15.102:0/3196367027 >> 172.21.15.102:0/3196367027 conn(0x7f7fbc066e00 msgr2=0x7f7fbc0aa710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.813+0000 7f7fc22c0700 1 -- 172.21.15.102:0/3196367027 shutdown_connections 2024-08-17T02:29:41.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.813+0000 7f7fc22c0700 1 -- 172.21.15.102:0/3196367027 wait complete. 2024-08-17T02:29:41.820 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-08-17T02:29:41.829 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-08-17T02:29:41.260094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2396356,"kb_used_data":5032,"kb_used_omap":13,"kb_used_meta":2391218,"kb_avail":752578364,"statfs":{"total":773094113280,"available":770640244736,"internally_reserved":0,"allocated":5152768,"data_stored":2813936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2448607936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003076"},"pg_stats":[{"pgid":"1.0","version":"42'119","reported_seq":191,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:29:25.090052+0000","last_change":"2024-08-17T02:29:25.089991+0000","last_active":"2024-08-17T02:29:25.090052+0000","last_peered":"2024-08-17T02:29:25.090052+0000","last_clean":"2024-08-17T02:29:25.090052+0000","last_became_active":"2024-08-17T02:25:51.239655+0000","last_became_peered":"2024-08-17T02:25:51.239655+0000","last_unstale":"2024-08-17T02:29:25.090052+0000","last_undegraded":"2024-08-17T02:29:25.090052+0000","last_fullsized":"2024-08-17T02:29:25.090052+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'119","last_scrub_stamp":"2024-08-17T02:29:25.089769+0000","last_deep_scrub":"42'119","last_deep_scrub_stamp":"2024-08-17T02:29:25.089769+0000","last_clean_scrub_stamp":"2024-08-17T02:29:25.089769+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:24.342416+0000","scrub_duration":0.0097615189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542193,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298416,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073424,"statfs":{"total":96636764160,"available":96331186176,"internally_reserved":0,"allocated":1089536,"data_stored":794518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.94399999999999995,"15min":0.94299999999999995},"min":{"1min":0.64400000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.034,"15min":1.0309999999999999},"min":{"1min":0.78400000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.2450000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.1459999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.90700000000000003,"15min":0.91800000000000004},"min":{"1min":0.66300000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1319999999999999,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.89500000000000002,"15min":0.89800000000000002},"min":{"1min":0.65600000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.2090000000000001,"5min":1.514,"15min":1.514},"last":0.91700000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.98299999999999998,"15min":1.0189999999999999},"min":{"1min":0.64100000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2170000000000001,"5min":1.669,"15min":1.669},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1200000000000001,"15min":1.1299999999999999},"min":{"1min":0.92900000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.258,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.2090000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":1.026,"15min":1.0600000000000001},"min":{"1min":0.71199999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.3140000000000001,"5min":1.778,"15min":1.778},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.101,"15min":1.1379999999999999},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.2330000000000001,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.256}]},{"osd":4,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.98699999999999999,"15min":1.0189999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.1259999999999999,"5min":1.694,"15min":1.694},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.194,"15min":1.244},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.4430000000000001,"5min":1.893,"15min":1.893},"last":0.996}]},{"osd":5,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.165,"15min":1.234},"min":{"1min":0.749,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.238,"5min":1.681,"15min":1.681},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.1439999999999999,"15min":1.1859999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.2889999999999999,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.032}]},{"osd":6,"last update":"Sat Aug 17 02:28:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.21,"15min":1.264},"min":{"1min":0.84899999999999998,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.2470000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.3100000000000001,"15min":1.3580000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.504,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.117}]}]},{"osd":6,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297840,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85899999999999999,"15min":0.85299999999999998},"min":{"1min":0.53300000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2070000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.65000000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1879999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.69799999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.86799999999999999,"15min":0.84499999999999997},"min":{"1min":0.64400000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.242,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96399999999999997,"15min":0.995},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1879999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.83799999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.85099999999999998,"15min":0.81999999999999995},"min":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.95799999999999996,"15min":0.95699999999999996},"min":{"1min":0.752,"5min":0.627,"15min":0.627},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.79400000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.93799999999999994,"15min":0.91900000000000004},"min":{"1min":0.64000000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.206,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0069999999999999,"15min":1.0189999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.24,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.073}]},{"osd":4,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.96099999999999997,"15min":0.97899999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1950000000000001,"5min":1.383,"15min":1.383},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.1439999999999999,"15min":1.163},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.298,"5min":1.544,"15min":1.544},"last":1.1759999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.075,"15min":1.093},"min":{"1min":0.751,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.232,"5min":1.427,"15min":1.427},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.113,"15min":1.127},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3280000000000001,"5min":1.456,"15min":1.456},"last":1.2589999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1080000000000001,"15min":1.1160000000000001},"min":{"1min":0.83699999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.3700000000000001,"5min":1.399,"15min":1.399},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1739999999999999,"15min":1.1879999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.2889999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.2949999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302000,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069840,"statfs":{"total":96636764160,"available":96327516160,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.89200000000000002,"15min":0.90400000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.169,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.88,"15min":0.86699999999999999},"min":{"1min":0.64900000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.173,"5min":1.24,"15min":1.24},"last":1.044}]},{"osd":1,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.85199999999999998,"15min":0.85499999999999998},"min":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.091},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.93100000000000005,"15min":0.91200000000000003},"min":{"1min":0.65600000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.246,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.94099999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.86099999999999999,"15min":0.85299999999999998},"min":{"1min":0.60999999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98599999999999999,"15min":1.002},"min":{"1min":0.754,"5min":0.443,"15min":0.443},"max":{"1min":1.234,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.76500000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93600000000000005,"15min":0.93400000000000005},"min":{"1min":0.69899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1319999999999999,"5min":1.359,"15min":1.359},"last":1.1899999999999999},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.92000000000000004,"15min":0.91600000000000004},"min":{"1min":0.68200000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.1599999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.71999999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.97199999999999998,"15min":1.012},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1899999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.0569999999999999,"15min":1.075},"min":{"1min":0.67500000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2769999999999999,"5min":1.409,"15min":1.409},"last":0.80300000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.998,"15min":1.0129999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.1699999999999999,"5min":1.28,"15min":1.28},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.113,"5min":1.1259999999999999,"15min":1.1459999999999999},"min":{"1min":0.83499999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.256,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.875}]},{"osd":7,"last update":"Sat Aug 17 02:28:59 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.117,"15min":1.125},"min":{"1min":0.84599999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.3180000000000001,"5min":1.464,"15min":1.464},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.113,"15min":1.127},"min":{"1min":0.754,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.2989999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.97099999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302000,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069840,"statfs":{"total":96636764160,"available":96327516160,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.873,"15min":0.88100000000000001},"min":{"1min":0.68300000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.131,"5min":1.47,"15min":1.47},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90900000000000003,"15min":0.90100000000000002},"min":{"1min":0.66700000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2350000000000001,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":1.0960000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.92200000000000004,"15min":0.93899999999999995},"min":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.1719999999999999,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.92000000000000004,"15min":0.90000000000000002},"min":{"1min":0.71099999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.89400000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.68799999999999994,"5min":0.626,"15min":0.626},"max":{"1min":1.252,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.0349999999999999,"15min":1.052},"min":{"1min":0.76500000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.2629999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.94399999999999995,"15min":0.95399999999999996},"min":{"1min":0.71799999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.171,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.997,"5min":1.0309999999999999,"15min":1.0549999999999999},"min":{"1min":0.84499999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2050000000000001,"5min":1.863,"15min":1.863},"last":0.95399999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.99399999999999999,"15min":1.0189999999999999},"min":{"1min":0.63800000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2649999999999999,"5min":1.401,"15min":1.401},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.98599999999999999,"15min":0.98099999999999998},"min":{"1min":0.69799999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3169999999999999,"5min":1.754,"15min":1.754},"last":0.99399999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.073,"15min":1.1000000000000001},"min":{"1min":0.65800000000000003,"5min":0.63,"15min":0.63},"max":{"1min":1.3,"5min":2.109,"15min":2.109},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1719999999999999,"15min":1.1879999999999999},"min":{"1min":0.91900000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.452,"5min":1.587,"15min":1.587},"last":1.3069999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.2210000000000001,"15min":1.276},"min":{"1min":0.77700000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.371,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.2390000000000001,"15min":1.2709999999999999},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.3049999999999999,"5min":2.202,"15min":2.202},"last":1.242}]}]},{"osd":3,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68000000000000005,"15min":0.68500000000000005},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66800000000000004,"15min":0.63700000000000001},"min":{"1min":0.53300000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92900000000000005,"5min":1.181,"15min":1.181},"last":0.87}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.65600000000000003,"15min":0.63600000000000001},"min":{"1min":0.54000000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80400000000000005,"15min":0.79100000000000004},"min":{"1min":0.61899999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0569999999999999,"5min":1.161,"15min":1.161},"last":0.93100000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.82299999999999995,"15min":0.80500000000000005},"min":{"1min":0.748,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1279999999999999,"5min":1.411,"15min":1.411},"last":1.046},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.58899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0820000000000001,"5min":1.099,"15min":1.099},"last":0.69199999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.94499999999999995,"15min":0.92600000000000005},"min":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.1870000000000001,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.98699999999999999,"15min":0.97799999999999998},"min":{"1min":0.753,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.90700000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.0229999999999999,"15min":1.0209999999999999},"min":{"1min":0.749,"5min":0.624,"15min":0.624},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.004},{"interface":"front","average":{"1min":1.099,"5min":1.101,"15min":1.099},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.3200000000000001,"5min":1.423,"15min":1.423},"last":1.232}]},{"osd":6,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1279999999999999,"15min":1.1120000000000001},"min":{"1min":0.88200000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":1.306},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0700000000000001,"15min":1.0580000000000001},"min":{"1min":0.89500000000000002,"5min":0.753,"15min":0.753},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.2190000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1279999999999999,"15min":1.1339999999999999},"min":{"1min":0.83099999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.319,"5min":1.913,"15min":1.913},"last":1.157},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1459999999999999,"15min":1.1240000000000001},"min":{"1min":0.97399999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.5049999999999999,"5min":1.698,"15min":1.698},"last":1.1359999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297840,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.51700000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.90100000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.502},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71399999999999997,"15min":0.70199999999999996},"min":{"1min":0.57399999999999995,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0840000000000001,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.88800000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78800000000000003,"15min":0.79700000000000004},"min":{"1min":0.63300000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1100000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78100000000000003,"15min":0.78500000000000003},"min":{"1min":0.59499999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95899999999999996,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.68700000000000006}]},{"osd":3,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.59999999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.90500000000000003,"15min":0.90700000000000003},"min":{"1min":0.65100000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.0880000000000001,"5min":1.258,"15min":1.258},"last":0.85999999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0760000000000001,"15min":1.1060000000000001},"min":{"1min":0.80500000000000005,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.236,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.02,"15min":1.0169999999999999},"min":{"1min":0.79400000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.256,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.109,"15min":1.1160000000000001},"min":{"1min":0.83199999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.375,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.105,"15min":1.1299999999999999},"min":{"1min":0.90300000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.2370000000000001,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.1020000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.091,"15min":1.1140000000000001},"min":{"1min":0.79600000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.1990000000000001,"5min":1.615,"15min":1.615},"last":0.999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2070000000000001,"15min":1.224},"min":{"1min":0.93700000000000006,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.403,"5min":1.681,"15min":1.681},"last":1.0269999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1819999999999999,"15min":1.198},"min":{"1min":0.94999999999999996,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.3979999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1539999999999999,"15min":1.1639999999999999},"min":{"1min":1.01,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3680000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.93000000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302000,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069840,"statfs":{"total":96636764160,"available":96327516160,"internally_reserved":0,"allocated":495616,"data_stored":204150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.76100000000000001},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1919999999999999,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77100000000000002,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99099999999999999,"5min":3.5209999999999999,"15min":3.5209999999999999},"last":1.1479999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.96999999999999997,"15min":1.0680000000000001},"min":{"1min":0.58399999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.302,"5min":9.1709999999999994,"15min":9.1709999999999994},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.90600000000000003,"15min":0.95699999999999996},"min":{"1min":0.58999999999999997,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.139,"5min":7.4320000000000004,"15min":7.4320000000000004},"last":0.89300000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":1.008,"15min":1.0860000000000001},"min":{"1min":0.70899999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.087,"5min":10.305,"15min":10.305},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":1.0069999999999999,"15min":1.101},"min":{"1min":0.59199999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0549999999999999,"5min":10.105,"15min":10.105},"last":1.266}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.1259999999999999,"15min":1.1919999999999999},"min":{"1min":0.68200000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.861,"5min":6,"15min":6},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0629999999999999,"15min":1.0820000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.171,"5min":4.0209999999999999,"15min":4.0209999999999999},"last":1.002}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.1499999999999999,"15min":1.204},"min":{"1min":0.79900000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.27,"5min":5.6459999999999999,"15min":5.6459999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.1910000000000001,"15min":1.2470000000000001},"min":{"1min":0.81299999999999994,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.986,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":1.089}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.2,"15min":1.242},"min":{"1min":0.84499999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.2509999999999999,"5min":6.7750000000000004,"15min":6.7750000000000004},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.2230000000000001,"15min":1.2729999999999999},"min":{"1min":0.93000000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.3129999999999999,"5min":5.4029999999999996,"15min":5.4029999999999996},"last":1.8280000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.2490000000000001,"15min":1.3009999999999999},"min":{"1min":0.84399999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.3700000000000001,"5min":5.758,"15min":5.758},"last":1.905},{"interface":"front","average":{"1min":1.216,"5min":1.272,"15min":1.3220000000000001},"min":{"1min":0.96999999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":2.044,"5min":4.875,"15min":4.875},"last":1.2470000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542192,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298416,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073424,"statfs":{"total":96636764160,"available":96331186176,"internally_reserved":0,"allocated":1089536,"data_stored":794518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67000000000000004,"15min":0.67700000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.85399999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.72299999999999998,"15min":0.71199999999999997},"min":{"1min":0.56299999999999994,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.02,"5min":1.375,"15min":1.375},"last":0.63100000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.747,"15min":0.745},"min":{"1min":0.55900000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.02,"5min":1.214,"15min":1.214},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72899999999999998,"15min":0.70699999999999996},"min":{"1min":0.61599999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0049999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.88600000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.70399999999999996,"15min":0.66800000000000004},"min":{"1min":0.621,"5min":0.436,"15min":0.436},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86699999999999999,"15min":0.85599999999999998},"min":{"1min":0.69899999999999995,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.071,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.0229999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0529999999999999,"15min":1.069},"min":{"1min":0.83099999999999996,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.2130000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0329999999999999,"15min":1.042},"min":{"1min":0.82399999999999995,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.373,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.84699999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0880000000000001,"15min":1.083},"min":{"1min":0.80700000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.278,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.095},{"interface":"front","average":{"1min":1.052,"5min":1.042,"15min":1.0409999999999999},"min":{"1min":0.84399999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.2769999999999999,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.996}]},{"osd":6,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.99199999999999999,"15min":0.99099999999999999},"min":{"1min":0.71199999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.486,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.109,"5min":1.1659999999999999,"15min":1.1759999999999999},"min":{"1min":0.88500000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.4099999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1819999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.214,"15min":1.26},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.385,"5min":3.9350000000000001,"15min":3.9350000000000001},"last":1.069},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.097,"15min":1.093},"min":{"1min":0.94299999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.131}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:41.832 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:29:41.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.937+0000 7f376e5ba700 1 Processor -- start 2024-08-17T02:29:41.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.937+0000 7f376e5ba700 1 -- start start 2024-08-17T02:29:41.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376e5ba700 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3768140910 0x7f37680c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376e5ba700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37680cbab0 0x7f37680cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376e5ba700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f37680c2c80 0x7f37680c3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376e5ba700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37680cc470 con 0x7f37680c2c80 2024-08-17T02:29:41.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376e5ba700 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37680c3e30 con 0x7f3768140910 2024-08-17T02:29:41.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376e5ba700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37680c4110 con 0x7f37680cbab0 2024-08-17T02:29:41.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376ddb9700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f37680c2c80 0x7f37680c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376ddb9700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f37680c2c80 0x7f37680c3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34890/0 (socket says 172.21.15.102:34890) 2024-08-17T02:29:41.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376ddb9700 1 -- 172.21.15.102:0/3254467202 learned_addr learned my addr 172.21.15.102:0/3254467202 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:41.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376cdb7700 1 --2- 172.21.15.102:0/3254467202 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37680cbab0 0x7f37680cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376d5b8700 1 --2- 172.21.15.102:0/3254467202 >> v2:172.21.15.121:3300/0 conn(0x7f3768140910 0x7f37680c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376ddb9700 1 -- 172.21.15.102:0/3254467202 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37680cbab0 msgr2=0x7f37680cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376ddb9700 1 --2- 172.21.15.102:0/3254467202 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37680cbab0 0x7f37680cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376ddb9700 1 -- 172.21.15.102:0/3254467202 >> v2:172.21.15.121:3300/0 conn(0x7f3768140910 msgr2=0x7f37680c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376ddb9700 1 --2- 172.21.15.102:0/3254467202 >> v2:172.21.15.121:3300/0 conn(0x7f3768140910 0x7f37680c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376ddb9700 1 -- 172.21.15.102:0/3254467202 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37680c43f0 con 0x7f37680c2c80 2024-08-17T02:29:41.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376ddb9700 1 --2- 172.21.15.102:0/3254467202 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37680c2c80 0x7f37680c3080 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f376806e260 tx=0x7f3760009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ff89b66d59fb98 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f375bfff700 1 -- 172.21.15.102:0/3254467202 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376000e070 con 0x7f37680c2c80 2024-08-17T02:29:41.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f375bfff700 1 -- 172.21.15.102:0/3254467202 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376000b970 con 0x7f37680c2c80 2024-08-17T02:29:41.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f375bfff700 1 -- 172.21.15.102:0/3254467202 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600092e0 con 0x7f37680c2c80 2024-08-17T02:29:41.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376e5ba700 1 -- 172.21.15.102:0/3254467202 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37680c2c80 msgr2=0x7f37680c3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376e5ba700 1 --2- 172.21.15.102:0/3254467202 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37680c2c80 0x7f37680c3080 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f376806e260 tx=0x7f3760009840 comp rx=0 tx=0).stop 2024-08-17T02:29:41.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376e5ba700 1 -- 172.21.15.102:0/3254467202 shutdown_connections 2024-08-17T02:29:41.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376e5ba700 1 --2- 172.21.15.102:0/3254467202 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37680c2c80 0x7f37680c3080 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376e5ba700 1 --2- 172.21.15.102:0/3254467202 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37680cbab0 0x7f37680cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376e5ba700 1 --2- 172.21.15.102:0/3254467202 >> v2:172.21.15.121:3300/0 conn(0x7f3768140910 0x7f37680c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376e5ba700 1 -- 172.21.15.102:0/3254467202 >> 172.21.15.102:0/3254467202 conn(0x7f37680cdee0 msgr2=0x7f37680ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.941+0000 7f376e5ba700 1 -- 172.21.15.102:0/3254467202 shutdown_connections 2024-08-17T02:29:41.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.945+0000 7f376e5ba700 1 -- 172.21.15.102:0/3254467202 wait complete. 2024-08-17T02:29:41.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.945+0000 7f376e5ba700 1 Processor -- start 2024-08-17T02:29:41.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.945+0000 7f376e5ba700 1 -- start start 2024-08-17T02:29:41.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.945+0000 7f376e5ba700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37680c2c80 0x7f37680af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376e5ba700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37680cbab0 0x7f3768159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376e5ba700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3768140910 0x7f376815a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376e5ba700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376813fa80 con 0x7f37680c2c80 2024-08-17T02:29:41.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376e5ba700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3768157c40 con 0x7f3768140910 2024-08-17T02:29:41.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376e5ba700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37680c7610 con 0x7f37680cbab0 2024-08-17T02:29:41.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376d5b8700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37680c2c80 0x7f37680af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376cdb7700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37680cbab0 0x7f3768159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376cdb7700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37680cbab0 0x7f3768159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:43618/0 (socket says 172.21.15.102:43618) 2024-08-17T02:29:41.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376cdb7700 1 -- 172.21.15.102:0/1445502213 learned_addr learned my addr 172.21.15.102:0/1445502213 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:41.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376ddb9700 1 --2- 172.21.15.102:0/1445502213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3768140910 0x7f376815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376cdb7700 1 -- 172.21.15.102:0/1445502213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3768140910 msgr2=0x7f376815a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376cdb7700 1 --2- 172.21.15.102:0/1445502213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3768140910 0x7f376815a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376cdb7700 1 -- 172.21.15.102:0/1445502213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37680c2c80 msgr2=0x7f37680af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376cdb7700 1 --2- 172.21.15.102:0/1445502213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37680c2c80 0x7f37680af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376cdb7700 1 -- 172.21.15.102:0/1445502213 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3760009ae0 con 0x7f37680cbab0 2024-08-17T02:29:41.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376cdb7700 1 --2- 172.21.15.102:0/1445502213 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37680cbab0 0x7f3768159dc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f375c00ecb0 tx=0x7f375c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f37597fa700 1 -- 172.21.15.102:0/1445502213 <== mon.2 v2:172.21.15.121:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c00c850 con 0x7f37680cbab0 2024-08-17T02:29:41.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f37597fa700 1 -- 172.21.15.102:0/1445502213 <== mon.2 v2:172.21.15.121:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c00c9d0 con 0x7f37680cbab0 2024-08-17T02:29:41.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376e5ba700 1 -- 172.21.15.102:0/1445502213 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37680c78f0 con 0x7f37680cbab0 2024-08-17T02:29:41.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f37597fa700 1 -- 172.21.15.102:0/1445502213 <== mon.2 v2:172.21.15.121:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c00cd90 con 0x7f37680cbab0 2024-08-17T02:29:41.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376e5ba700 1 -- 172.21.15.102:0/1445502213 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37680c6920 con 0x7f37680cbab0 2024-08-17T02:29:41.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.949+0000 7f376e5ba700 1 -- 172.21.15.102:0/1445502213 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3768157730 con 0x7f37680cbab0 2024-08-17T02:29:41.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.953+0000 7f37597fa700 1 -- 172.21.15.102:0/1445502213 <== mon.2 v2:172.21.15.121:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f375c013680 con 0x7f37680cbab0 2024-08-17T02:29:41.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.953+0000 7f37597fa700 1 --2- 172.21.15.102:0/1445502213 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f374c060860 0x7f374c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.953+0000 7f376d5b8700 1 --2- 172.21.15.102:0/1445502213 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f374c060860 0x7f374c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.953+0000 7f37597fa700 1 -- 172.21.15.102:0/1445502213 <== mon.2 v2:172.21.15.121:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f375c07cc20 con 0x7f37680cbab0 2024-08-17T02:29:41.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.953+0000 7f376d5b8700 1 --2- 172.21.15.102:0/1445502213 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f374c060860 0x7f374c062d10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3764009db0 tx=0x7f37640091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:41.965+0000 7f37597fa700 1 -- 172.21.15.102:0/1445502213 <== mon.2 v2:172.21.15.121:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3768157730 con 0x7f37680cbab0 2024-08-17T02:29:42.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.125+0000 7f376e5ba700 1 -- 172.21.15.102:0/1445502213 --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f3768157730 con 0x7f37680cbab0 2024-08-17T02:29:42.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.137+0000 7f37597fa700 1 -- 172.21.15.102:0/1445502213 <== mon.2 v2:172.21.15.121:3301/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f375c04d270 con 0x7f37680cbab0 2024-08-17T02:29:42.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.137+0000 7f37597fa700 1 -- 172.21.15.102:0/1445502213 <== mon.2 v2:172.21.15.121:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3768157730 con 0x7f37680cbab0 2024-08-17T02:29:42.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.141+0000 7f376e5ba700 1 -- 172.21.15.102:0/1445502213 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f374c060860 msgr2=0x7f374c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.141+0000 7f376e5ba700 1 --2- 172.21.15.102:0/1445502213 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f374c060860 0x7f374c062d10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3764009db0 tx=0x7f37640091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.141+0000 7f376e5ba700 1 -- 172.21.15.102:0/1445502213 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37680cbab0 msgr2=0x7f3768159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.141+0000 7f376e5ba700 1 --2- 172.21.15.102:0/1445502213 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37680cbab0 0x7f3768159dc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f375c00ecb0 tx=0x7f375c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.141+0000 7f376e5ba700 1 -- 172.21.15.102:0/1445502213 shutdown_connections 2024-08-17T02:29:42.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.141+0000 7f376e5ba700 1 --2- 172.21.15.102:0/1445502213 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f374c060860 0x7f374c062d10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.141+0000 7f376e5ba700 1 --2- 172.21.15.102:0/1445502213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3768140910 0x7f376815a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.141+0000 7f376e5ba700 1 --2- 172.21.15.102:0/1445502213 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f37680cbab0 0x7f3768159dc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.141+0000 7f376e5ba700 1 --2- 172.21.15.102:0/1445502213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37680c2c80 0x7f37680af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.141+0000 7f376e5ba700 1 -- 172.21.15.102:0/1445502213 >> 172.21.15.102:0/1445502213 conn(0x7f37680cdee0 msgr2=0x7f37680c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:42.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.141+0000 7f376e5ba700 1 -- 172.21.15.102:0/1445502213 shutdown_connections 2024-08-17T02:29:42.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.141+0000 7f376e5ba700 1 -- 172.21.15.102:0/1445502213 wait complete. 2024-08-17T02:29:42.157 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:29:42.157 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:42.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.261+0000 7f837d17f700 1 Processor -- start 2024-08-17T02:29:42.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.261+0000 7f837d17f700 1 -- start start 2024-08-17T02:29:42.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.261+0000 7f837d17f700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f83780b0d20 0x7f837806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.261+0000 7f837d17f700 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8378141a00 con 0x7f837806e450 2024-08-17T02:29:42.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.261+0000 7f837d17f700 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837806e8a0 con 0x7f83780b1800 2024-08-17T02:29:42.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.261+0000 7f837d17f700 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8378140b10 con 0x7f83780b0d20 2024-08-17T02:29:42.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f8377fff700 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f83780b0d20 0x7f837806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f83777fe700 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f837806e450 0x7f83780b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36842/0 (socket says 172.21.15.102:36842) 2024-08-17T02:29:42.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f83777fe700 1 -- 172.21.15.102:0/1028601877 learned_addr learned my addr 172.21.15.102:0/1028601877 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-08-17T02:29:42.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f8376ffd700 1 -- 172.21.15.102:0/1028601877 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614215884 0 0) 0x7f8378141a00 con 0x7f837806e450 2024-08-17T02:29:42.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f8376ffd700 1 -- 172.21.15.102:0/1028601877 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8358003570 con 0x7f837806e450 2024-08-17T02:29:42.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f8377fff700 1 -- 172.21.15.102:0/1028601877 >> v1:172.21.15.121:6789/0 conn(0x7f83780b1800 legacy=0x7f8378141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f8377fff700 1 -- 172.21.15.102:0/1028601877 >> v1:172.21.15.102:6789/0 conn(0x7f837806e450 legacy=0x7f83780b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f8377fff700 1 -- 172.21.15.102:0/1028601877 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8378140df0 con 0x7f83780b0d20 2024-08-17T02:29:42.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f8377fff700 1 --2- 172.21.15.102:0/1028601877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83780b0d20 0x7f837806df10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f83680098e0 tx=0x7f83680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e39d320d3cc107 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:42.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f8376ffd700 1 -- 172.21.15.102:0/1028601877 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836800b640 con 0x7f83780b0d20 2024-08-17T02:29:42.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f8376ffd700 1 -- 172.21.15.102:0/1028601877 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f836800b7a0 con 0x7f83780b0d20 2024-08-17T02:29:42.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f8376ffd700 1 -- 172.21.15.102:0/1028601877 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836800bb60 con 0x7f83780b0d20 2024-08-17T02:29:42.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f837d17f700 1 -- 172.21.15.102:0/1028601877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83780b0d20 msgr2=0x7f837806df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f837d17f700 1 --2- 172.21.15.102:0/1028601877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83780b0d20 0x7f837806df10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f83680098e0 tx=0x7f83680091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f837d17f700 1 -- 172.21.15.102:0/1028601877 shutdown_connections 2024-08-17T02:29:42.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f837d17f700 1 --2- 172.21.15.102:0/1028601877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83780b0d20 0x7f837806df10 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f837d17f700 1 -- 172.21.15.102:0/1028601877 >> 172.21.15.102:0/1028601877 conn(0x7f83780678d0 msgr2=0x7f8378067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:42.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f837d17f700 1 -- 172.21.15.102:0/1028601877 shutdown_connections 2024-08-17T02:29:42.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.265+0000 7f837d17f700 1 -- 172.21.15.102:0/1028601877 wait complete. 2024-08-17T02:29:42.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837d17f700 1 Processor -- start 2024-08-17T02:29:42.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837d17f700 1 -- start start 2024-08-17T02:29:42.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837d17f700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f837806e450 0x7f8378156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837d17f700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83780b0d20 0x7f8378158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837d17f700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83780b1800 0x7f8378142ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837d17f700 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83780a7f70 con 0x7f83780b1800 2024-08-17T02:29:42.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837d17f700 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83780a5920 con 0x7f837806e450 2024-08-17T02:29:42.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837d17f700 1 -- --> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83780a55d0 con 0x7f83780b0d20 2024-08-17T02:29:42.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837c97e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83780b1800 0x7f8378142ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f83777fe700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83780b0d20 0x7f8378158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f8377fff700 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f837806e450 0x7f8378156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837c97e700 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83780b1800 0x7f8378142ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34928/0 (socket says 172.21.15.102:34928) 2024-08-17T02:29:42.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f83777fe700 1 --2- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83780b0d20 0x7f8378158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3301/0 says I am v2:172.21.15.102:43622/0 (socket says 172.21.15.102:43622) 2024-08-17T02:29:42.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837c97e700 1 -- 172.21.15.102:0/2415806826 learned_addr learned my addr 172.21.15.102:0/2415806826 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-08-17T02:29:42.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837c97e700 1 -- 172.21.15.102:0/2415806826 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83780b0d20 msgr2=0x7f8378158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837c97e700 1 --2- 172.21.15.102:0/2415806826 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83780b0d20 0x7f8378158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837c97e700 1 -- 172.21.15.102:0/2415806826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f837806e450 msgr2=0x7f8378156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837c97e700 1 --2- 172.21.15.102:0/2415806826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f837806e450 0x7f8378156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837c97e700 1 -- 172.21.15.102:0/2415806826 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8368009420 con 0x7f83780b1800 2024-08-17T02:29:42.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837c97e700 1 --2- 172.21.15.102:0/2415806826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83780b1800 0x7f8378142ae0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f837000c8e0 tx=0x7f8370001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:42.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f836ffff700 1 -- 172.21.15.102:0/2415806826 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370012630 con 0x7f83780b1800 2024-08-17T02:29:42.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f836ffff700 1 -- 172.21.15.102:0/2415806826 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8370012790 con 0x7f83780b1800 2024-08-17T02:29:42.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837d17f700 1 -- 172.21.15.102:0/2415806826 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8378158ac0 con 0x7f83780b1800 2024-08-17T02:29:42.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f836ffff700 1 -- 172.21.15.102:0/2415806826 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370012b70 con 0x7f83780b1800 2024-08-17T02:29:42.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.269+0000 7f837d17f700 1 -- 172.21.15.102:0/2415806826 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837815a040 con 0x7f83780b1800 2024-08-17T02:29:42.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.273+0000 7f837d17f700 1 -- 172.21.15.102:0/2415806826 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83780643a0 con 0x7f83780b1800 2024-08-17T02:29:42.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.273+0000 7f836ffff700 1 -- 172.21.15.102:0/2415806826 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8370025480 con 0x7f83780b1800 2024-08-17T02:29:42.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.273+0000 7f836ffff700 1 --2- 172.21.15.102:0/2415806826 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f835c060860 0x7f835c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.273+0000 7f836ffff700 1 -- 172.21.15.102:0/2415806826 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f837007d660 con 0x7f83780b1800 2024-08-17T02:29:42.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.273+0000 7f8377fff700 1 --2- 172.21.15.102:0/2415806826 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f835c060860 0x7f835c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.273+0000 7f8377fff700 1 --2- 172.21.15.102:0/2415806826 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f835c060860 0x7f835c062d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f83680093f0 tx=0x7f83680091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:42.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.281+0000 7f836ffff700 1 -- 172.21.15.102:0/2415806826 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f837004ddb0 con 0x7f83780b1800 2024-08-17T02:29:42.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.485+0000 7f837d17f700 1 -- 172.21.15.102:0/2415806826 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f837806f5f0 con 0x7f83780b1800 2024-08-17T02:29:42.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.485+0000 7f836ffff700 1 -- 172.21.15.102:0/2415806826 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3540 (secure 0 0 0) 0x7f83700513d0 con 0x7f83780b1800 2024-08-17T02:29:42.487 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-08-17T02:29:42.487 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3728405798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3728405798},{"type":"v1","addr":"172.21.15.102:6835","nonce":3728405798}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4673,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2759836087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2759836087},{"type":"v1","addr":"172.21.15.121:6833","nonce":2759836087}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4994,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1524598488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1524598488},{"type":"v1","addr":"172.21.15.121:6835","nonce":1524598488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5337,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/3310056391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":3310056391},{"type":"v1","addr":"172.21.15.102:6837","nonce":3310056391}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2024-08-17T02:29:42.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.489+0000 7f837d17f700 1 -- 172.21.15.102:0/2415806826 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f835c060860 msgr2=0x7f835c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.489+0000 7f837d17f700 1 --2- 172.21.15.102:0/2415806826 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f835c060860 0x7f835c062d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f83680093f0 tx=0x7f83680091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.489+0000 7f837d17f700 1 -- 172.21.15.102:0/2415806826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83780b1800 msgr2=0x7f8378142ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.489+0000 7f837d17f700 1 --2- 172.21.15.102:0/2415806826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83780b1800 0x7f8378142ae0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f837000c8e0 tx=0x7f8370001710 comp rx=0 tx=0).stop 2024-08-17T02:29:42.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.489+0000 7f837d17f700 1 -- 172.21.15.102:0/2415806826 shutdown_connections 2024-08-17T02:29:42.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.489+0000 7f837d17f700 1 --2- 172.21.15.102:0/2415806826 >> [v2:172.21.15.102:6832/24139,v1:172.21.15.102:6833/24139] conn(0x7f835c060860 0x7f835c062d10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.489+0000 7f837d17f700 1 --2- 172.21.15.102:0/2415806826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83780b1800 0x7f8378142ae0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.489+0000 7f837d17f700 1 --2- 172.21.15.102:0/2415806826 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f83780b0d20 0x7f8378158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.489+0000 7f837d17f700 1 --2- 172.21.15.102:0/2415806826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f837806e450 0x7f8378156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.489+0000 7f837d17f700 1 -- 172.21.15.102:0/2415806826 >> 172.21.15.102:0/2415806826 conn(0x7f83780678d0 msgr2=0x7f837815dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:42.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.489+0000 7f837d17f700 1 -- 172.21.15.102:0/2415806826 shutdown_connections 2024-08-17T02:29:42.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-08-17T02:29:42.489+0000 7f837d17f700 1 -- 172.21.15.102:0/2415806826 wait complete. 2024-08-17T02:29:42.493 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 21 2024-08-17T02:29:42.506 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:29:42.506 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:29:42.506 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:29:42.507 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:42.516 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:29:42.516 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:29:42.516 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:42.574 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:29:42.574 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:29:42.574 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:42.590 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:29:42.590 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:29:42.590 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:42.602 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:29:42.602 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:29:42.602 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:29:42.603 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:42.659 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:29:42.659 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:29:42.659 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:42.739 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:29:42.739 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:29:42.740 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:42.825 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:29:42.825 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:29:42.825 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:42.921 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:29:42.921 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:29:42.922 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:43.014 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:29:43.014 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:29:43.014 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:43.112 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:29:43.113 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:29:43.113 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:43.187 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:29:43.187 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:29:43.187 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:43.273 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:29:43.273 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:29:43.273 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:29:43.273 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:43.302 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:29:43.302 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:29:43.302 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:43.335 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:29:43.335 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:29:43.335 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:29:43.335 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:43.354 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:29:43.354 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:29:43.355 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:43.394 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:29:43.395 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:29:43.395 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:43.409 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:29:43.410 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:29:43.410 DEBUG:teuthology.orchestra.run.smithi102:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:29:43.433 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi102.front.sepia.ceph.com 2024-08-17T02:29:43.433 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:29:43.783 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi102.front.sepia.ceph.com 2024-08-17T02:29:43.784 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:29:44.034 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi102.front.sepia.ceph.com 2024-08-17T02:29:44.034 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:29:44.251 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi102.front.sepia.ceph.com 2024-08-17T02:29:44.252 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:29:44.442 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi121.front.sepia.ceph.com 2024-08-17T02:29:44.442 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:29:44.713 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi121.front.sepia.ceph.com 2024-08-17T02:29:44.713 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:29:44.944 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi121.front.sepia.ceph.com 2024-08-17T02:29:44.945 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:29:45.110 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi121.front.sepia.ceph.com 2024-08-17T02:29:45.110 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:29:45.307 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:29:45.308 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858253/data/mon.a.tgz 2024-08-17T02:29:45.308 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-08-17T02:29:45.315 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.BoeVcgA5SW 2024-08-17T02:29:45.315 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.BoeVcgA5SW 2024-08-17T02:29:45.394 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.BoeVcgA5SW 2024-08-17T02:29:45.465 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.BoeVcgA5SW is 303KB 2024-08-17T02:29:45.528 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.BoeVcgA5SW 2024-08-17T02:29:45.535 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858253/data/mon.b.tgz 2024-08-17T02:29:45.535 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-08-17T02:29:45.542 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.HnRMImwvRs 2024-08-17T02:29:45.542 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.HnRMImwvRs 2024-08-17T02:29:45.687 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.HnRMImwvRs 2024-08-17T02:29:45.714 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.HnRMImwvRs is 402KB 2024-08-17T02:29:45.732 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.HnRMImwvRs 2024-08-17T02:29:45.737 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858253/data/mon.c.tgz 2024-08-17T02:29:45.737 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-08-17T02:29:45.787 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.4qsE7Lm2op 2024-08-17T02:29:45.787 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.4qsE7Lm2op 2024-08-17T02:29:45.888 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.4qsE7Lm2op 2024-08-17T02:29:45.907 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.4qsE7Lm2op is 402KB 2024-08-17T02:29:45.971 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.4qsE7Lm2op 2024-08-17T02:29:45.978 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:29:45.979 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:29:45.981 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:29:45.995 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:29:45.995 DEBUG:teuthology.orchestra.run.smithi102:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:29:46.039 DEBUG:teuthology.orchestra.run.smithi121:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:29:46.062 INFO:teuthology.orchestra.run.smithi121.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:29:46.064 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:29:46.070 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:29:46.072 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858253/remote/smithi102/crash 2024-08-17T02:29:46.073 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:29:46.087 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858253/remote/smithi121/crash 2024-08-17T02:29:46.088 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:29:46.126 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:29:46.127 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:46.129 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:46.203 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:46.217 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:46.233 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:29:46.233 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:29:46.236 DEBUG:teuthology.orchestra.run.smithi121:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:29:46.258 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30796.log 2024-08-17T02:29:46.258 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30410.log 2024-08-17T02:29:46.260 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32364.log 2024-08-17T02:29:46.260 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29440.log 2024-08-17T02:29:46.260 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30410.log: /var/log/ceph/ceph-client.admin.32364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30415.log 2024-08-17T02:29:46.260 INFO:teuthology.orchestra.run.smithi102.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30796.log.gz 2024-08-17T02:29:46.260 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32364.log.gz 2024-08-17T02:29:46.261 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30201.log 2024-08-17T02:29:46.261 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30410.log.gz 2024-08-17T02:29:46.261 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29440.log.gz 2024-08-17T02:29:46.262 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29768.log 2024-08-17T02:29:46.262 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30415.log: /var/log/ceph/ceph-client.admin.30201.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30415.log.gz 2024-08-17T02:29:46.263 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30201.log.gz 2024-08-17T02:29:46.263 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30607.log 2024-08-17T02:29:46.263 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33452.log 2024-08-17T02:29:46.264 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33313.log 2024-08-17T02:29:46.265 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30607.log: /var/log/ceph/ceph-client.admin.33452.log: 88.2% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30607.log.gz 2024-08-17T02:29:46.265 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29768.log.gz 2024-08-17T02:29:46.265 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33232.log 2024-08-17T02:29:46.265 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33452.log.gz 2024-08-17T02:29:46.265 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:29:46.266 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33313.log: /var/log/ceph/ceph-client.0.33232.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33313.log.gz 2024-08-17T02:29:46.266 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32310.log 2024-08-17T02:29:46.266 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30412.log 2024-08-17T02:29:46.267 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.32310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33367.log 2024-08-17T02:29:46.267 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32310.log.gz 2024-08-17T02:29:46.267 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34167.log 2024-08-17T02:29:46.268 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30412.log: /var/log/ceph/ceph-client.admin.33367.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30412.log.gz 2024-08-17T02:29:46.269 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30877.log 2024-08-17T02:29:46.269 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33367.log.gz 2024-08-17T02:29:46.270 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32065.log 2024-08-17T02:29:46.272 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31916.log 2024-08-17T02:29:46.272 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30877.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34167.log.gz 2024-08-17T02:29:46.272 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34966.log 2024-08-17T02:29:46.272 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32065.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30877.log.gz 2024-08-17T02:29:46.272 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30688.log 2024-08-17T02:29:46.272 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32065.log.gz 2024-08-17T02:29:46.273 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31916.log.gz 2024-08-17T02:29:46.273 INFO:teuthology.orchestra.run.smithi102.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.0.33232.log.gz 2024-08-17T02:29:46.273 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34966.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34966.log.gz 2024-08-17T02:29:46.275 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32937.log 2024-08-17T02:29:46.275 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29903.log 2024-08-17T02:29:46.275 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30688.log.gz 2024-08-17T02:29:46.276 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34885.log 2024-08-17T02:29:46.276 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32937.log: /var/log/ceph/ceph-client.admin.29903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30985.log 2024-08-17T02:29:46.276 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29903.log.gz 2024-08-17T02:29:46.276 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34885.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:29:46.276 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32937.log.gz 2024-08-17T02:29:46.276 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30958.log 2024-08-17T02:29:46.276 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30985.log.gz 2024-08-17T02:29:46.276 INFO:teuthology.orchestra.run.smithi102.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34885.log.gz 2024-08-17T02:29:46.277 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32391.log 2024-08-17T02:29:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30958.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30958.log.gz 2024-08-17T02:29:46.282 INFO:teuthology.orchestra.run.smithi102.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:29:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30194.log 2024-08-17T02:29:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32391.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32391.log.gz 2024-08-17T02:29:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34424.log 2024-08-17T02:29:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30194.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30194.log.gz 2024-08-17T02:29:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31997.log 2024-08-17T02:29:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29564.log 2024-08-17T02:29:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34424.log: /var/log/ceph/ceph-client.admin.31997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34669.log 2024-08-17T02:29:46.284 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31997.log.gz 2024-08-17T02:29:46.284 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34424.log.gz 2024-08-17T02:29:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34615.log 2024-08-17T02:29:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29564.log: /var/log/ceph/ceph-client.admin.34669.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:29:46.284 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34669.log.gz 2024-08-17T02:29:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34615.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29564.log.gz 2024-08-17T02:29:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34588.log 2024-08-17T02:29:46.284 INFO:teuthology.orchestra.run.smithi102.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34615.log.gz 2024-08-17T02:29:46.285 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34113.log 2024-08-17T02:29:46.285 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.34588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33479.log 2024-08-17T02:29:46.285 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34588.log.gz 2024-08-17T02:29:46.285 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33878.log 2024-08-17T02:29:46.285 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34113.log: /var/log/ceph/ceph-client.admin.33479.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34113.log.gz 2024-08-17T02:29:46.285 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30198.log 2024-08-17T02:29:46.285 INFO:teuthology.orchestra.run.smithi102.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33479.log.gz 2024-08-17T02:29:46.285 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34005.log 2024-08-17T02:29:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34383.log 2024-08-17T02:29:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32572.log 2024-08-17T02:29:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34005.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33878.log.gz 2024-08-17T02:29:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34383.log: gzip -5 --verbose -- 88.1%/var/log/ceph/ceph-client.admin.34140.log 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30198.log.gz 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34005.log.gz 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31397.log 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34383.log.gz 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32572.log: /var/log/ceph/ceph-client.admin.34140.log: gzip -5 --verbose -- 88.3%/var/log/ceph/ceph-client.admin.32790.log 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32572.log.gz 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi102.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34140.log.gz 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31430.log 2024-08-17T02:29:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29876.log 2024-08-17T02:29:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32790.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:29:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31430.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31397.log.gz 2024-08-17T02:29:46.295 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32790.log.gz 2024-08-17T02:29:46.295 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31430.log.gz 2024-08-17T02:29:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33072.log 2024-08-17T02:29:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:gzip /var/log/ceph/ceph-mgr.y.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32283.log 2024-08-17T02:29:46.296 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29876.log.gz 2024-08-17T02:29:46.296 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29741.log 2024-08-17T02:29:46.296 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33072.log: /var/log/ceph/ceph-client.admin.32283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33126.log 2024-08-17T02:29:46.296 INFO:teuthology.orchestra.run.smithi102.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33072.log.gz 2024-08-17T02:29:46.296 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32283.log.gz 2024-08-17T02:29:46.296 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31727.log 2024-08-17T02:29:46.296 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33770.log 2024-08-17T02:29:46.296 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33126.log: /var/log/ceph/ceph-client.admin.31727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29849.log 2024-08-17T02:29:46.297 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29741.log.gz 2024-08-17T02:29:46.297 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33770.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31727.log.gz 2024-08-17T02:29:46.297 INFO:teuthology.orchestra.run.smithi102.stderr:-5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.19237.log 2024-08-17T02:29:46.297 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33770.log.gz 2024-08-17T02:29:46.297 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32229.log 2024-08-17T02:29:46.297 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.33126.log.gz 2024-08-17T02:29:46.297 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34480.log 2024-08-17T02:29:46.298 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.tmp-client.admin.19237.log: /var/log/ceph/ceph-client.admin.32229.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29849.log.gz 2024-08-17T02:29:46.298 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31457.log 2024-08-17T02:29:46.298 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.19237.log.gz 2024-08-17T02:29:46.298 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32229.log.gz 2024-08-17T02:29:46.298 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34480.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34480.log.gz 2024-08-17T02:29:46.304 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31068.log 2024-08-17T02:29:46.304 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29984.log 2024-08-17T02:29:46.304 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33579.log 2024-08-17T02:29:46.305 INFO:teuthology.orchestra.run.smithi102.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31457.log.gz 2024-08-17T02:29:46.305 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32426.log 2024-08-17T02:29:46.305 INFO:teuthology.orchestra.run.smithi102.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31068.log.gz 2024-08-17T02:29:46.305 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29984.log: /var/log/ceph/ceph-client.admin.33579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32202.log 2024-08-17T02:29:46.305 INFO:teuthology.orchestra.run.smithi102.stderr: 89.6% 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.29984.log.gz-5 --verbose 2024-08-17T02:29:46.305 INFO:teuthology.orchestra.run.smithi102.stderr:-- /var/log/ceph/ceph-client.admin.34059.log 2024-08-17T02:29:46.305 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33579.log.gz 2024-08-17T02:29:46.306 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32426.log: /var/log/ceph/ceph-client.admin.32202.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32426.log.gz 2024-08-17T02:29:46.306 INFO:teuthology.orchestra.run.smithi102.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32202.log.gz 2024-08-17T02:29:46.306 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30413.log 2024-08-17T02:29:46.306 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34059.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34059.log.gz 2024-08-17T02:29:46.306 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31646.log 2024-08-17T02:29:46.306 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33797.log 2024-08-17T02:29:46.306 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30413.log: /var/log/ceph/ceph-client.admin.31646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32854.log 2024-08-17T02:29:46.307 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30413.log.gz 2024-08-17T02:29:46.307 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33824.log 2024-08-17T02:29:46.307 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33797.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31646.log.gz 2024-08-17T02:29:46.307 INFO:teuthology.orchestra.run.smithi102.stderr:gzip /var/log/ceph/ceph-client.admin.32854.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31484.log 2024-08-17T02:29:46.307 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33797.log.gz 2024-08-17T02:29:46.307 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34696.log 2024-08-17T02:29:46.307 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32854.log.gz 2024-08-17T02:29:46.307 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32680.log 2024-08-17T02:29:46.308 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33824.log.gz 2024-08-17T02:29:46.308 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31484.log: /var/log/ceph/ceph-client.admin.34696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33552.log 2024-08-17T02:29:46.308 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:29:46.308 INFO:teuthology.orchestra.run.smithi102.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31484.log.gz 2024-08-17T02:29:46.309 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34696.log.gz 2024-08-17T02:29:46.309 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32680.log: /var/log/ceph/ceph-client.admin.33552.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32680.log.gz 2024-08-17T02:29:46.309 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33552.log.gz 2024-08-17T02:29:46.309 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32119.log 2024-08-17T02:29:46.309 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32991.log 2024-08-17T02:29:46.309 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34912.log 2024-08-17T02:29:46.309 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32119.log.gz 2024-08-17T02:29:46.310 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32991.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32991.log.gz 2024-08-17T02:29:46.310 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:29:46.310 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30121.log 2024-08-17T02:29:46.310 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24100.log 2024-08-17T02:29:46.310 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34912.log.gz 2024-08-17T02:29:46.315 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33045.log 2024-08-17T02:29:46.315 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30823.log 2024-08-17T02:29:46.315 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.24100.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30121.log.gz 2024-08-17T02:29:46.315 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29683.log 2024-08-17T02:29:46.315 INFO:teuthology.orchestra.run.smithi102.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.24100.log.gz 2024-08-17T02:29:46.315 INFO:teuthology.orchestra.run.smithi102.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33045.log.gz 2024-08-17T02:29:46.316 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30742.log 2024-08-17T02:29:46.316 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31754.log 2024-08-17T02:29:46.316 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30823.log.gz 2024-08-17T02:29:46.316 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29957.log 2024-08-17T02:29:46.316 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30742.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29683.log.gz 2024-08-17T02:29:46.316 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29930.log 2024-08-17T02:29:46.317 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31754.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30742.log.gz 2024-08-17T02:29:46.317 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31565.log 2024-08-17T02:29:46.317 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31754.log.gz 2024-08-17T02:29:46.317 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.29930.log: -- /var/log/ceph/ceph-client.admin.31862.log 2024-08-17T02:29:46.317 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29957.log.gz 2024-08-17T02:29:46.317 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31565.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29930.log.gz 2024-08-17T02:29:46.317 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31565.log.gz 2024-08-17T02:29:46.318 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30202.log 2024-08-17T02:29:46.318 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33177.log 2024-08-17T02:29:46.318 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose 88.4%-- /var/log/ceph/ceph-client.admin.34329.log -- replaced with /var/log/ceph/ceph-client.admin.31862.log.gz 2024-08-17T02:29:46.318 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-08-17T02:29:46.318 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30407.log 2024-08-17T02:29:46.318 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33177.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30202.log.gz 2024-08-17T02:29:46.318 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29656.log 2024-08-17T02:29:46.319 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34329.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33177.log.gz 2024-08-17T02:29:46.319 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32092.log 2024-08-17T02:29:46.319 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34329.log.gz 2024-08-17T02:29:46.319 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30931.log 2024-08-17T02:29:46.319 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29656.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30407.log.gz 2024-08-17T02:29:46.319 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29656.log.gz 2024-08-17T02:29:46.319 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32092.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32092.log.gz 2024-08-17T02:29:46.330 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24179.log 2024-08-17T02:29:46.330 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24229.log 2024-08-17T02:29:46.331 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.24179.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:29:46.331 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.24179.log.gz 2024-08-17T02:29:46.331 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:29:46.331 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.24229.log: /var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24347.log 2024-08-17T02:29:46.331 INFO:teuthology.orchestra.run.smithi121.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.24229.log.gz 2024-08-17T02:29:46.331 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24271.log 2024-08-17T02:29:46.331 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.24347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.29504.log 2024-08-17T02:29:46.332 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.24271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24297.log 2024-08-17T02:29:46.332 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.24347.log.gz 2024-08-17T02:29:46.332 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:29:46.332 INFO:teuthology.orchestra.run.smithi121.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.24271.log.gz 2024-08-17T02:29:46.332 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.1.29504.log: /var/log/ceph/ceph-client.admin.24297.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24297.log.gz 2024-08-17T02:29:46.332 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.29339.log 2024-08-17T02:29:46.332 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:29:46.332 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.3.29339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24204.log 2024-08-17T02:29:46.333 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:29:46.333 INFO:teuthology.orchestra.run.smithi121.stderr: 88.5%/var/log/ceph/ceph-client.admin.24204.log: -- replaced with /var/log/ceph/ceph-client.3.29339.log.gz 2024-08-17T02:29:46.333 INFO:teuthology.orchestra.run.smithi121.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.24204.log.gz 2024-08-17T02:29:46.333 INFO:teuthology.orchestra.run.smithi121.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.1.29504.log.gz 2024-08-17T02:29:46.333 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:29:46.333 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:29:46.333 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24322.log 2024-08-17T02:29:46.333 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-osd.6.log: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:29:46.334 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24375.log 2024-08-17T02:29:46.334 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.24322.log: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:29:46.334 INFO:teuthology.orchestra.run.smithi121.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24322.log.gz 2024-08-17T02:29:46.334 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:29:46.334 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:29:46.338 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.24375.log: /var/log/ceph/ceph-mds.b.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.24375.log.gz 2024-08-17T02:29:46.338 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.29226.log 2024-08-17T02:29:46.339 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph.log: 91.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:29:46.339 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:29:46.339 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.1.29226.log: 89.7% -- replaced with /var/log/ceph/ceph-client.1.29226.log.gz 2024-08-17T02:29:46.339 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:29:46.339 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.4.log: 92.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:29:46.356 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.7.log: 91.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:29:46.362 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34993.log 2024-08-17T02:29:46.362 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34561.log 2024-08-17T02:29:46.362 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32881.log 2024-08-17T02:29:46.362 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34993.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30931.log.gz 2024-08-17T02:29:46.362 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33394.log 2024-08-17T02:29:46.363 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34993.log.gz 2024-08-17T02:29:46.363 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34561.log.gz 2024-08-17T02:29:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.31320.log 2024-08-17T02:29:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32881.log: /var/log/ceph/ceph-client.admin.33394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30715.log 2024-08-17T02:29:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32653.log 2024-08-17T02:29:46.363 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32881.log.gz 2024-08-17T02:29:46.363 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33394.log.gz 2024-08-17T02:29:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.2.31320.log: /var/log/ceph/ceph-client.admin.30715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30419.log 2024-08-17T02:29:46.364 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30715.log.gz 2024-08-17T02:29:46.364 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32490.log 2024-08-17T02:29:46.364 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32910.log 2024-08-17T02:29:46.364 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30419.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:29:46.364 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32490.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32653.log.gz 2024-08-17T02:29:46.364 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.2.31320.log.gz 2024-08-17T02:29:46.364 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30419.log.gz 2024-08-17T02:29:46.365 INFO:teuthology.orchestra.run.smithi102.stderr:gzip 88.8%-5 -- replaced with /var/log/ceph/ceph-client.admin.32490.log.gz--verbose 2024-08-17T02:29:46.365 INFO:teuthology.orchestra.run.smithi102.stderr:-- /var/log/ceph/ceph-client.admin.31970.log 2024-08-17T02:29:46.365 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30067.log 2024-08-17T02:29:46.365 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32910.log: /var/log/ceph/ceph-client.admin.31970.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:29:46.365 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32910.log.gz 2024-08-17T02:29:46.365 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31970.log.gz 2024-08-17T02:29:46.365 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30196.log 2024-08-17T02:29:46.365 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30067.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34831.log 2024-08-17T02:29:46.366 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30067.log.gz 2024-08-17T02:29:46.366 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33662.log 2024-08-17T02:29:46.366 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30196.log: /var/log/ceph/ceph-client.admin.34831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31673.log 2024-08-17T02:29:46.366 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30196.log.gz 2024-08-17T02:29:46.366 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29596.log 2024-08-17T02:29:46.366 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34831.log.gz 2024-08-17T02:29:46.366 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30094.log 2024-08-17T02:29:46.367 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31673.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32734.log 2024-08-17T02:29:46.367 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29596.log: -- replaced with /var/log/ceph/ceph-client.admin.33662.log.gz 2024-08-17T02:29:46.367 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33851.log 2024-08-17T02:29:46.367 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30094.log: 87.8% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31673.log.gz 2024-08-17T02:29:46.367 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29596.log.gz 2024-08-17T02:29:46.367 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- 88.6%/var/log/ceph/ceph-client.admin.30011.log -- replaced with /var/log/ceph/ceph-client.admin.30094.log.gz 2024-08-17T02:29:46.367 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-08-17T02:29:46.367 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34858.log 2024-08-17T02:29:46.368 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33851.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32734.log.gz 2024-08-17T02:29:46.368 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34777.log 2024-08-17T02:29:46.368 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33851.log.gz 2024-08-17T02:29:46.368 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32761.log 2024-08-17T02:29:46.368 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30011.log.gz 2024-08-17T02:29:46.368 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34642.log 2024-08-17T02:29:46.368 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34858.log.gz 2024-08-17T02:29:46.368 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30661.log 2024-08-17T02:29:46.369 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34777.log.gz 2024-08-17T02:29:46.369 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32337.log 2024-08-17T02:29:46.369 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34642.log: gzip -5 88.0%--verbose -- /var/log/ceph/ceph-client.admin.24223.log -- replaced with /var/log/ceph/ceph-client.admin.32761.log.gz 2024-08-17T02:29:46.369 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-08-17T02:29:46.369 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30661.log: 88.3%/var/log/ceph/ceph-client.admin.32337.log: -- replaced with /var/log/ceph/ceph-client.admin.34642.log.gz 2024-08-17T02:29:46.369 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30661.log.gz 2024-08-17T02:29:46.369 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32337.log.gz 2024-08-17T02:29:46.370 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34302.log 2024-08-17T02:29:46.370 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34275.log 2024-08-17T02:29:46.370 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.24223.log: /var/log/ceph/ceph-client.admin.34302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33425.log 2024-08-17T02:29:46.370 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.24223.log.gz 2024-08-17T02:29:46.370 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31889.log 2024-08-17T02:29:46.370 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34275.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34302.log.gz 2024-08-17T02:29:46.370 INFO:teuthology.orchestra.run.smithi102.stderr:gzip /var/log/ceph/ceph-client.admin.33425.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33606.log 2024-08-17T02:29:46.370 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34275.log.gz 2024-08-17T02:29:46.371 INFO:teuthology.orchestra.run.smithi102.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33425.log.gz 2024-08-17T02:29:46.371 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32175.log 2024-08-17T02:29:46.371 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31889.log.gz 2024-08-17T02:29:46.371 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33340.log 2024-08-17T02:29:46.371 INFO:teuthology.orchestra.run.smithi102.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:29:46.371 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33606.log.gz 2024-08-17T02:29:46.371 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31227.log 2024-08-17T02:29:46.371 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32175.log.gz 2024-08-17T02:29:46.372 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30038.log 2024-08-17T02:29:46.372 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29404.log 2024-08-17T02:29:46.372 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31227.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33340.log.gz 2024-08-17T02:29:46.372 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.30038.log: -- /var/log/ceph/ceph-client.admin.34086.log 2024-08-17T02:29:46.372 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31227.log.gz 2024-08-17T02:29:46.372 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log 2024-08-17T02:29:46.372 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29404.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30038.log.gz 2024-08-17T02:29:46.373 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32038.log 2024-08-17T02:29:46.373 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29404.log.gz 2024-08-17T02:29:46.373 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35074.log 2024-08-17T02:29:46.373 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34356.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34086.log.gz 2024-08-17T02:29:46.373 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33018.log 2024-08-17T02:29:46.373 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32038.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34356.log.gz 2024-08-17T02:29:46.373 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32544.log 2024-08-17T02:29:46.374 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35074.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32038.log.gz 2024-08-17T02:29:46.374 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30199.log 2024-08-17T02:29:46.374 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35074.log.gz 2024-08-17T02:29:46.374 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33018.log.gz 2024-08-17T02:29:46.374 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30200.log 2024-08-17T02:29:46.374 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32544.log: /var/log/ceph/ceph-client.admin.30199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33716.log 2024-08-17T02:29:46.374 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32544.log.gz 2024-08-17T02:29:46.375 INFO:teuthology.orchestra.run.smithi102.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30199.log.gz 2024-08-17T02:29:46.375 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34032.log 2024-08-17T02:29:46.375 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30409.log 2024-08-17T02:29:46.375 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33716.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30200.log.gz 2024-08-17T02:29:46.375 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32146.log 2024-08-17T02:29:46.375 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33716.log.gz 2024-08-17T02:29:46.375 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30904.log 2024-08-17T02:29:46.376 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30409.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34032.log.gz 2024-08-17T02:29:46.376 INFO:teuthology.orchestra.run.smithi102.stderr:gzip /var/log/ceph/ceph-client.admin.32146.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31012.log 2024-08-17T02:29:46.376 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30409.log.gz 2024-08-17T02:29:46.376 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32146.log.gz 2024-08-17T02:29:46.376 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34804.log 2024-08-17T02:29:46.376 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33743.log 2024-08-17T02:29:46.376 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31012.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30904.log.gz 2024-08-17T02:29:46.377 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33286.log 2024-08-17T02:29:46.377 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33978.log 2024-08-17T02:29:46.377 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33743.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34804.log.gz 2024-08-17T02:29:46.377 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.31012.log.gz 2024-08-17T02:29:46.377 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32256.log 2024-08-17T02:29:46.377 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33286.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33743.log.gz 2024-08-17T02:29:46.377 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30148.log 2024-08-17T02:29:46.377 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33286.log.gz 2024-08-17T02:29:46.378 INFO:teuthology.orchestra.run.smithi102.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33978.log.gz 2024-08-17T02:29:46.378 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34221.log 2024-08-17T02:29:46.378 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32256.log.gz 2024-08-17T02:29:46.378 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32819.log 2024-08-17T02:29:46.378 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30148.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:29:46.378 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34221.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30148.log.gz 2024-08-17T02:29:46.378 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34507.log 2024-08-17T02:29:46.379 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32819.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:29:46.379 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34221.log.gz 2024-08-17T02:29:46.379 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32819.log.gz 2024-08-17T02:29:46.379 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31835.log 2024-08-17T02:29:46.379 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34507.log: /var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35022.log 2024-08-17T02:29:46.379 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% 84.4% -- replaced with /var/log/ceph/ceph-client.admin.34507.log.gz 2024-08-17T02:29:46.379 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:29:46.379 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33633.log 2024-08-17T02:29:46.380 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31835.log: /var/log/ceph/ceph-client.admin.35022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32517.log 2024-08-17T02:29:46.380 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31835.log.gz 2024-08-17T02:29:46.380 INFO:teuthology.orchestra.run.smithi102.stderr:gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35022.log.gz-5 2024-08-17T02:29:46.380 INFO:teuthology.orchestra.run.smithi102.stderr:--verbose -- /var/log/ceph/ceph-client.admin.34248.log 2024-08-17T02:29:46.380 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33633.log: /var/log/ceph/ceph-client.admin.32517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31370.log 2024-08-17T02:29:46.380 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33633.log.gz 2024-08-17T02:29:46.380 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29623.log 2024-08-17T02:29:46.380 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32517.log.gz 2024-08-17T02:29:46.381 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34248.log: /var/log/ceph/ceph-client.admin.31370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33099.log 2024-08-17T02:29:46.381 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34248.log.gz 2024-08-17T02:29:46.381 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29712.log 2024-08-17T02:29:46.381 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31370.log.gz 2024-08-17T02:29:46.381 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29623.log: /var/log/ceph/ceph-client.admin.33099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34939.log 2024-08-17T02:29:46.381 INFO:teuthology.orchestra.run.smithi102.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29623.log.gz 2024-08-17T02:29:46.381 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32626.log 2024-08-17T02:29:46.382 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33099.log.gz 2024-08-17T02:29:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34939.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29712.log.gz 2024-08-17T02:29:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30769.log 2024-08-17T02:29:46.382 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34939.log.gz 2024-08-17T02:29:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33951.log 2024-08-17T02:29:46.382 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32626.log.gz/var/log/ceph/ceph-client.admin.30769.log: 2024-08-17T02:29:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34534.log 2024-08-17T02:29:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31538.log 2024-08-17T02:29:46.383 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33951.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30769.log.gz 2024-08-17T02:29:46.383 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31700.log 2024-08-17T02:29:46.383 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34534.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33951.log.gz 2024-08-17T02:29:46.383 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31808.log 2024-08-17T02:29:46.383 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34534.log.gz 2024-08-17T02:29:46.383 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31511.log 2024-08-17T02:29:46.383 INFO:teuthology.orchestra.run.smithi102.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31538.log.gz 2024-08-17T02:29:46.384 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29795.log 2024-08-17T02:29:46.384 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31808.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31700.log.gz 2024-08-17T02:29:46.384 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34194.log 2024-08-17T02:29:46.384 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31511.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31808.log.gz 2024-08-17T02:29:46.384 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30634.log 2024-08-17T02:29:46.384 INFO:teuthology.orchestra.run.smithi102.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31511.log.gz 2024-08-17T02:29:46.384 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34194.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29795.log.gz 2024-08-17T02:29:46.384 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34750.log 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30634.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi102.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34194.log.gz 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi102.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30634.log.gz 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31179.log 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33905.log 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.3.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34750.log.gz 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35047.log 2024-08-17T02:29:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.31179.log: /var/log/ceph/ceph-client.admin.33905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34453.log 2024-08-17T02:29:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31943.log 2024-08-17T02:29:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35047.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33905.log.gz 2024-08-17T02:29:46.386 INFO:teuthology.orchestra.run.smithi102.stderr: 90.7% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35047.log.gz/var/log/ceph/ceph-client.admin.34453.log: 2024-08-17T02:29:46.386 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.31179.log.gz 2024-08-17T02:29:46.386 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34453.log.gz 2024-08-17T02:29:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32964.log 2024-08-17T02:29:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33506.log 2024-08-17T02:29:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33689.log 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4%/var/log/ceph/ceph-client.admin.32964.log: -- replaced with /var/log/ceph/ceph-client.admin.31943.log.gz 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33506.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32964.log.gz 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi102.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33506.log.gz 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24362.log 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31781.log 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33689.log: /var/log/ceph/ceph-client.admin.24362.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33689.log.gz 2024-08-17T02:29:46.387 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29506.log 2024-08-17T02:29:46.388 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.24362.log.gz 2024-08-17T02:29:46.388 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31619.log 2024-08-17T02:29:46.388 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29822.log 2024-08-17T02:29:46.388 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29506.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31781.log.gz 2024-08-17T02:29:46.388 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31592.log 2024-08-17T02:29:46.388 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29506.log.gz 2024-08-17T02:29:46.388 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34723.log 2024-08-17T02:29:46.388 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29822.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31619.log.gz 2024-08-17T02:29:46.389 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31592.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29822.log.gz 2024-08-17T02:29:46.389 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31592.log.gz 2024-08-17T02:29:46.389 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32707.log 2024-08-17T02:29:46.389 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30850.log 2024-08-17T02:29:46.389 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34723.log: gzip -5 --verbose /var/log/ceph/ceph-client.admin.32707.log: -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:29:46.389 INFO:teuthology.orchestra.run.smithi102.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34723.log.gz 2024-08-17T02:29:46.389 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32599.log 2024-08-17T02:29:46.389 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30850.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32707.log.gz 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30414.log 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30850.log.gz 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30203.log 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32599.log: /var/log/ceph/ceph-client.admin.30414.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32599.log.gz 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi102.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.30414.log.gz 2024-08-17T02:29:46.390 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30203.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30203.log.gz 2024-08-17T02:29:46.427 INFO:teuthology.orchestra.run.smithi121.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:29:46.447 INFO:teuthology.orchestra.run.smithi121.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:29:46.463 INFO:teuthology.orchestra.run.smithi121.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:29:46.466 INFO:teuthology.orchestra.run.smithi102.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:29:46.509 INFO:teuthology.orchestra.run.smithi121.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:29:46.523 INFO:teuthology.orchestra.run.smithi121.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:29:46.533 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:29:46.541 INFO:teuthology.orchestra.run.smithi102.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:29:46.551 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:29:46.563 INFO:teuthology.orchestra.run.smithi121.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:29:46.564 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-08-17T02:29:46.565 INFO:teuthology.orchestra.run.smithi121.stderr:real 0m0.274s 2024-08-17T02:29:46.565 INFO:teuthology.orchestra.run.smithi121.stderr:user 0m1.049s 2024-08-17T02:29:46.565 INFO:teuthology.orchestra.run.smithi121.stderr:sys 0m0.056s 2024-08-17T02:29:46.566 INFO:teuthology.orchestra.run.smithi102.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:29:46.568 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-08-17T02:29:46.568 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m0.329s 2024-08-17T02:29:46.568 INFO:teuthology.orchestra.run.smithi102.stderr:user 0m1.311s 2024-08-17T02:29:46.568 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m0.083s 2024-08-17T02:29:46.568 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:29:46.569 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858253/remote/smithi102/log 2024-08-17T02:29:46.569 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:29:46.874 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858253/remote/smithi121/log 2024-08-17T02:29:46.875 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:29:47.031 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:29:47.053 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:29:47.053 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:29:47.056 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:29:47.121 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:29:47.132 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:29:47.132 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:29:47.135 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:29:47.158 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:29:47.159 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2024-08-17T02:29:47.159 INFO:teuthology.orchestra.run.smithi102.stdout:*hv01.front.sepi 67.205.162.81 3 u 5 64 377 0.076 0.486 0.193 2024-08-17T02:29:47.159 INFO:teuthology.orchestra.run.smithi102.stdout:+hv02.front.sepi 63.231.80.2 3 u 63 64 177 0.071 0.435 0.243 2024-08-17T02:29:47.159 INFO:teuthology.orchestra.run.smithi102.stdout:+hv03.front.sepi 74.6.168.72 3 u 3 64 377 0.063 0.586 0.331 2024-08-17T02:29:47.159 INFO:teuthology.orchestra.run.smithi102.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:29:47.159 INFO:teuthology.orchestra.run.smithi121.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:29:47.160 INFO:teuthology.orchestra.run.smithi121.stdout:============================================================================== 2024-08-17T02:29:47.160 INFO:teuthology.orchestra.run.smithi121.stdout:+hv01.front.sepi 67.205.162.81 3 u 61 64 177 0.092 0.658 0.547 2024-08-17T02:29:47.160 INFO:teuthology.orchestra.run.smithi121.stdout:*hv02.front.sepi 63.231.80.2 3 u - 64 377 0.068 0.494 0.636 2024-08-17T02:29:47.160 INFO:teuthology.orchestra.run.smithi121.stdout:+hv03.front.sepi 74.6.168.72 3 u 63 64 177 0.106 0.557 0.497 2024-08-17T02:29:47.160 INFO:teuthology.orchestra.run.smithi121.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:29:47.162 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:29:47.178 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:29:47.179 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:29:47.192 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:29:47.206 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:29:47.220 INFO:teuthology.task.internal:Duration was 808.071988 seconds 2024-08-17T02:29:47.220 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:29:47.232 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:29:47.232 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:29:47.234 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:29:47.284 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:29:47.285 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-08-17T02:29:47.285 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:29:47.296 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2024-08-17T02:29:47.296 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:29:47.308 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:29:47.308 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:29:47.339 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:29:47.377 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:29:47.377 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:29:47.380 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:29:47.492 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:29:47.503 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:29:47.503 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:29:47.520 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:29:47.535 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:29:47.546 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:29:47.563 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:29:47.576 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-08-17T02:29:47.577 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2024-08-17T02:29:47.593 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:29:47.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:47.599 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:29:47.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:47.643 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:29:47.654 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:29:47.655 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858253/remote/smithi102 2024-08-17T02:29:47.655 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:29:47.682 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858253/remote/smithi121 2024-08-17T02:29:47.682 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:29:47.708 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:29:47.708 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:29:47.727 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:29:47.734 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:29:47.743 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:29:47.744 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:29:47.823 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:29:47.823 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:29:47.826 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:29:47.831 INFO:teuthology.orchestra.run.smithi102.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:29 /home/ubuntu/cephtest 2024-08-17T02:29:47.833 INFO:teuthology.orchestra.run.smithi121.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:29 /home/ubuntu/cephtest 2024-08-17T02:29:47.836 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:29:47.848 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:29:47.891 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 808.0719878673553 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=064c69340f68449fb3b1bf23dd22311d status: fail success: false 2024-08-17T02:29:47.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:29:47.972 INFO:teuthology.run:FAIL